May 26 11:24:42.500577 ip-10-0-133-99 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 26 11:24:42.500592 ip-10-0-133-99 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 26 11:24:42.500601 ip-10-0-133-99 systemd[1]: kubelet.service: Failed with result 'resources'. May 26 11:24:42.500961 ip-10-0-133-99 systemd[1]: Failed to start Kubernetes Kubelet. May 26 11:24:52.621634 ip-10-0-133-99 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 26 11:24:52.621652 ip-10-0-133-99 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 78159bb1247841caa6fdaef27d7013ab -- May 26 11:27:24.194809 ip-10-0-133-99 systemd[1]: Starting Kubernetes Kubelet... May 26 11:27:24.593314 ip-10-0-133-99 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 11:27:24.593314 ip-10-0-133-99 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 11:27:24.593314 ip-10-0-133-99 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 11:27:24.593314 ip-10-0-133-99 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 11:27:24.593314 ip-10-0-133-99 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 11:27:24.596388 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.596292 2551 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 11:27:24.602549 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602529 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:27:24.602549 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602546 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:27:24.602549 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602550 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:27:24.602549 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602554 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602558 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602561 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602564 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602567 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602569 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602572 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602574 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602577 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602579 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602582 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602586 2551 feature_gate.go:328] unrecognized feature gate: Example May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602588 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602593 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602597 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602601 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602604 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602607 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602611 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:27:24.602724 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602614 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602617 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602620 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602623 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602625 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602628 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602630 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602633 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602635 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602638 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602647 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602650 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602653 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602655 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602658 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602661 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602664 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602667 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602669 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602672 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:27:24.603204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602674 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602677 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602679 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602682 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602685 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602687 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602690 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602692 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602695 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602697 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602700 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602703 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602705 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602708 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602710 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602713 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602716 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602719 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602722 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:27:24.603714 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602724 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602727 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602730 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602732 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602735 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602737 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602740 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602743 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602747 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602750 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602752 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602755 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602757 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602760 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602762 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602765 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602767 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602770 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602773 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602776 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:27:24.604197 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602778 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602780 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602783 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602786 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.602788 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603162 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603167 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603170 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603172 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603175 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603178 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603180 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603183 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603188 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603191 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603194 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603197 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603200 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603203 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603206 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:27:24.604711 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603209 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603212 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603215 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603218 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603220 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603223 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603226 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603228 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603231 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603234 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603236 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603239 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603241 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603243 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603246 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603249 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603251 2551 feature_gate.go:328] unrecognized feature gate: Example May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603254 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603257 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603259 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:27:24.605183 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603262 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603264 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603267 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603270 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603274 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603277 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603279 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603282 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603284 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603286 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603289 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603291 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603294 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603299 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603301 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603304 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603306 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603309 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603311 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:27:24.605727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603314 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603317 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603319 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603322 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603325 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603328 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603330 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603333 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603335 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603338 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603340 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603343 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603345 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603348 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603350 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603353 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603355 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603357 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603360 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603362 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:27:24.606218 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603365 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603368 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603370 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603374 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603377 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603380 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603383 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603386 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603388 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603391 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603393 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.603396 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604040 2551 flags.go:64] FLAG: --address="0.0.0.0" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604049 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604056 2551 flags.go:64] FLAG: --anonymous-auth="true" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604061 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604065 2551 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604069 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604073 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604081 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604085 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 11:27:24.606727 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604088 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604091 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604095 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604098 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604100 2551 flags.go:64] FLAG: --cgroup-root="" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604103 2551 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604106 2551 flags.go:64] FLAG: --client-ca-file="" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604109 2551 flags.go:64] FLAG: --cloud-config="" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604112 2551 flags.go:64] FLAG: --cloud-provider="external" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604115 2551 flags.go:64] FLAG: --cluster-dns="[]" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604118 2551 flags.go:64] FLAG: --cluster-domain="" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604121 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604124 2551 flags.go:64] FLAG: --config-dir="" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604127 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604131 2551 flags.go:64] FLAG: --container-log-max-files="5" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604137 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604141 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604144 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604147 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604150 2551 flags.go:64] FLAG: --contention-profiling="false" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604153 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604156 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604159 2551 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604162 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604166 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 11:27:24.607237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604169 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604172 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604175 2551 flags.go:64] FLAG: --enable-load-reader="false" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604179 2551 flags.go:64] FLAG: --enable-server="true" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604182 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604187 2551 flags.go:64] FLAG: --event-burst="100" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604190 2551 flags.go:64] FLAG: --event-qps="50" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604193 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604196 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604199 2551 flags.go:64] FLAG: --eviction-hard="" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604203 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604206 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604209 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604212 2551 flags.go:64] FLAG: --eviction-soft="" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604215 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604218 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604221 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604224 2551 flags.go:64] FLAG: --experimental-mounter-path="" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604227 2551 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604230 2551 flags.go:64] FLAG: --fail-swap-on="true" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604233 2551 flags.go:64] FLAG: --feature-gates="" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604237 2551 flags.go:64] FLAG: --file-check-frequency="20s" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604241 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604244 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604248 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604251 2551 flags.go:64] FLAG: --healthz-port="10248" May 26 11:27:24.607872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604254 2551 flags.go:64] FLAG: --help="false" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604257 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-133-99.ec2.internal" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604260 2551 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604263 2551 flags.go:64] FLAG: --http-check-frequency="20s" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604266 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604269 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604273 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604276 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604279 2551 flags.go:64] FLAG: --image-service-endpoint="" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604281 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604285 2551 flags.go:64] FLAG: --kube-api-burst="100" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604288 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604291 2551 flags.go:64] FLAG: --kube-api-qps="50" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604294 2551 flags.go:64] FLAG: --kube-reserved="" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604297 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604300 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604303 2551 flags.go:64] FLAG: --kubelet-cgroups="" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604305 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604309 2551 flags.go:64] FLAG: --lock-file="" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604312 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604314 2551 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604317 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604323 2551 flags.go:64] FLAG: --log-json-split-stream="false" May 26 11:27:24.608533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604335 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604339 2551 flags.go:64] FLAG: --log-text-split-stream="false" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604342 2551 flags.go:64] FLAG: --logging-format="text" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604345 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604348 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604352 2551 flags.go:64] FLAG: --manifest-url="" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604355 2551 flags.go:64] FLAG: --manifest-url-header="" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604360 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604363 2551 flags.go:64] FLAG: --max-open-files="1000000" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604367 2551 flags.go:64] FLAG: --max-pods="110" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604370 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604373 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604376 2551 flags.go:64] FLAG: --memory-manager-policy="None" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604379 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604382 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604385 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604388 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604398 2551 flags.go:64] FLAG: --node-status-max-images="50" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604401 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604404 2551 flags.go:64] FLAG: --oom-score-adj="-999" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604408 2551 flags.go:64] FLAG: --pod-cidr="" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604410 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604416 2551 flags.go:64] FLAG: --pod-manifest-path="" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604419 2551 flags.go:64] FLAG: --pod-max-pids="-1" May 26 11:27:24.609139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604422 2551 flags.go:64] FLAG: --pods-per-core="0" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604425 2551 flags.go:64] FLAG: --port="10250" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604428 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604431 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d657e70653d9f690" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604434 2551 flags.go:64] FLAG: --qos-reserved="" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604437 2551 flags.go:64] FLAG: --read-only-port="10255" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604440 2551 flags.go:64] FLAG: --register-node="true" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604443 2551 flags.go:64] FLAG: --register-schedulable="true" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604445 2551 flags.go:64] FLAG: --register-with-taints="" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604449 2551 flags.go:64] FLAG: --registry-burst="10" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604466 2551 flags.go:64] FLAG: --registry-qps="5" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604469 2551 flags.go:64] FLAG: --reserved-cpus="" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604472 2551 flags.go:64] FLAG: --reserved-memory="" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604477 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604480 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604483 2551 flags.go:64] FLAG: --rotate-certificates="false" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604486 2551 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604489 2551 flags.go:64] FLAG: --runonce="false" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604492 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604495 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604498 2551 flags.go:64] FLAG: --seccomp-default="false" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604501 2551 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604504 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604507 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604510 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604513 2551 flags.go:64] FLAG: --storage-driver-password="root" May 26 11:27:24.609731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604517 2551 flags.go:64] FLAG: --storage-driver-secure="false" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604520 2551 flags.go:64] FLAG: --storage-driver-table="stats" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604523 2551 flags.go:64] FLAG: --storage-driver-user="root" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604526 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604529 2551 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604532 2551 flags.go:64] FLAG: --system-cgroups="" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604535 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604540 2551 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604543 2551 flags.go:64] FLAG: --tls-cert-file="" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604546 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604550 2551 flags.go:64] FLAG: --tls-min-version="" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604553 2551 flags.go:64] FLAG: --tls-private-key-file="" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604556 2551 flags.go:64] FLAG: --topology-manager-policy="none" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604559 2551 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604561 2551 flags.go:64] FLAG: --topology-manager-scope="container" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604564 2551 flags.go:64] FLAG: --v="2" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604569 2551 flags.go:64] FLAG: --version="false" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604573 2551 flags.go:64] FLAG: --vmodule="" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604578 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.604583 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604690 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604694 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604697 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604700 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:27:24.610341 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604703 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604706 2551 feature_gate.go:328] unrecognized feature gate: Example May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604709 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604712 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604715 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604718 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604720 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604723 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604727 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604730 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604733 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604735 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604738 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604741 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604744 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604747 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604749 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604752 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604755 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:27:24.610945 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604758 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604761 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604763 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604766 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604768 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604771 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604773 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604776 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604780 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604782 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604785 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604787 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604790 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604793 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604795 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604797 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604800 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604803 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604805 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604808 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:27:24.611429 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604810 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604813 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604816 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604819 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604822 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604824 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604827 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604830 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604832 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604835 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604838 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604840 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604842 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604845 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604847 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604850 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604853 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604855 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604858 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604860 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:27:24.611950 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604864 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604867 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604870 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604872 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604875 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604877 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604881 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604884 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604888 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604891 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604893 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604897 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604901 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604905 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604908 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604910 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604913 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604915 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604918 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:27:24.612489 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604921 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604924 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604926 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.604929 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.605576 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.612089 2551 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.612107 2551 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612167 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612172 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612176 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612179 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612182 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612185 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612188 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612191 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612193 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:27:24.612954 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612196 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612199 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612202 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612204 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612207 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612210 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612212 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612215 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612218 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612220 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612224 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612226 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612229 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612231 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612234 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612237 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612239 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612241 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612244 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612246 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:27:24.613348 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612249 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612252 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612261 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612264 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612266 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612269 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612271 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612274 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612276 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612279 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612281 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612284 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612286 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612289 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612293 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612296 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612299 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612302 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612304 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612307 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:27:24.613850 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612309 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612312 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612314 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612317 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612319 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612322 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612333 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612336 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612338 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612341 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612344 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612346 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612348 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612351 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612355 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612364 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612367 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612369 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612371 2551 feature_gate.go:328] unrecognized feature gate: Example May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612374 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:27:24.614330 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612376 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612379 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612381 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612384 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612387 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612389 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612392 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612395 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612398 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612400 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612403 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612405 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612408 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612411 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612414 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612416 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:27:24.614816 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612420 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.612426 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612569 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612575 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612578 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612581 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612584 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612587 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612590 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612593 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612596 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612599 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612602 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612605 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612608 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612611 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 11:27:24.615235 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612613 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612616 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612618 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612621 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612624 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612628 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612631 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612634 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612636 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612639 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612641 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612644 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612646 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612649 2551 feature_gate.go:328] unrecognized feature gate: Example May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612651 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612654 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612656 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612659 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612661 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 11:27:24.615639 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612664 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612666 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612669 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612671 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612674 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612676 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612678 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612681 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612684 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612686 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612689 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612691 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612694 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612696 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612699 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612701 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612703 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612706 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612708 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 11:27:24.616163 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612711 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612713 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612716 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612718 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612721 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612724 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612726 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612729 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612731 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612734 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612736 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612739 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612741 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612744 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612746 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612749 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612751 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612754 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612756 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612759 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 11:27:24.616671 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612761 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612764 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612768 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612772 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612775 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612778 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612780 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612783 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612786 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612788 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612791 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612793 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612796 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:24.612799 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.612803 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 11:27:24.617159 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.613554 2551 server.go:962] "Client rotation is on, will bootstrap in background" May 26 11:27:24.617532 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.615906 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 11:27:24.617532 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.616850 2551 server.go:1019] "Starting client certificate rotation" May 26 11:27:24.617532 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.616945 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 11:27:24.617532 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.616978 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 11:27:24.641880 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.641862 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 11:27:24.644090 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.644070 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 11:27:24.657129 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.657104 2551 log.go:25] "Validated CRI v1 runtime API" May 26 11:27:24.663219 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.663204 2551 log.go:25] "Validated CRI v1 image API" May 26 11:27:24.664315 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.664287 2551 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 11:27:24.666561 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.666538 2551 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9c565e63-6669-406d-98d2-28961e81524b:/dev/nvme0n1p3 e78a9a59-ee77-48d4-9e91-d00d0685fec6:/dev/nvme0n1p4] May 26 11:27:24.666636 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.666559 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 11:27:24.671058 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.670957 2551 manager.go:217] Machine: {Timestamp:2026-05-26 11:27:24.670465892 +0000 UTC m=+0.366453918 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3116207 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20241471a469a7ad44af1b9970af36 SystemUUID:ec202414-71a4-69a7-ad44-af1b9970af36 BootID:78159bb1-2478-41ca-a6fd-aef27d7013ab Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:87:99:89:29:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:87:99:89:29:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:34:10:8e:05:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 11:27:24.671514 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.671499 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 11:27:24.671751 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.671739 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 11:27:24.671832 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.671821 2551 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 11:27:24.674015 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.673980 2551 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 11:27:24.674152 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.674018 2551 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 11:27:24.674200 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.674162 2551 topology_manager.go:138] "Creating topology manager with none policy" May 26 11:27:24.674200 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.674171 2551 container_manager_linux.go:306] "Creating device plugin manager" May 26 11:27:24.674200 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.674178 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 11:27:24.675682 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.675672 2551 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 11:27:24.678008 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.677998 2551 state_mem.go:36] "Initialized new in-memory state store" May 26 11:27:24.678117 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.678108 2551 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 11:27:24.680320 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.680311 2551 kubelet.go:491] "Attempting to sync node with API server" May 26 11:27:24.680353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.680324 2551 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 11:27:24.680353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.680335 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 11:27:24.680353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.680344 2551 kubelet.go:397] "Adding apiserver pod source" May 26 11:27:24.680353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.680351 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 11:27:24.681658 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.681646 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 11:27:24.681715 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.681667 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 11:27:24.684392 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.684377 2551 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 11:27:24.686532 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.686518 2551 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 11:27:24.687445 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687432 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687449 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687471 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687477 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687485 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687491 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687497 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687502 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687509 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 11:27:24.687516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687514 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 11:27:24.687743 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687528 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 11:27:24.687743 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.687671 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 11:27:24.689063 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.689027 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmzkb" May 26 11:27:24.689209 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.689199 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 11:27:24.689245 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.689211 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 11:27:24.690993 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.690967 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 11:27:24.691058 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.690967 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 11:27:24.692276 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.692262 2551 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 11:27:24.692347 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.692308 2551 server.go:1295] "Started kubelet" May 26 11:27:24.692483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.692363 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 11:27:24.692550 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.692496 2551 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 11:27:24.692645 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.692633 2551 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 11:27:24.694600 ip-10-0-133-99 systemd[1]: Started Kubernetes Kubelet. May 26 11:27:24.695095 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.694642 2551 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 11:27:24.696989 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.696967 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmzkb" May 26 11:27:24.697249 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.697229 2551 server.go:317] "Adding debug handlers to kubelet server" May 26 11:27:24.700813 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.700789 2551 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 26 11:27:24.701572 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.700687 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-99.ec2.internal.18b319fb42f46102 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-99.ec2.internal,UID:ip-10-0-133-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-99.ec2.internal,},FirstTimestamp:2026-05-26 11:27:24.692275458 +0000 UTC m=+0.388263484,LastTimestamp:2026-05-26 11:27:24.692275458 +0000 UTC m=+0.388263484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-99.ec2.internal,}" May 26 11:27:24.705426 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.705382 2551 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 11:27:24.705594 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.705566 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 11:27:24.706174 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.706157 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 11:27:24.706320 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.706304 2551 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 11:27:24.706428 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.706418 2551 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 11:27:24.706547 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.706387 2551 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 11:27:24.706601 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.706576 2551 reconstruct.go:97] "Volume reconstruction finished" May 26 11:27:24.706601 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.706586 2551 reconciler.go:26] "Reconciler: start to sync state" May 26 11:27:24.706844 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.706829 2551 factory.go:55] Registering systemd factory May 26 11:27:24.706913 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.706847 2551 factory.go:223] Registration of the systemd container factory successfully May 26 11:27:24.707013 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.706992 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:24.707095 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.707078 2551 factory.go:153] Registering CRI-O factory May 26 11:27:24.707095 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.707091 2551 factory.go:223] Registration of the crio container factory successfully May 26 11:27:24.707184 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.707136 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 11:27:24.707184 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.707149 2551 factory.go:103] Registering Raw factory May 26 11:27:24.707184 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.707159 2551 manager.go:1196] Started watching for new ooms in manager May 26 11:27:24.707779 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.707763 2551 manager.go:319] Starting recovery of all containers May 26 11:27:24.708470 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.708431 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:27:24.710691 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.710665 2551 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-99.ec2.internal\" not found" node="ip-10-0-133-99.ec2.internal" May 26 11:27:24.717193 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.717060 2551 manager.go:324] Recovery completed May 26 11:27:24.722353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.722338 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:27:24.729943 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.729919 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 26 11:27:24.730018 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.729951 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:27:24.730018 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.729966 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 26 11:27:24.730510 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.730496 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 11:27:24.730572 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.730510 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 11:27:24.730572 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.730528 2551 state_mem.go:36] "Initialized new in-memory state store" May 26 11:27:24.733341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.733329 2551 policy_none.go:49] "None policy: Start" May 26 11:27:24.733379 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.733345 2551 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 11:27:24.733379 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.733357 2551 state_mem.go:35] "Initializing new in-memory state store" May 26 11:27:24.779021 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.779008 2551 manager.go:341] "Starting Device Plugin manager" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.779036 2551 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.779045 2551 server.go:85] "Starting device plugin registration server" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.779217 2551 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.779228 2551 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.779330 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.779432 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.779446 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.779855 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 11:27:24.784936 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.779886 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:24.837594 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.837564 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 11:27:24.838805 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.838778 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 11:27:24.838900 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.838811 2551 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 11:27:24.838900 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.838835 2551 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 11:27:24.838900 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.838844 2551 kubelet.go:2451] "Starting kubelet main sync loop" May 26 11:27:24.838900 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.838888 2551 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 11:27:24.844868 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.844822 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:27:24.880296 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.880279 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:27:24.881063 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.881047 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 26 11:27:24.881148 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.881082 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:27:24.881148 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.881098 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 26 11:27:24.881148 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.881136 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-99.ec2.internal" May 26 11:27:24.886232 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.886218 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-99.ec2.internal" May 26 11:27:24.886293 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.886238 2551 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-99.ec2.internal\": node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:24.896420 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.896403 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:24.939600 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.939580 2551 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal"] May 26 11:27:24.939684 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.939653 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:27:24.941212 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.941197 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 26 11:27:24.941282 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.941224 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:27:24.941282 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.941235 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 26 11:27:24.942537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.942524 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:27:24.942731 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.942717 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:24.942797 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.942753 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:27:24.943153 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.943139 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 26 11:27:24.943223 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.943159 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:27:24.943223 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.943169 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 26 11:27:24.943223 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.943206 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 26 11:27:24.943358 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.943232 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:27:24.943358 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.943246 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 26 11:27:24.944363 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.944347 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 26 11:27:24.944435 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.944375 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 11:27:24.945012 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.944996 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientMemory" May 26 11:27:24.945077 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.945028 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasNoDiskPressure" May 26 11:27:24.945077 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:24.945048 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeHasSufficientPID" May 26 11:27:24.967052 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.967036 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-99.ec2.internal\" not found" node="ip-10-0-133-99.ec2.internal" May 26 11:27:24.971605 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.971589 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-99.ec2.internal\" not found" node="ip-10-0-133-99.ec2.internal" May 26 11:27:24.997371 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:24.997351 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.008255 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.008230 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:25.008340 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.008265 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:25.008340 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.008291 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f60ea2db76896f8a68dfa4cecb6168b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-99.ec2.internal\" (UID: \"f60ea2db76896f8a68dfa4cecb6168b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 26 11:27:25.098397 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.098305 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.108596 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.108570 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:25.108702 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.108607 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:25.108702 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.108632 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f60ea2db76896f8a68dfa4cecb6168b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-99.ec2.internal\" (UID: \"f60ea2db76896f8a68dfa4cecb6168b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 26 11:27:25.108702 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.108666 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:25.108702 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.108684 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f60ea2db76896f8a68dfa4cecb6168b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-99.ec2.internal\" (UID: \"f60ea2db76896f8a68dfa4cecb6168b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 26 11:27:25.108841 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.108685 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1bcfa917a54ac6563779f94fbfd3a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal\" (UID: \"b1bcfa917a54ac6563779f94fbfd3a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:25.198945 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.198911 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.270371 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.270345 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:25.275202 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.275181 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 26 11:27:25.299339 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.299303 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.399878 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.399800 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.500326 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.500304 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.600889 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.600858 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.617290 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.617266 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 11:27:25.617425 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.617411 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 11:27:25.617484 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.617424 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 11:27:25.699884 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.699803 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 11:22:24 +0000 UTC" deadline="2028-02-13 08:28:51.224277488 +0000 UTC" May 26 11:27:25.699884 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.699840 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15069h1m25.524442481s" May 26 11:27:25.701063 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.701039 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.706219 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.706201 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 11:27:25.723290 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.723272 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 11:27:25.745125 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.745104 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-425n9" May 26 11:27:25.750488 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.750467 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-425n9" May 26 11:27:25.773331 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:25.773304 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bcfa917a54ac6563779f94fbfd3a99.slice/crio-9cafca98492cbb15327d70e6cb5ba36e047e698b7d26271e2204ad7b074dce8e WatchSource:0}: Error finding container 9cafca98492cbb15327d70e6cb5ba36e047e698b7d26271e2204ad7b074dce8e: Status 404 returned error can't find the container with id 9cafca98492cbb15327d70e6cb5ba36e047e698b7d26271e2204ad7b074dce8e May 26 11:27:25.773553 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:25.773536 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60ea2db76896f8a68dfa4cecb6168b4.slice/crio-f1c2639a77e5049f58efc37075bc2aa46aa53b2fa621837b71eaae5b66111481 WatchSource:0}: Error finding container f1c2639a77e5049f58efc37075bc2aa46aa53b2fa621837b71eaae5b66111481: Status 404 returned error can't find the container with id f1c2639a77e5049f58efc37075bc2aa46aa53b2fa621837b71eaae5b66111481 May 26 11:27:25.777540 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.777523 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 11:27:25.802144 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.802125 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:25.842183 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.842141 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" event={"ID":"b1bcfa917a54ac6563779f94fbfd3a99","Type":"ContainerStarted","Data":"9cafca98492cbb15327d70e6cb5ba36e047e698b7d26271e2204ad7b074dce8e"} May 26 11:27:25.842986 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:25.842961 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" event={"ID":"f60ea2db76896f8a68dfa4cecb6168b4","Type":"ContainerStarted","Data":"f1c2639a77e5049f58efc37075bc2aa46aa53b2fa621837b71eaae5b66111481"} May 26 11:27:25.903160 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:25.903137 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:26.003707 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.003638 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:26.104136 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.104110 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-99.ec2.internal\" not found" May 26 11:27:26.111093 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.111072 2551 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:27:26.206874 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.206849 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" May 26 11:27:26.219569 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.219540 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 11:27:26.221855 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.221819 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" May 26 11:27:26.231317 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.231293 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 11:27:26.288946 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.288878 2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:27:26.680978 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.680893 2551 apiserver.go:52] "Watching apiserver" May 26 11:27:26.688500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.688473 2551 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 11:27:26.688859 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.688836 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-4jd2t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal","openshift-multus/multus-8r62z","openshift-multus/network-metrics-daemon-g4m6v","openshift-network-diagnostics/network-check-target-pf5kc","openshift-network-operator/iptables-alerter-9q4g2","openshift-ovn-kubernetes/ovnkube-node-pqqr2","kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8","openshift-cluster-node-tuning-operator/tuned-tqwph","openshift-image-registry/node-ca-2wvg7","openshift-multus/multus-additional-cni-plugins-mdqzv","kube-system/konnectivity-agent-c4sq2"] May 26 11:27:26.691318 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.691298 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.693336 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.693316 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8r62z" May 26 11:27:26.693493 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.693470 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 11:27:26.693786 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.693769 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 11:27:26.693874 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.693851 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 11:27:26.694033 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.694014 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 11:27:26.694033 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.694020 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 11:27:26.694165 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.694049 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 11:27:26.694165 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.694151 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5vm4s\"" May 26 11:27:26.695804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.695303 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 11:27:26.695804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.695575 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:26.695804 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.695639 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:26.695804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.695702 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cv2dv\"" May 26 11:27:26.695804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.695749 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 11:27:26.696090 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.695950 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 11:27:26.696090 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.695971 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 11:27:26.700293 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.700245 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:26.702595 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.700652 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:26.702595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.700720 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.703096 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.703073 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 11:27:26.703172 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.703136 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ctmvl\"" May 26 11:27:26.703275 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.703258 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 11:27:26.703520 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.703504 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 11:27:26.705090 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.705070 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.707236 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.707218 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 11:27:26.707236 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.707226 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 11:27:26.707546 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.707496 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mc86r\"" May 26 11:27:26.709612 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.709591 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.709710 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.709685 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.711771 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.711755 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 11:27:26.711989 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.711973 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 11:27:26.712077 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.711991 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 11:27:26.712139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.712100 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 11:27:26.712261 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.712240 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 11:27:26.712333 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.712313 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-66h8r\"" May 26 11:27:26.712392 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.712352 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t4h6s\"" May 26 11:27:26.714239 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.714221 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.714393 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.714378 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.716576 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716556 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:26.716682 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716581 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 11:27:26.716682 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716631 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 11:27:26.716682 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716656 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 11:27:26.716682 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716674 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-multus-certs\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.716882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716702 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-etc-selinux\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.716882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716753 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-node-log\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.716882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716778 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-k8s-cni-cncf-io\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.716882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716805 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 11:27:26.716882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716806 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-cni-multus\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.716882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716880 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716904 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-hosts-file\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716927 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-kubelet\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716951 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716957 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716963 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dprfz\"" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716973 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-clmmv\"" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.716975 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovnkube-config\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717045 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovn-node-metrics-cert\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717075 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-cni-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717107 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-slash\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717132 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-etc-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717155 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-log-socket\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717179 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717207 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-cni-bin\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717230 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-env-overrides\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717254 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-etc-kubernetes\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717281 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-iptables-alerter-script\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717315 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-var-lib-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717340 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff5bcaeb-5c08-44ef-80db-805c692c448e-cni-binary-copy\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717365 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-socket-dir-parent\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717390 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-system-cni-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717436 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-cnibin\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717478 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-os-release\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717509 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-cni-bin\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717534 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-kubelet\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717557 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-daemon-config\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717629 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvqpg\" (UniqueName: \"kubernetes.io/projected/ff5bcaeb-5c08-44ef-80db-805c692c448e-kube-api-access-mvqpg\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717657 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-systemd\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.717747 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717681 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-ovn\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717706 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zmlh\" (UniqueName: \"kubernetes.io/projected/acb515e4-f4ef-437f-91bd-dadc3359247d-kube-api-access-2zmlh\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717747 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqv67\" (UniqueName: \"kubernetes.io/projected/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-kube-api-access-bqv67\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717771 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-socket-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717865 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwtn5\" (UniqueName: \"kubernetes.io/projected/d93dc972-89f2-4234-be03-96167b02f19f-kube-api-access-vwtn5\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717905 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jpx9\" (UniqueName: \"kubernetes.io/projected/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-kube-api-access-5jpx9\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717934 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fnkj\" (UniqueName: \"kubernetes.io/projected/a46be309-5eae-4bf4-80b7-0a502bba5d91-kube-api-access-4fnkj\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717959 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-host-slash\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.717986 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-device-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718024 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-sys-fs\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718072 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718104 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-systemd-units\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718122 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-run-netns\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718143 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-cni-netd\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718174 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-netns\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718196 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:26.718412 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718219 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-registration-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.719147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718244 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-tmp-dir\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.719147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718259 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.719147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718274 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovnkube-script-lib\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.719147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718291 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-hostroot\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.719147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718313 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-conf-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.719147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718744 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5jcx7\"" May 26 11:27:26.719147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.718959 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 11:27:26.719147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.719094 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 11:27:26.751533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.751500 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 11:22:25 +0000 UTC" deadline="2028-01-10 04:36:06.166984289 +0000 UTC" May 26 11:27:26.751533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.751533 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14249h8m39.415454598s" May 26 11:27:26.807671 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.807649 2551 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 11:27:26.818649 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818621 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.818763 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818672 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-kubelet\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818763 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818692 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.818763 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818704 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818763 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818734 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovnkube-config\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818763 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818760 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovn-node-metrics-cert\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818759 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-kubelet\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818770 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818792 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8afd26c-8164-4985-8d0f-1ca259f05391-agent-certs\") pod \"konnectivity-agent-c4sq2\" (UID: \"b8afd26c-8164-4985-8d0f-1ca259f05391\") " pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818820 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysctl-conf\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818844 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-run\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818875 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-etc-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818902 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818932 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-cni-bin\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.818966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818954 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.818957 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-env-overrides\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819009 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-etc-kubernetes\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819042 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9660178-e587-4a86-8f62-9cd0d0c00bff-host\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819069 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-var-lib-kubelet\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819098 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-var-lib-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819125 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-socket-dir-parent\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819150 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/251764ab-9b6f-46fb-b545-1959683a49f2-tmp\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819137 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819182 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819213 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-system-cni-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819260 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-etc-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.819286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819274 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-system-cni-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819298 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-cnibin\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819316 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-etc-kubernetes\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819332 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-daemon-config\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819335 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovnkube-config\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819358 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvqpg\" (UniqueName: \"kubernetes.io/projected/ff5bcaeb-5c08-44ef-80db-805c692c448e-kube-api-access-mvqpg\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819400 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysctl-d\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819401 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-env-overrides\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819413 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-socket-dir-parent\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819430 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zmlh\" (UniqueName: \"kubernetes.io/projected/acb515e4-f4ef-437f-91bd-dadc3359247d-kube-api-access-2zmlh\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819476 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqv67\" (UniqueName: \"kubernetes.io/projected/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-kube-api-access-bqv67\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819525 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-cnibin\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819645 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-cni-bin\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819650 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-socket-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819700 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwtn5\" (UniqueName: \"kubernetes.io/projected/d93dc972-89f2-4234-be03-96167b02f19f-kube-api-access-vwtn5\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819746 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-var-lib-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819793 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jpx9\" (UniqueName: \"kubernetes.io/projected/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-kube-api-access-5jpx9\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.819881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819822 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fnkj\" (UniqueName: \"kubernetes.io/projected/a46be309-5eae-4bf4-80b7-0a502bba5d91-kube-api-access-4fnkj\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819826 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-socket-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819862 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-netns\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819908 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-daemon-config\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819922 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-kubernetes\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819953 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-host-slash\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819965 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-netns\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.819981 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820009 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-multus-certs\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820019 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-host-slash\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820036 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cnibin\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820073 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820086 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-multus-certs\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820109 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820159 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovnkube-script-lib\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820191 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-conf-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.820193 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820221 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-etc-selinux\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.820686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820237 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-conf-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820247 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-node-log\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.820285 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:27:27.320256313 +0000 UTC m=+3.016244346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820297 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-node-log\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820326 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-k8s-cni-cncf-io\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820351 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-etc-selinux\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820355 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-system-cni-dir\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820418 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-run-k8s-cni-cncf-io\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820430 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-hosts-file\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820474 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-cni-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820510 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-lib-modules\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820517 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-hosts-file\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820538 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820567 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6d99\" (UniqueName: \"kubernetes.io/projected/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-kube-api-access-w6d99\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820578 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-multus-cni-dir\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820596 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-slash\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.821294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820623 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-log-socket\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820652 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9660178-e587-4a86-8f62-9cd0d0c00bff-serviceca\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820653 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-slash\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820668 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovnkube-script-lib\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820679 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-modprobe-d\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820708 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnhrw\" (UniqueName: \"kubernetes.io/projected/251764ab-9b6f-46fb-b545-1959683a49f2-kube-api-access-jnhrw\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820716 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-log-socket\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820737 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-iptables-alerter-script\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820767 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff5bcaeb-5c08-44ef-80db-805c692c448e-cni-binary-copy\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820818 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-systemd\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820848 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-os-release\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820877 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-cni-bin\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820930 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-cni-bin\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820959 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-os-release\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.820996 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-kubelet\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821032 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g726n\" (UniqueName: \"kubernetes.io/projected/f9660178-e587-4a86-8f62-9cd0d0c00bff-kube-api-access-g726n\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821073 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-sys\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.821858 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821096 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/251764ab-9b6f-46fb-b545-1959683a49f2-etc-tuned\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821100 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-kubelet\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821118 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821145 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-systemd\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821166 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-ovn\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821200 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-device-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821222 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-sys-fs\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821240 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-systemd\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821242 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-systemd-units\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821255 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff5bcaeb-5c08-44ef-80db-805c692c448e-cni-binary-copy\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821281 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-systemd-units\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821293 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-run-netns\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821305 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-ovn\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821313 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-device-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821321 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-cni-netd\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821330 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-sys-fs\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821348 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-hostroot\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.822483 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821353 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-cni-netd\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821255 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-iptables-alerter-script\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821347 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-host-run-netns\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821377 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-hostroot\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821377 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8afd26c-8164-4985-8d0f-1ca259f05391-konnectivity-ca\") pod \"konnectivity-agent-c4sq2\" (UID: \"b8afd26c-8164-4985-8d0f-1ca259f05391\") " pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821416 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-registration-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821437 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-tmp-dir\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821476 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821494 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysconfig\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821496 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d93dc972-89f2-4234-be03-96167b02f19f-registration-dir\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821512 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-os-release\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821545 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46be309-5eae-4bf4-80b7-0a502bba5d91-run-openvswitch\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821549 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-cni-multus\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821569 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-host\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821628 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ff5bcaeb-5c08-44ef-80db-805c692c448e-host-var-lib-cni-multus\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.821757 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-tmp-dir\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.823284 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.822448 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a46be309-5eae-4bf4-80b7-0a502bba5d91-ovn-node-metrics-cert\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.830216 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.830195 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:27:26.830310 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.830219 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:27:26.830310 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.830233 2551 projected.go:194] Error preparing data for projected volume kube-api-access-qwkxc for pod openshift-network-diagnostics/network-check-target-pf5kc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:26.830389 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:26.830311 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc podName:d453e52d-629c-4f97-b043-946bcf90cdb4 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:27.330293586 +0000 UTC m=+3.026281616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qwkxc" (UniqueName: "kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc") pod "network-check-target-pf5kc" (UID: "d453e52d-629c-4f97-b043-946bcf90cdb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:26.832763 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.832734 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zmlh\" (UniqueName: \"kubernetes.io/projected/acb515e4-f4ef-437f-91bd-dadc3359247d-kube-api-access-2zmlh\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:26.833496 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.833470 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwtn5\" (UniqueName: \"kubernetes.io/projected/d93dc972-89f2-4234-be03-96167b02f19f-kube-api-access-vwtn5\") pod \"aws-ebs-csi-driver-node-gngr8\" (UID: \"d93dc972-89f2-4234-be03-96167b02f19f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:26.834234 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.834215 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvqpg\" (UniqueName: \"kubernetes.io/projected/ff5bcaeb-5c08-44ef-80db-805c692c448e-kube-api-access-mvqpg\") pod \"multus-8r62z\" (UID: \"ff5bcaeb-5c08-44ef-80db-805c692c448e\") " pod="openshift-multus/multus-8r62z" May 26 11:27:26.834920 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.834896 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jpx9\" (UniqueName: \"kubernetes.io/projected/cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b-kube-api-access-5jpx9\") pod \"node-resolver-4jd2t\" (UID: \"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b\") " pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:26.835582 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.835564 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fnkj\" (UniqueName: \"kubernetes.io/projected/a46be309-5eae-4bf4-80b7-0a502bba5d91-kube-api-access-4fnkj\") pod \"ovnkube-node-pqqr2\" (UID: \"a46be309-5eae-4bf4-80b7-0a502bba5d91\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:26.837760 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.837736 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqv67\" (UniqueName: \"kubernetes.io/projected/e7976c98-bddc-4048-a62f-1a1dea4cfbf0-kube-api-access-bqv67\") pod \"iptables-alerter-9q4g2\" (UID: \"e7976c98-bddc-4048-a62f-1a1dea4cfbf0\") " pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:26.850872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.850853 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:27:26.921993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.921965 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8afd26c-8164-4985-8d0f-1ca259f05391-konnectivity-ca\") pod \"konnectivity-agent-c4sq2\" (UID: \"b8afd26c-8164-4985-8d0f-1ca259f05391\") " pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:26.921993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.921994 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysconfig\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922164 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922012 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-os-release\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922164 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922099 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysconfig\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922164 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922144 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-host\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922164 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922158 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-os-release\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922289 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922167 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8afd26c-8164-4985-8d0f-1ca259f05391-agent-certs\") pod \"konnectivity-agent-c4sq2\" (UID: \"b8afd26c-8164-4985-8d0f-1ca259f05391\") " pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:26.922289 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922183 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysctl-conf\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922289 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922195 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-host\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922289 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922198 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-run\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922289 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922217 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9660178-e587-4a86-8f62-9cd0d0c00bff-host\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.922289 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922246 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9660178-e587-4a86-8f62-9cd0d0c00bff-host\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.922500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922283 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-run\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922329 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysctl-conf\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922334 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-var-lib-kubelet\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922368 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-var-lib-kubelet\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922386 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/251764ab-9b6f-46fb-b545-1959683a49f2-tmp\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922414 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922443 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysctl-d\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922491 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-kubernetes\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922524 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8afd26c-8164-4985-8d0f-1ca259f05391-konnectivity-ca\") pod \"konnectivity-agent-c4sq2\" (UID: \"b8afd26c-8164-4985-8d0f-1ca259f05391\") " pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922531 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cnibin\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922555 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922591 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-system-cni-dir\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922601 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-kubernetes\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922609 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-lib-modules\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922588 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922656 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-system-cni-dir\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922635 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922696 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6d99\" (UniqueName: \"kubernetes.io/projected/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-kube-api-access-w6d99\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922714 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cnibin\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922724 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9660178-e587-4a86-8f62-9cd0d0c00bff-serviceca\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922720 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-sysctl-d\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922739 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-lib-modules\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922761 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-modprobe-d\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922792 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnhrw\" (UniqueName: \"kubernetes.io/projected/251764ab-9b6f-46fb-b545-1959683a49f2-kube-api-access-jnhrw\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.922820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922821 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-systemd\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922847 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g726n\" (UniqueName: \"kubernetes.io/projected/f9660178-e587-4a86-8f62-9cd0d0c00bff-kube-api-access-g726n\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922874 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-sys\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922900 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/251764ab-9b6f-46fb-b545-1959683a49f2-etc-tuned\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.922926 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.923033 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-systemd\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.923073 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.923114 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-etc-modprobe-d\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.923131 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/251764ab-9b6f-46fb-b545-1959683a49f2-sys\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.923144 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9660178-e587-4a86-8f62-9cd0d0c00bff-serviceca\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.923206 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.923583 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.923406 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.924840 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.924818 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/251764ab-9b6f-46fb-b545-1959683a49f2-tmp\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.924923 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.924867 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8afd26c-8164-4985-8d0f-1ca259f05391-agent-certs\") pod \"konnectivity-agent-c4sq2\" (UID: \"b8afd26c-8164-4985-8d0f-1ca259f05391\") " pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:26.925069 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.925053 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/251764ab-9b6f-46fb-b545-1959683a49f2-etc-tuned\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.930595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.930576 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnhrw\" (UniqueName: \"kubernetes.io/projected/251764ab-9b6f-46fb-b545-1959683a49f2-kube-api-access-jnhrw\") pod \"tuned-tqwph\" (UID: \"251764ab-9b6f-46fb-b545-1959683a49f2\") " pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:26.931524 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.931450 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6d99\" (UniqueName: \"kubernetes.io/projected/b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39-kube-api-access-w6d99\") pod \"multus-additional-cni-plugins-mdqzv\" (UID: \"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39\") " pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:26.932211 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:26.932195 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g726n\" (UniqueName: \"kubernetes.io/projected/f9660178-e587-4a86-8f62-9cd0d0c00bff-kube-api-access-g726n\") pod \"node-ca-2wvg7\" (UID: \"f9660178-e587-4a86-8f62-9cd0d0c00bff\") " pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:27.004636 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.004593 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:27.011563 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.011543 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8r62z" May 26 11:27:27.020997 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.020963 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9q4g2" May 26 11:27:27.025590 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.025570 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4jd2t" May 26 11:27:27.035145 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.035118 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" May 26 11:27:27.041728 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.041708 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tqwph" May 26 11:27:27.047212 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.047195 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2wvg7" May 26 11:27:27.053708 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.053689 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" May 26 11:27:27.058248 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.058231 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:27.111439 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.111413 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 11:27:27.325694 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.325633 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:27.325819 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:27.325742 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:27.325819 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:27.325791 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:27:28.325778599 +0000 UTC m=+4.021766616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:27.373780 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.373751 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251764ab_9b6f_46fb_b545_1959683a49f2.slice/crio-44a7c6b75e3d9b5894179ee95913521d1c2065a36a2d3d5989f3712b4b248a73 WatchSource:0}: Error finding container 44a7c6b75e3d9b5894179ee95913521d1c2065a36a2d3d5989f3712b4b248a73: Status 404 returned error can't find the container with id 44a7c6b75e3d9b5894179ee95913521d1c2065a36a2d3d5989f3712b4b248a73 May 26 11:27:27.375088 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.375067 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5bcaeb_5c08_44ef_80db_805c692c448e.slice/crio-17ed390e54ee0709923bfe4e18e31ac7d1615a6520f4e32baa5228a0d72bc201 WatchSource:0}: Error finding container 17ed390e54ee0709923bfe4e18e31ac7d1615a6520f4e32baa5228a0d72bc201: Status 404 returned error can't find the container with id 17ed390e54ee0709923bfe4e18e31ac7d1615a6520f4e32baa5228a0d72bc201 May 26 11:27:27.376204 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.376177 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e506cb_3f64_4c8b_aaf7_d25fe4e58b39.slice/crio-b612e3f0b09d3e9601c3bdcd5220d22fb641e76887ee060d2bbbba6439d3568f WatchSource:0}: Error finding container b612e3f0b09d3e9601c3bdcd5220d22fb641e76887ee060d2bbbba6439d3568f: Status 404 returned error can't find the container with id b612e3f0b09d3e9601c3bdcd5220d22fb641e76887ee060d2bbbba6439d3568f May 26 11:27:27.377720 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.377655 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc09abf0_cb77_4d17_a560_eaa1c8e1ff4b.slice/crio-b153a77c94a280dc850f775dd36bde71b449ba4dded38136bfd042e14a80f677 WatchSource:0}: Error finding container b153a77c94a280dc850f775dd36bde71b449ba4dded38136bfd042e14a80f677: Status 404 returned error can't find the container with id b153a77c94a280dc850f775dd36bde71b449ba4dded38136bfd042e14a80f677 May 26 11:27:27.381442 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.381246 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9660178_e587_4a86_8f62_9cd0d0c00bff.slice/crio-b509c3d429a193470560c9ecc47145f43aeded9c009a64ecc95f8d6fdc693b76 WatchSource:0}: Error finding container b509c3d429a193470560c9ecc47145f43aeded9c009a64ecc95f8d6fdc693b76: Status 404 returned error can't find the container with id b509c3d429a193470560c9ecc47145f43aeded9c009a64ecc95f8d6fdc693b76 May 26 11:27:27.383055 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.382282 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46be309_5eae_4bf4_80b7_0a502bba5d91.slice/crio-32e66895f12ca52930e839a69c2298fbb67853672ae309a47d4fa49383ddf6e1 WatchSource:0}: Error finding container 32e66895f12ca52930e839a69c2298fbb67853672ae309a47d4fa49383ddf6e1: Status 404 returned error can't find the container with id 32e66895f12ca52930e839a69c2298fbb67853672ae309a47d4fa49383ddf6e1 May 26 11:27:27.383124 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.383067 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93dc972_89f2_4234_be03_96167b02f19f.slice/crio-0f806cc4c0fa9506cebc9465da1a6954e777b203ad727f22105f49421585fb76 WatchSource:0}: Error finding container 0f806cc4c0fa9506cebc9465da1a6954e777b203ad727f22105f49421585fb76: Status 404 returned error can't find the container with id 0f806cc4c0fa9506cebc9465da1a6954e777b203ad727f22105f49421585fb76 May 26 11:27:27.385649 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.385324 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8afd26c_8164_4985_8d0f_1ca259f05391.slice/crio-84d4c8da6e494393f2fbeaf90a76055a99f6f8135257c8fdddc12b11eb41010a WatchSource:0}: Error finding container 84d4c8da6e494393f2fbeaf90a76055a99f6f8135257c8fdddc12b11eb41010a: Status 404 returned error can't find the container with id 84d4c8da6e494393f2fbeaf90a76055a99f6f8135257c8fdddc12b11eb41010a May 26 11:27:27.386695 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:27:27.386145 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7976c98_bddc_4048_a62f_1a1dea4cfbf0.slice/crio-f06b8bbdddc5c628095ac6b002f2ef16aa7f8fd24ff8cd6e1f2dc6e359c0b542 WatchSource:0}: Error finding container f06b8bbdddc5c628095ac6b002f2ef16aa7f8fd24ff8cd6e1f2dc6e359c0b542: Status 404 returned error can't find the container with id f06b8bbdddc5c628095ac6b002f2ef16aa7f8fd24ff8cd6e1f2dc6e359c0b542 May 26 11:27:27.426516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.426367 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:27.426625 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:27.426523 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:27:27.426625 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:27.426546 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:27:27.426625 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:27.426558 2551 projected.go:194] Error preparing data for projected volume kube-api-access-qwkxc for pod openshift-network-diagnostics/network-check-target-pf5kc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:27.426625 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:27.426607 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc podName:d453e52d-629c-4f97-b043-946bcf90cdb4 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:28.426591518 +0000 UTC m=+4.122579545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwkxc" (UniqueName: "kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc") pod "network-check-target-pf5kc" (UID: "d453e52d-629c-4f97-b043-946bcf90cdb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:27.752874 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.752812 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 11:22:25 +0000 UTC" deadline="2027-11-25 01:34:51.95114462 +0000 UTC" May 26 11:27:27.752874 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.752847 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13142h7m24.198300934s" May 26 11:27:27.839503 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.839476 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:27.839642 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:27.839621 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:27.850971 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.850196 2551 generic.go:358] "Generic (PLEG): container finished" podID="b1bcfa917a54ac6563779f94fbfd3a99" containerID="44365bf30dfcd0cdf1bc772a59ddebaeed4605f048c1707908423c93d5ccf7f7" exitCode=0 May 26 11:27:27.850971 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.850264 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" event={"ID":"b1bcfa917a54ac6563779f94fbfd3a99","Type":"ContainerDied","Data":"44365bf30dfcd0cdf1bc772a59ddebaeed4605f048c1707908423c93d5ccf7f7"} May 26 11:27:27.859973 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.859912 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c4sq2" event={"ID":"b8afd26c-8164-4985-8d0f-1ca259f05391","Type":"ContainerStarted","Data":"84d4c8da6e494393f2fbeaf90a76055a99f6f8135257c8fdddc12b11eb41010a"} May 26 11:27:27.865321 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.863923 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"32e66895f12ca52930e839a69c2298fbb67853672ae309a47d4fa49383ddf6e1"} May 26 11:27:27.874652 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.874625 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2wvg7" event={"ID":"f9660178-e587-4a86-8f62-9cd0d0c00bff","Type":"ContainerStarted","Data":"b509c3d429a193470560c9ecc47145f43aeded9c009a64ecc95f8d6fdc693b76"} May 26 11:27:27.876601 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.876575 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tqwph" event={"ID":"251764ab-9b6f-46fb-b545-1959683a49f2","Type":"ContainerStarted","Data":"44a7c6b75e3d9b5894179ee95913521d1c2065a36a2d3d5989f3712b4b248a73"} May 26 11:27:27.893258 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.893228 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" event={"ID":"f60ea2db76896f8a68dfa4cecb6168b4","Type":"ContainerStarted","Data":"d17054e96f3c26fbaf37a4f142fd9256dca0a694b5e356695bd5440d64346289"} May 26 11:27:27.897736 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.897683 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9q4g2" event={"ID":"e7976c98-bddc-4048-a62f-1a1dea4cfbf0","Type":"ContainerStarted","Data":"f06b8bbdddc5c628095ac6b002f2ef16aa7f8fd24ff8cd6e1f2dc6e359c0b542"} May 26 11:27:27.902476 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.902436 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" event={"ID":"d93dc972-89f2-4234-be03-96167b02f19f","Type":"ContainerStarted","Data":"0f806cc4c0fa9506cebc9465da1a6954e777b203ad727f22105f49421585fb76"} May 26 11:27:27.925691 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.925614 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4jd2t" event={"ID":"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b","Type":"ContainerStarted","Data":"b153a77c94a280dc850f775dd36bde71b449ba4dded38136bfd042e14a80f677"} May 26 11:27:27.932644 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.931866 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" event={"ID":"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39","Type":"ContainerStarted","Data":"b612e3f0b09d3e9601c3bdcd5220d22fb641e76887ee060d2bbbba6439d3568f"} May 26 11:27:27.937166 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:27.937108 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8r62z" event={"ID":"ff5bcaeb-5c08-44ef-80db-805c692c448e","Type":"ContainerStarted","Data":"17ed390e54ee0709923bfe4e18e31ac7d1615a6520f4e32baa5228a0d72bc201"} May 26 11:27:28.344217 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:28.344133 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:28.344366 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:28.344297 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:28.344366 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:28.344359 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:27:30.344341451 +0000 UTC m=+6.040329479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:28.445510 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:28.445472 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:28.445667 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:28.445635 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:27:28.445667 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:28.445653 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:27:28.445667 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:28.445665 2551 projected.go:194] Error preparing data for projected volume kube-api-access-qwkxc for pod openshift-network-diagnostics/network-check-target-pf5kc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:28.445829 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:28.445725 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc podName:d453e52d-629c-4f97-b043-946bcf90cdb4 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:30.445706274 +0000 UTC m=+6.141694301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwkxc" (UniqueName: "kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc") pod "network-check-target-pf5kc" (UID: "d453e52d-629c-4f97-b043-946bcf90cdb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:28.839287 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:28.839205 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:28.839728 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:28.839334 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:28.958577 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:28.958541 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" event={"ID":"b1bcfa917a54ac6563779f94fbfd3a99","Type":"ContainerStarted","Data":"c1651593aeda98ed010bd87014f468ada87ed84f8b5b2e70a3c337ba58766688"} May 26 11:27:28.973799 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:28.973749 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" podStartSLOduration=2.973735688 podStartE2EDuration="2.973735688s" podCreationTimestamp="2026-05-26 11:27:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:27:27.913034444 +0000 UTC m=+3.609022476" watchObservedRunningTime="2026-05-26 11:27:28.973735688 +0000 UTC m=+4.669723722" May 26 11:27:28.975430 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:28.974095 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-99.ec2.internal" podStartSLOduration=2.974090359 podStartE2EDuration="2.974090359s" podCreationTimestamp="2026-05-26 11:27:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:27:28.973197333 +0000 UTC m=+4.669185368" watchObservedRunningTime="2026-05-26 11:27:28.974090359 +0000 UTC m=+4.670078393" May 26 11:27:29.839910 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:29.839877 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:29.840385 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:29.840017 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:30.360851 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:30.360816 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:30.361059 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:30.361006 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:30.361139 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:30.361088 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:27:34.361066291 +0000 UTC m=+10.057054307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:30.461906 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:30.461872 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:30.462056 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:30.462030 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:27:30.462056 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:30.462044 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:27:30.462056 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:30.462056 2551 projected.go:194] Error preparing data for projected volume kube-api-access-qwkxc for pod openshift-network-diagnostics/network-check-target-pf5kc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:30.462245 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:30.462119 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc podName:d453e52d-629c-4f97-b043-946bcf90cdb4 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:34.462100522 +0000 UTC m=+10.158088553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwkxc" (UniqueName: "kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc") pod "network-check-target-pf5kc" (UID: "d453e52d-629c-4f97-b043-946bcf90cdb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:30.841875 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:30.841788 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:30.842308 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:30.841905 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:31.839075 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:31.839042 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:31.839225 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:31.839181 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:32.841486 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:32.841434 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:32.841941 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:32.841579 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:33.839978 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:33.839891 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:33.840740 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:33.840344 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:34.396913 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:34.396879 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:34.397343 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:34.397068 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:34.397343 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:34.397147 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:27:42.397126161 +0000 UTC m=+18.093114187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:34.497391 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:34.497353 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:34.497554 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:34.497539 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:27:34.497605 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:34.497557 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:27:34.497605 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:34.497570 2551 projected.go:194] Error preparing data for projected volume kube-api-access-qwkxc for pod openshift-network-diagnostics/network-check-target-pf5kc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:34.497705 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:34.497640 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc podName:d453e52d-629c-4f97-b043-946bcf90cdb4 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:42.497617831 +0000 UTC m=+18.193605867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwkxc" (UniqueName: "kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc") pod "network-check-target-pf5kc" (UID: "d453e52d-629c-4f97-b043-946bcf90cdb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:34.840355 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:34.840279 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:34.840564 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:34.840403 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:35.840025 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:35.839996 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:35.840530 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:35.840144 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:36.842927 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:36.840357 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:36.842927 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:36.840554 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:37.839340 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:37.839310 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:37.839604 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:37.839446 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:38.842191 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:38.842162 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:38.842596 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:38.842263 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:39.839636 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:39.839598 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:39.839805 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:39.839747 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:40.839598 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:40.839511 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:40.839942 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:40.839633 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:41.839071 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:41.839041 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:41.839246 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:41.839156 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:42.456076 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:42.456024 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:42.456500 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:42.456205 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:42.456500 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:42.456290 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:27:58.456267768 +0000 UTC m=+34.152255797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:42.556879 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:42.556838 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:42.557063 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:42.557017 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:27:42.557063 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:42.557043 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:27:42.557063 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:42.557057 2551 projected.go:194] Error preparing data for projected volume kube-api-access-qwkxc for pod openshift-network-diagnostics/network-check-target-pf5kc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:42.557232 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:42.557108 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc podName:d453e52d-629c-4f97-b043-946bcf90cdb4 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:58.557094977 +0000 UTC m=+34.253082995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwkxc" (UniqueName: "kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc") pod "network-check-target-pf5kc" (UID: "d453e52d-629c-4f97-b043-946bcf90cdb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:42.839833 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:42.839789 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:42.839999 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:42.839912 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:43.839465 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:43.839419 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:43.839916 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:43.839564 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:44.839685 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:44.839660 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:44.840037 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:44.839740 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:45.839887 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.839678 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:45.840609 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:45.839966 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:45.987363 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.987331 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tqwph" event={"ID":"251764ab-9b6f-46fb-b545-1959683a49f2","Type":"ContainerStarted","Data":"863bee21499c90bc29e50150e84c016216549981d090bd686fa266b4db2035cb"} May 26 11:27:45.988816 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.988786 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" event={"ID":"d93dc972-89f2-4234-be03-96167b02f19f","Type":"ContainerStarted","Data":"9a3816fa1ab28e64fd5ce4f49976cecd97c51901d67e19e4a2f4e0b154698e7a"} May 26 11:27:45.990220 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.990184 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4jd2t" event={"ID":"cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b","Type":"ContainerStarted","Data":"0a9f55bb204a7198752f737394d1b42fbc40c1ce1bae9f2de8757d9f3fbc3f5e"} May 26 11:27:45.991743 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.991718 2551 generic.go:358] "Generic (PLEG): container finished" podID="b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39" containerID="ba0ffc08907b484faccea17ec42892961bc074cc820948b9fa084e2a1898b45a" exitCode=0 May 26 11:27:45.991848 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.991787 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" event={"ID":"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39","Type":"ContainerDied","Data":"ba0ffc08907b484faccea17ec42892961bc074cc820948b9fa084e2a1898b45a"} May 26 11:27:45.993264 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.993240 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8r62z" event={"ID":"ff5bcaeb-5c08-44ef-80db-805c692c448e","Type":"ContainerStarted","Data":"6b38ccda8ea34895521440f3399ec3782b30f916586adb01c53cc0aab7ea6cde"} May 26 11:27:45.994839 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.994803 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c4sq2" event={"ID":"b8afd26c-8164-4985-8d0f-1ca259f05391","Type":"ContainerStarted","Data":"03df8e7ab524b7a5d01a2bd1c00a9c162de891b68535a4ecb4b18ad45de102bd"} May 26 11:27:45.997372 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.997353 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:27:45.997736 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.997709 2551 generic.go:358] "Generic (PLEG): container finished" podID="a46be309-5eae-4bf4-80b7-0a502bba5d91" containerID="f4df33e83d37dee23323711550323e1fd46e782e2d5889eaec16fb909ffa2544" exitCode=1 May 26 11:27:45.997840 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.997774 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"692cfc1d46fb97fc913b8910b21edc2f093313fb167e254cac0a97a49bae3a5e"} May 26 11:27:45.997840 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.997793 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"1f93cb17dd6508e7e2f1ef9feff616ecb276b15baa6cc59018838d45588a6bba"} May 26 11:27:45.997840 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.997802 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"0b975a7625345983e5255cb10e32320c3ddf61609ea6782fbe34b3e358603e72"} May 26 11:27:45.997840 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.997832 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"791dba4c0beefb5dd8c10325ec3a4a07666e095bd01ff24a704e067d9e1c9ccf"} May 26 11:27:45.998004 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.997844 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerDied","Data":"f4df33e83d37dee23323711550323e1fd46e782e2d5889eaec16fb909ffa2544"} May 26 11:27:45.998004 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.997856 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"47ef0387b99d85f97dfeee25af9c5948b35527c2a48c388a3cf192f60a0852b0"} May 26 11:27:45.999120 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:45.999095 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2wvg7" event={"ID":"f9660178-e587-4a86-8f62-9cd0d0c00bff","Type":"ContainerStarted","Data":"cd4a746fd01311dcfaeef956631c4e7607a8ee44f3d1d8edd1ae818a3a62deea"} May 26 11:27:46.006006 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.005968 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tqwph" podStartSLOduration=4.380923675 podStartE2EDuration="22.005957326s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.376074544 +0000 UTC m=+3.072062568" lastFinishedPulling="2026-05-26 11:27:45.001108191 +0000 UTC m=+20.697096219" observedRunningTime="2026-05-26 11:27:46.004480225 +0000 UTC m=+21.700468260" watchObservedRunningTime="2026-05-26 11:27:46.005957326 +0000 UTC m=+21.701945360" May 26 11:27:46.070044 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.070005 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2wvg7" podStartSLOduration=4.48666777 podStartE2EDuration="22.069989078s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.384963809 +0000 UTC m=+3.080951825" lastFinishedPulling="2026-05-26 11:27:44.968285102 +0000 UTC m=+20.664273133" observedRunningTime="2026-05-26 11:27:46.069902513 +0000 UTC m=+21.765890549" watchObservedRunningTime="2026-05-26 11:27:46.069989078 +0000 UTC m=+21.765977115" May 26 11:27:46.104210 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.104170 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c4sq2" podStartSLOduration=4.523187105 podStartE2EDuration="22.104158763s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.387370416 +0000 UTC m=+3.083358431" lastFinishedPulling="2026-05-26 11:27:44.968342071 +0000 UTC m=+20.664330089" observedRunningTime="2026-05-26 11:27:46.085623824 +0000 UTC m=+21.781611860" watchObservedRunningTime="2026-05-26 11:27:46.104158763 +0000 UTC m=+21.800146798" May 26 11:27:46.104305 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.104279 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-8r62z" podStartSLOduration=4.478812656 podStartE2EDuration="22.10427571s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.37718573 +0000 UTC m=+3.073173757" lastFinishedPulling="2026-05-26 11:27:45.002648783 +0000 UTC m=+20.698636811" observedRunningTime="2026-05-26 11:27:46.104103634 +0000 UTC m=+21.800091670" watchObservedRunningTime="2026-05-26 11:27:46.10427571 +0000 UTC m=+21.800263745" May 26 11:27:46.118511 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.118476 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-4jd2t" podStartSLOduration=4.491848091 podStartE2EDuration="22.118443973s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.37916863 +0000 UTC m=+3.075156642" lastFinishedPulling="2026-05-26 11:27:45.005764511 +0000 UTC m=+20.701752524" observedRunningTime="2026-05-26 11:27:46.118182556 +0000 UTC m=+21.814170592" watchObservedRunningTime="2026-05-26 11:27:46.118443973 +0000 UTC m=+21.814432007" May 26 11:27:46.420725 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.420698 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 11:27:46.788831 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.788725 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T11:27:46.420722163Z","UUID":"8dbe68d6-75f0-40fc-a27c-03c298b712ee","Handler":null,"Name":"","Endpoint":""} May 26 11:27:46.790709 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.790611 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 11:27:46.790709 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.790638 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 11:27:46.844200 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:46.844173 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:46.844677 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:46.844280 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:47.002984 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:47.002945 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9q4g2" event={"ID":"e7976c98-bddc-4048-a62f-1a1dea4cfbf0","Type":"ContainerStarted","Data":"166a875fb34273c0197d9f4bd6a53a0991b0f6d5bd53558515c21b8f8e4a982a"} May 26 11:27:47.004673 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:47.004645 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" event={"ID":"d93dc972-89f2-4234-be03-96167b02f19f","Type":"ContainerStarted","Data":"a450ef80defa2fc39bc7d56d623679889a69c44532abac106083ec22fe2722a7"} May 26 11:27:47.020114 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:47.020063 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9q4g2" podStartSLOduration=5.439387514 podStartE2EDuration="23.020047483s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.387869301 +0000 UTC m=+3.083857314" lastFinishedPulling="2026-05-26 11:27:44.968529254 +0000 UTC m=+20.664517283" observedRunningTime="2026-05-26 11:27:47.019510915 +0000 UTC m=+22.715498952" watchObservedRunningTime="2026-05-26 11:27:47.020047483 +0000 UTC m=+22.716035496" May 26 11:27:47.839384 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:47.839305 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:47.839557 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:47.839442 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:48.008435 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:48.008367 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" event={"ID":"d93dc972-89f2-4234-be03-96167b02f19f","Type":"ContainerStarted","Data":"02667b240fee7547faa6169d36422c7d0289d38f360b770b334625cfdf7409ff"} May 26 11:27:48.012143 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:48.012118 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:27:48.013180 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:48.013142 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"950175f9c1d8a7fa87a590bf8d6d5569f701fd19688701939e55fb9c1f84f9bc"} May 26 11:27:48.026509 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:48.026445 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gngr8" podStartSLOduration=3.895671308 podStartE2EDuration="24.026434207s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.385738327 +0000 UTC m=+3.081726346" lastFinishedPulling="2026-05-26 11:27:47.516501233 +0000 UTC m=+23.212489245" observedRunningTime="2026-05-26 11:27:48.025891191 +0000 UTC m=+23.721879225" watchObservedRunningTime="2026-05-26 11:27:48.026434207 +0000 UTC m=+23.722422241" May 26 11:27:48.784668 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:48.784381 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:48.785057 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:48.785034 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:48.839354 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:48.839325 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:48.839522 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:48.839434 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:49.015869 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:49.015839 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:49.016316 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:49.016284 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c4sq2" May 26 11:27:49.839879 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:49.839856 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:49.840033 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:49.839953 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:50.017797 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:50.017773 2551 generic.go:358] "Generic (PLEG): container finished" podID="b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39" containerID="7ac84c0e657cd11f2bf1bfe43d03e5cb686a1c7d959f72bc1896a30d24becbe0" exitCode=0 May 26 11:27:50.018425 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:50.017833 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" event={"ID":"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39","Type":"ContainerDied","Data":"7ac84c0e657cd11f2bf1bfe43d03e5cb686a1c7d959f72bc1896a30d24becbe0"} May 26 11:27:50.839686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:50.839479 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:50.839823 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:50.839713 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:51.021850 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.021825 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:27:51.022434 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.022152 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"b2e93b7c2d610c781f181c305e55f4b7f14da6fa8f0db2770f9f5d8c7ca09cb1"} May 26 11:27:51.022533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.022443 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:51.022533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.022487 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:51.022633 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.022605 2551 scope.go:117] "RemoveContainer" containerID="f4df33e83d37dee23323711550323e1fd46e782e2d5889eaec16fb909ffa2544" May 26 11:27:51.024179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.024156 2551 generic.go:358] "Generic (PLEG): container finished" podID="b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39" containerID="491c0363e0a25f6d2022318a7cb052360583ffac9111a18ea172db6da0b15322" exitCode=0 May 26 11:27:51.024298 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.024213 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" event={"ID":"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39","Type":"ContainerDied","Data":"491c0363e0a25f6d2022318a7cb052360583ffac9111a18ea172db6da0b15322"} May 26 11:27:51.038867 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.038845 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:51.839978 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:51.839949 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:51.840087 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:51.840067 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:52.016111 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.016080 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pf5kc"] May 26 11:27:52.016280 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.016214 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:52.016340 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:52.016317 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:52.018974 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.018952 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g4m6v"] May 26 11:27:52.028275 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.028246 2551 generic.go:358] "Generic (PLEG): container finished" podID="b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39" containerID="e6caa3c8be44c69d7e3ff3f3a4402ec6e1b1a0a57b87c69bf5b4b143406bd06d" exitCode=0 May 26 11:27:52.028658 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.028334 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" event={"ID":"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39","Type":"ContainerDied","Data":"e6caa3c8be44c69d7e3ff3f3a4402ec6e1b1a0a57b87c69bf5b4b143406bd06d"} May 26 11:27:52.032077 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.032060 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:27:52.032472 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.032440 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:52.032570 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.032444 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" event={"ID":"a46be309-5eae-4bf4-80b7-0a502bba5d91","Type":"ContainerStarted","Data":"28c5f00fe26182098fc05b0ed9560743e30d4149705d83327590cff5ca69aa61"} May 26 11:27:52.032646 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:52.032572 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:52.032783 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.032758 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:52.048896 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.048871 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:27:52.083692 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:52.083640 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" podStartSLOduration=10.212089313 podStartE2EDuration="28.083625441s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.384329141 +0000 UTC m=+3.080317154" lastFinishedPulling="2026-05-26 11:27:45.255865266 +0000 UTC m=+20.951853282" observedRunningTime="2026-05-26 11:27:52.083005926 +0000 UTC m=+27.778993960" watchObservedRunningTime="2026-05-26 11:27:52.083625441 +0000 UTC m=+27.779613477" May 26 11:27:53.839346 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:53.839317 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:53.839772 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:53.839322 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:53.839772 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:53.839441 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:53.839772 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:53.839532 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:55.839319 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:55.839103 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:55.839911 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:55.839112 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:55.839911 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:55.839426 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:55.839911 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:55.839492 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:57.839647 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:57.839618 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:57.840074 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:57.839618 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:57.840074 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:57.839726 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:27:57.840074 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:57.839780 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pf5kc" podUID="d453e52d-629c-4f97-b043-946bcf90cdb4" May 26 11:27:58.139574 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.139552 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-99.ec2.internal" event="NodeReady" May 26 11:27:58.139684 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.139674 2551 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 11:27:58.185426 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.185393 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5hw5n"] May 26 11:27:58.208776 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.208752 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x7kbt"] May 26 11:27:58.208921 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.208904 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.211954 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.211937 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 11:27:58.212328 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.212315 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqkc6\"" May 26 11:27:58.212395 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.212377 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 11:27:58.221746 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.221729 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5hw5n"] May 26 11:27:58.221746 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.221750 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7kbt"] May 26 11:27:58.221862 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.221830 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:27:58.224801 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.224785 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 11:27:58.224866 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.224847 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 11:27:58.224915 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.224896 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 11:27:58.224957 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.224903 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gmhr4\"" May 26 11:27:58.378940 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.378880 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8770d97f-a72b-484e-adad-4d6aaf94ccf5-tmp-dir\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.378940 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.378913 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:27:58.379187 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.378958 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss45h\" (UniqueName: \"kubernetes.io/projected/8770d97f-a72b-484e-adad-4d6aaf94ccf5-kube-api-access-ss45h\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.379187 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.378979 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.379187 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.379059 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hllnt\" (UniqueName: \"kubernetes.io/projected/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-kube-api-access-hllnt\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:27:58.379187 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.379108 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8770d97f-a72b-484e-adad-4d6aaf94ccf5-config-volume\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.479705 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.479674 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8770d97f-a72b-484e-adad-4d6aaf94ccf5-tmp-dir\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.479705 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.479708 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:27:58.479881 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.479806 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:27:58.479881 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.479855 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert podName:74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d nodeName:}" failed. No retries permitted until 2026-05-26 11:27:58.979841767 +0000 UTC m=+34.675829780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert") pod "ingress-canary-x7kbt" (UID: "74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d") : secret "canary-serving-cert" not found May 26 11:27:58.479881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.479855 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:58.479992 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.479899 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ss45h\" (UniqueName: \"kubernetes.io/projected/8770d97f-a72b-484e-adad-4d6aaf94ccf5-kube-api-access-ss45h\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.479992 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.479931 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.479992 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.479978 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hllnt\" (UniqueName: \"kubernetes.io/projected/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-kube-api-access-hllnt\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:27:58.480101 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.479994 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:58.480101 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.480015 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8770d97f-a72b-484e-adad-4d6aaf94ccf5-config-volume\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.480101 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.480054 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:28:30.480038622 +0000 UTC m=+66.176026660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 11:27:58.480101 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.480066 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:27:58.480101 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.479996 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8770d97f-a72b-484e-adad-4d6aaf94ccf5-tmp-dir\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.480269 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.480123 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls podName:8770d97f-a72b-484e-adad-4d6aaf94ccf5 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:58.980107324 +0000 UTC m=+34.676095362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls") pod "dns-default-5hw5n" (UID: "8770d97f-a72b-484e-adad-4d6aaf94ccf5") : secret "dns-default-metrics-tls" not found May 26 11:27:58.480426 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.480411 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8770d97f-a72b-484e-adad-4d6aaf94ccf5-config-volume\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.489648 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.489624 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss45h\" (UniqueName: \"kubernetes.io/projected/8770d97f-a72b-484e-adad-4d6aaf94ccf5-kube-api-access-ss45h\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.489754 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.489697 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hllnt\" (UniqueName: \"kubernetes.io/projected/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-kube-api-access-hllnt\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:27:58.580880 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.580845 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:58.581038 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.580993 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 11:27:58.581038 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.581008 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 11:27:58.581038 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.581017 2551 projected.go:194] Error preparing data for projected volume kube-api-access-qwkxc for pod openshift-network-diagnostics/network-check-target-pf5kc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:58.581156 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.581064 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc podName:d453e52d-629c-4f97-b043-946bcf90cdb4 nodeName:}" failed. No retries permitted until 2026-05-26 11:28:30.581052518 +0000 UTC m=+66.277040537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qwkxc" (UniqueName: "kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc") pod "network-check-target-pf5kc" (UID: "d453e52d-629c-4f97-b043-946bcf90cdb4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 11:27:58.983937 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.983907 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:58.984533 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:58.983955 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:27:58.984533 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.984062 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:27:58.984533 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.984063 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:27:58.984533 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.984117 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert podName:74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d nodeName:}" failed. No retries permitted until 2026-05-26 11:27:59.984101018 +0000 UTC m=+35.680089030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert") pod "ingress-canary-x7kbt" (UID: "74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d") : secret "canary-serving-cert" not found May 26 11:27:58.984533 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:58.984131 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls podName:8770d97f-a72b-484e-adad-4d6aaf94ccf5 nodeName:}" failed. No retries permitted until 2026-05-26 11:27:59.984125192 +0000 UTC m=+35.680113204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls") pod "dns-default-5hw5n" (UID: "8770d97f-a72b-484e-adad-4d6aaf94ccf5") : secret "dns-default-metrics-tls" not found May 26 11:27:59.047579 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.047549 2551 generic.go:358] "Generic (PLEG): container finished" podID="b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39" containerID="348059c57c376aed17ec387b7a359d22bb31c3fcded79f4ffc71e83632eb2468" exitCode=0 May 26 11:27:59.047721 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.047589 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" event={"ID":"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39","Type":"ContainerDied","Data":"348059c57c376aed17ec387b7a359d22bb31c3fcded79f4ffc71e83632eb2468"} May 26 11:27:59.839864 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.839834 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:27:59.840103 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.839836 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:27:59.842906 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.842888 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 11:27:59.843031 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.842924 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 11:27:59.843031 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.842936 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jz9wk\"" May 26 11:27:59.843031 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.842924 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 11:27:59.843960 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.843946 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wnncn\"" May 26 11:27:59.990417 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.990385 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:27:59.990877 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:27:59.990442 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:27:59.990877 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:59.990569 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:27:59.990877 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:59.990600 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:27:59.990877 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:59.990651 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls podName:8770d97f-a72b-484e-adad-4d6aaf94ccf5 nodeName:}" failed. No retries permitted until 2026-05-26 11:28:01.990631888 +0000 UTC m=+37.686619906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls") pod "dns-default-5hw5n" (UID: "8770d97f-a72b-484e-adad-4d6aaf94ccf5") : secret "dns-default-metrics-tls" not found May 26 11:27:59.990877 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:27:59.990672 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert podName:74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d nodeName:}" failed. No retries permitted until 2026-05-26 11:28:01.990662126 +0000 UTC m=+37.686650141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert") pod "ingress-canary-x7kbt" (UID: "74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d") : secret "canary-serving-cert" not found May 26 11:28:00.052331 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:00.052304 2551 generic.go:358] "Generic (PLEG): container finished" podID="b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39" containerID="11b2a75e6e37a13314a7e7908d92bd8845039417a3ee8cfc9b2e2cc65712e84a" exitCode=0 May 26 11:28:00.052479 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:00.052336 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" event={"ID":"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39","Type":"ContainerDied","Data":"11b2a75e6e37a13314a7e7908d92bd8845039417a3ee8cfc9b2e2cc65712e84a"} May 26 11:28:01.057360 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:01.057187 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" event={"ID":"b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39","Type":"ContainerStarted","Data":"304923b7bf98443dbc094a426318fbbbb49ddb4c296ced86b4178dedd44696ea"} May 26 11:28:01.080027 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:01.079972 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mdqzv" podStartSLOduration=6.328602249 podStartE2EDuration="37.07995955s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:27:27.378779979 +0000 UTC m=+3.074768006" lastFinishedPulling="2026-05-26 11:27:58.130137291 +0000 UTC m=+33.826125307" observedRunningTime="2026-05-26 11:28:01.079424178 +0000 UTC m=+36.775412216" watchObservedRunningTime="2026-05-26 11:28:01.07995955 +0000 UTC m=+36.775947595" May 26 11:28:02.003876 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:02.003846 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:28:02.004028 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:02.003946 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:28:02.004028 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:02.003997 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:28:02.004099 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:02.004053 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:28:02.004099 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:02.004073 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert podName:74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d nodeName:}" failed. No retries permitted until 2026-05-26 11:28:06.004053515 +0000 UTC m=+41.700041542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert") pod "ingress-canary-x7kbt" (UID: "74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d") : secret "canary-serving-cert" not found May 26 11:28:02.004099 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:02.004091 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls podName:8770d97f-a72b-484e-adad-4d6aaf94ccf5 nodeName:}" failed. No retries permitted until 2026-05-26 11:28:06.004082453 +0000 UTC m=+41.700070466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls") pod "dns-default-5hw5n" (UID: "8770d97f-a72b-484e-adad-4d6aaf94ccf5") : secret "dns-default-metrics-tls" not found May 26 11:28:06.029887 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:06.029849 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:28:06.030327 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:06.029907 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:28:06.030327 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:06.030003 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:28:06.030327 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:06.030018 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:28:06.030327 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:06.030061 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls podName:8770d97f-a72b-484e-adad-4d6aaf94ccf5 nodeName:}" failed. No retries permitted until 2026-05-26 11:28:14.03004454 +0000 UTC m=+49.726032572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls") pod "dns-default-5hw5n" (UID: "8770d97f-a72b-484e-adad-4d6aaf94ccf5") : secret "dns-default-metrics-tls" not found May 26 11:28:06.030327 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:06.030085 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert podName:74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d nodeName:}" failed. No retries permitted until 2026-05-26 11:28:14.030067725 +0000 UTC m=+49.726055745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert") pod "ingress-canary-x7kbt" (UID: "74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d") : secret "canary-serving-cert" not found May 26 11:28:14.083831 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:14.083795 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:28:14.084198 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:14.083852 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:28:14.084198 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:14.083935 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:28:14.084198 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:14.083941 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:28:14.084198 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:14.083990 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls podName:8770d97f-a72b-484e-adad-4d6aaf94ccf5 nodeName:}" failed. No retries permitted until 2026-05-26 11:28:30.083972615 +0000 UTC m=+65.779960640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls") pod "dns-default-5hw5n" (UID: "8770d97f-a72b-484e-adad-4d6aaf94ccf5") : secret "dns-default-metrics-tls" not found May 26 11:28:14.084198 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:14.084011 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert podName:74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d nodeName:}" failed. No retries permitted until 2026-05-26 11:28:30.084004655 +0000 UTC m=+65.779992668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert") pod "ingress-canary-x7kbt" (UID: "74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d") : secret "canary-serving-cert" not found May 26 11:28:24.046333 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:24.046296 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqqr2" May 26 11:28:30.093394 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.093338 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:28:30.093394 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.093402 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:28:30.093836 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:30.093517 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:28:30.093836 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:30.093522 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:28:30.093836 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:30.093569 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert podName:74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d nodeName:}" failed. No retries permitted until 2026-05-26 11:29:02.093554216 +0000 UTC m=+97.789542228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert") pod "ingress-canary-x7kbt" (UID: "74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d") : secret "canary-serving-cert" not found May 26 11:28:30.093836 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:30.093581 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls podName:8770d97f-a72b-484e-adad-4d6aaf94ccf5 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:02.093575477 +0000 UTC m=+97.789563490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls") pod "dns-default-5hw5n" (UID: "8770d97f-a72b-484e-adad-4d6aaf94ccf5") : secret "dns-default-metrics-tls" not found May 26 11:28:30.495610 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.495585 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:28:30.498281 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.498265 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 11:28:30.506424 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:30.506401 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 11:28:30.506488 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:28:30.506473 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:29:34.50644656 +0000 UTC m=+130.202434572 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : secret "metrics-daemon-secret" not found May 26 11:28:30.596169 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.596139 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:28:30.598890 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.598874 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 11:28:30.609057 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.609040 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 11:28:30.621066 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.621036 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwkxc\" (UniqueName: \"kubernetes.io/projected/d453e52d-629c-4f97-b043-946bcf90cdb4-kube-api-access-qwkxc\") pod \"network-check-target-pf5kc\" (UID: \"d453e52d-629c-4f97-b043-946bcf90cdb4\") " pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:28:30.751549 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.751480 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wnncn\"" May 26 11:28:30.759495 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.759476 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:28:30.910240 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:30.910211 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pf5kc"] May 26 11:28:30.913448 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:28:30.913417 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd453e52d_629c_4f97_b043_946bcf90cdb4.slice/crio-fb03cfb8a1a13de17a55852d2f1ce83dd02cd0a766d4f44852b16f45bb8378c4 WatchSource:0}: Error finding container fb03cfb8a1a13de17a55852d2f1ce83dd02cd0a766d4f44852b16f45bb8378c4: Status 404 returned error can't find the container with id fb03cfb8a1a13de17a55852d2f1ce83dd02cd0a766d4f44852b16f45bb8378c4 May 26 11:28:31.110665 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:31.110590 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pf5kc" event={"ID":"d453e52d-629c-4f97-b043-946bcf90cdb4","Type":"ContainerStarted","Data":"fb03cfb8a1a13de17a55852d2f1ce83dd02cd0a766d4f44852b16f45bb8378c4"} May 26 11:28:34.117430 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:34.117391 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pf5kc" event={"ID":"d453e52d-629c-4f97-b043-946bcf90cdb4","Type":"ContainerStarted","Data":"2fe2758969125b37c8b04caf51d67b9535a5ebd20fce89896f2af633c3d2d90e"} May 26 11:28:34.117810 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:34.117537 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:28:34.132574 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:28:34.132532 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pf5kc" podStartSLOduration=67.690687673 podStartE2EDuration="1m10.132520818s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:28:30.915265801 +0000 UTC m=+66.611253814" lastFinishedPulling="2026-05-26 11:28:33.357098943 +0000 UTC m=+69.053086959" observedRunningTime="2026-05-26 11:28:34.131655036 +0000 UTC m=+69.827643093" watchObservedRunningTime="2026-05-26 11:28:34.132520818 +0000 UTC m=+69.828508847" May 26 11:29:02.109474 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:02.109423 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:29:02.109914 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:02.109507 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:29:02.109914 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:02.109574 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 11:29:02.109914 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:02.109623 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 11:29:02.109914 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:02.109651 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert podName:74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d nodeName:}" failed. No retries permitted until 2026-05-26 11:30:06.109635366 +0000 UTC m=+161.805623380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert") pod "ingress-canary-x7kbt" (UID: "74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d") : secret "canary-serving-cert" not found May 26 11:29:02.109914 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:02.109685 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls podName:8770d97f-a72b-484e-adad-4d6aaf94ccf5 nodeName:}" failed. No retries permitted until 2026-05-26 11:30:06.109668366 +0000 UTC m=+161.805656386 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls") pod "dns-default-5hw5n" (UID: "8770d97f-a72b-484e-adad-4d6aaf94ccf5") : secret "dns-default-metrics-tls" not found May 26 11:29:05.121984 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:05.121955 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pf5kc" May 26 11:29:17.549404 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.549368 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-688p8"] May 26 11:29:17.551654 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.551636 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.554074 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.554049 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 11:29:17.554207 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.554074 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 26 11:29:17.554207 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.554148 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 11:29:17.554207 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.554186 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 26 11:29:17.554370 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.554355 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-v4npg\"" May 26 11:29:17.559494 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.559478 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 26 11:29:17.561353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.561334 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-688p8"] May 26 11:29:17.609901 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.609877 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-tmp\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.609993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.609913 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-serving-cert\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.609993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.609936 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dtms\" (UniqueName: \"kubernetes.io/projected/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-kube-api-access-6dtms\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.609993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.609958 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-snapshots\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.610096 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.610021 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.610131 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.610090 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.652556 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.652533 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f86559754-rjjh7"] May 26 11:29:17.654136 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.654123 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.656428 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.656410 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 26 11:29:17.656804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.656788 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k7n5l\"" May 26 11:29:17.656917 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.656812 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 26 11:29:17.657018 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.656812 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 26 11:29:17.657018 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.656816 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 26 11:29:17.657115 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.656836 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 26 11:29:17.657115 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.656873 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 26 11:29:17.666361 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.666343 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f86559754-rjjh7"] May 26 11:29:17.710773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.710754 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.710871 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.710792 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.710871 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.710819 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.710871 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.710835 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-stats-auth\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.711038 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.710857 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnd64\" (UniqueName: \"kubernetes.io/projected/108c5513-15ce-42a7-ad35-290f855779d1-kube-api-access-jnd64\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.711038 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.710913 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.711038 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.710950 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-tmp\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.711038 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.710994 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-serving-cert\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.711232 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.711089 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dtms\" (UniqueName: \"kubernetes.io/projected/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-kube-api-access-6dtms\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.711232 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.711123 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-default-certificate\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.711232 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.711169 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-snapshots\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.711389 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.711338 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-tmp\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.711520 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.711500 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-service-ca-bundle\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.711699 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.711683 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-snapshots\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.712071 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.712056 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.713318 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.713302 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-serving-cert\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.718674 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.718656 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dtms\" (UniqueName: \"kubernetes.io/projected/2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7-kube-api-access-6dtms\") pod \"insights-operator-78bdfb888c-688p8\" (UID: \"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7\") " pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.811651 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.811573 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.811651 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.811607 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-stats-auth\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.811651 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.811630 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnd64\" (UniqueName: \"kubernetes.io/projected/108c5513-15ce-42a7-ad35-290f855779d1-kube-api-access-jnd64\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.811875 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:17.811764 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:18.311741588 +0000 UTC m=+114.007729628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : configmap references non-existent config key: service-ca.crt May 26 11:29:17.811875 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.811793 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.811875 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.811842 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-default-certificate\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.812026 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:17.811943 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:29:17.812026 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:17.812007 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:18.311990211 +0000 UTC m=+114.007978239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : secret "router-metrics-certs-default" not found May 26 11:29:17.813983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.813960 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-stats-auth\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.814080 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.814045 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-default-certificate\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.820150 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.820130 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnd64\" (UniqueName: \"kubernetes.io/projected/108c5513-15ce-42a7-ad35-290f855779d1-kube-api-access-jnd64\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:17.860940 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.860919 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-688p8" May 26 11:29:17.974032 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:17.973998 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-688p8"] May 26 11:29:17.977396 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:29:17.977374 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec8f60b_37b2_4944_aa0d_ebeb8ed812d7.slice/crio-2bbef56983344bfb0c73578b6a4978eccec87aca576287968fa8a55ff19dae74 WatchSource:0}: Error finding container 2bbef56983344bfb0c73578b6a4978eccec87aca576287968fa8a55ff19dae74: Status 404 returned error can't find the container with id 2bbef56983344bfb0c73578b6a4978eccec87aca576287968fa8a55ff19dae74 May 26 11:29:18.199389 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:18.199303 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-688p8" event={"ID":"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7","Type":"ContainerStarted","Data":"2bbef56983344bfb0c73578b6a4978eccec87aca576287968fa8a55ff19dae74"} May 26 11:29:18.315359 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:18.315328 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:18.315540 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:18.315370 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:18.315540 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:18.315478 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:29:18.315540 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:18.315501 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:19.31548208 +0000 UTC m=+115.011470092 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : configmap references non-existent config key: service-ca.crt May 26 11:29:18.315540 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:18.315521 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:19.315514804 +0000 UTC m=+115.011502816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : secret "router-metrics-certs-default" not found May 26 11:29:19.323519 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.323487 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:19.323957 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.323534 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:19.323957 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:19.323644 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:29:19.323957 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:19.323685 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:21.323661057 +0000 UTC m=+117.019649081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : configmap references non-existent config key: service-ca.crt May 26 11:29:19.323957 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:19.323720 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:21.323708272 +0000 UTC m=+117.019696288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : secret "router-metrics-certs-default" not found May 26 11:29:19.484326 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.484290 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4"] May 26 11:29:19.486701 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.486679 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:19.489185 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.489158 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 26 11:29:19.489674 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.489643 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zc94w\"" May 26 11:29:19.489783 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.489731 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 26 11:29:19.490421 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.490319 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 26 11:29:19.495751 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.495726 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4"] May 26 11:29:19.626396 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.626293 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69k9z\" (UniqueName: \"kubernetes.io/projected/f13351a3-3126-49c9-b11c-45dc80e7824e-kube-api-access-69k9z\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:19.626581 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.626503 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:19.726971 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.726947 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:19.727054 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.727022 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69k9z\" (UniqueName: \"kubernetes.io/projected/f13351a3-3126-49c9-b11c-45dc80e7824e-kube-api-access-69k9z\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:19.727107 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:19.727091 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 11:29:19.727162 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:19.727153 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls podName:f13351a3-3126-49c9-b11c-45dc80e7824e nodeName:}" failed. No retries permitted until 2026-05-26 11:29:20.227134043 +0000 UTC m=+115.923122068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls") pod "cluster-samples-operator-697587599-mjbx4" (UID: "f13351a3-3126-49c9-b11c-45dc80e7824e") : secret "samples-operator-tls" not found May 26 11:29:19.736695 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:19.736674 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69k9z\" (UniqueName: \"kubernetes.io/projected/f13351a3-3126-49c9-b11c-45dc80e7824e-kube-api-access-69k9z\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:20.204123 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:20.204077 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-688p8" event={"ID":"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7","Type":"ContainerStarted","Data":"c54af7ea8996d6339dcac9e6245386f631778f1e84d24661eec76bd6a6bedeb4"} May 26 11:29:20.219655 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:20.219604 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-688p8" podStartSLOduration=1.522936557 podStartE2EDuration="3.219590564s" podCreationTimestamp="2026-05-26 11:29:17 +0000 UTC" firstStartedPulling="2026-05-26 11:29:17.979071417 +0000 UTC m=+113.675059433" lastFinishedPulling="2026-05-26 11:29:19.675725414 +0000 UTC m=+115.371713440" observedRunningTime="2026-05-26 11:29:20.219355674 +0000 UTC m=+115.915343710" watchObservedRunningTime="2026-05-26 11:29:20.219590564 +0000 UTC m=+115.915578598" May 26 11:29:20.229651 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:20.229623 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:20.229761 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:20.229748 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 11:29:20.229818 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:20.229808 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls podName:f13351a3-3126-49c9-b11c-45dc80e7824e nodeName:}" failed. No retries permitted until 2026-05-26 11:29:21.229791003 +0000 UTC m=+116.925779030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls") pod "cluster-samples-operator-697587599-mjbx4" (UID: "f13351a3-3126-49c9-b11c-45dc80e7824e") : secret "samples-operator-tls" not found May 26 11:29:21.238371 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.238343 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:21.238752 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:21.238488 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 11:29:21.238752 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:21.238558 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls podName:f13351a3-3126-49c9-b11c-45dc80e7824e nodeName:}" failed. No retries permitted until 2026-05-26 11:29:23.238543898 +0000 UTC m=+118.934531911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls") pod "cluster-samples-operator-697587599-mjbx4" (UID: "f13351a3-3126-49c9-b11c-45dc80e7824e") : secret "samples-operator-tls" not found May 26 11:29:21.338833 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.338800 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:21.339005 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.338848 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:21.339005 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:21.338966 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:25.338952125 +0000 UTC m=+121.034940141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : configmap references non-existent config key: service-ca.crt May 26 11:29:21.339005 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:21.338988 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:29:21.339183 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:21.339079 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:25.33906282 +0000 UTC m=+121.035050848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : secret "router-metrics-certs-default" not found May 26 11:29:21.477555 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.477528 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-c82hq"] May 26 11:29:21.479262 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.479249 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.481951 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.481933 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 26 11:29:21.482096 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.482077 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 26 11:29:21.482175 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.482100 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 26 11:29:21.482971 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.482953 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 26 11:29:21.483056 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.483013 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d7jgz\"" May 26 11:29:21.487675 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.487659 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 26 11:29:21.489932 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.489886 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-c82hq"] May 26 11:29:21.540832 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.540812 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75997849-b606-4fd2-9aa5-37e7dee71456-serving-cert\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.540930 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.540862 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75997849-b606-4fd2-9aa5-37e7dee71456-config\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.540930 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.540878 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75997849-b606-4fd2-9aa5-37e7dee71456-trusted-ca\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.540930 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.540898 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xc4h\" (UniqueName: \"kubernetes.io/projected/75997849-b606-4fd2-9aa5-37e7dee71456-kube-api-access-9xc4h\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.641898 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.641876 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75997849-b606-4fd2-9aa5-37e7dee71456-config\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.642012 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.641903 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75997849-b606-4fd2-9aa5-37e7dee71456-trusted-ca\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.642012 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.641925 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xc4h\" (UniqueName: \"kubernetes.io/projected/75997849-b606-4fd2-9aa5-37e7dee71456-kube-api-access-9xc4h\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.642091 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.642013 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75997849-b606-4fd2-9aa5-37e7dee71456-serving-cert\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.642543 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.642527 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75997849-b606-4fd2-9aa5-37e7dee71456-config\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.642820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.642802 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75997849-b606-4fd2-9aa5-37e7dee71456-trusted-ca\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.644223 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.644204 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75997849-b606-4fd2-9aa5-37e7dee71456-serving-cert\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.651173 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.651156 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xc4h\" (UniqueName: \"kubernetes.io/projected/75997849-b606-4fd2-9aa5-37e7dee71456-kube-api-access-9xc4h\") pod \"console-operator-76dff48d59-c82hq\" (UID: \"75997849-b606-4fd2-9aa5-37e7dee71456\") " pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.788821 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.788750 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:21.903328 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:21.903298 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-c82hq"] May 26 11:29:21.905956 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:29:21.905925 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75997849_b606_4fd2_9aa5_37e7dee71456.slice/crio-3e025007692a721d7af0f07fe3c3edf6a4e09c1c9815ae96633580bcb2718cd4 WatchSource:0}: Error finding container 3e025007692a721d7af0f07fe3c3edf6a4e09c1c9815ae96633580bcb2718cd4: Status 404 returned error can't find the container with id 3e025007692a721d7af0f07fe3c3edf6a4e09c1c9815ae96633580bcb2718cd4 May 26 11:29:22.208994 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:22.208916 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" event={"ID":"75997849-b606-4fd2-9aa5-37e7dee71456","Type":"ContainerStarted","Data":"3e025007692a721d7af0f07fe3c3edf6a4e09c1c9815ae96633580bcb2718cd4"} May 26 11:29:22.760947 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:22.760915 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4jd2t_cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b/dns-node-resolver/0.log" May 26 11:29:23.253946 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:23.253916 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:23.254123 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:23.254059 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 11:29:23.254171 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:23.254144 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls podName:f13351a3-3126-49c9-b11c-45dc80e7824e nodeName:}" failed. No retries permitted until 2026-05-26 11:29:27.254120833 +0000 UTC m=+122.950108852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls") pod "cluster-samples-operator-697587599-mjbx4" (UID: "f13351a3-3126-49c9-b11c-45dc80e7824e") : secret "samples-operator-tls" not found May 26 11:29:23.559912 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:23.559849 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2wvg7_f9660178-e587-4a86-8f62-9cd0d0c00bff/node-ca/0.log" May 26 11:29:24.214874 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:24.214849 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/0.log" May 26 11:29:24.215260 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:24.214885 2551 generic.go:358] "Generic (PLEG): container finished" podID="75997849-b606-4fd2-9aa5-37e7dee71456" containerID="6ad61d886cc89ab40612812bf5270da2015c0e16d142d3bf144552c6276bbc10" exitCode=255 May 26 11:29:24.215260 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:24.214920 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" event={"ID":"75997849-b606-4fd2-9aa5-37e7dee71456","Type":"ContainerDied","Data":"6ad61d886cc89ab40612812bf5270da2015c0e16d142d3bf144552c6276bbc10"} May 26 11:29:24.215260 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:24.215139 2551 scope.go:117] "RemoveContainer" containerID="6ad61d886cc89ab40612812bf5270da2015c0e16d142d3bf144552c6276bbc10" May 26 11:29:25.218123 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:25.218097 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/1.log" May 26 11:29:25.218555 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:25.218519 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/0.log" May 26 11:29:25.218630 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:25.218550 2551 generic.go:358] "Generic (PLEG): container finished" podID="75997849-b606-4fd2-9aa5-37e7dee71456" containerID="5d11063a48aeb5c8202f2da48eaef621004e2ce0abb79249d01c08f47f79b77c" exitCode=255 May 26 11:29:25.218630 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:25.218595 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" event={"ID":"75997849-b606-4fd2-9aa5-37e7dee71456","Type":"ContainerDied","Data":"5d11063a48aeb5c8202f2da48eaef621004e2ce0abb79249d01c08f47f79b77c"} May 26 11:29:25.218630 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:25.218621 2551 scope.go:117] "RemoveContainer" containerID="6ad61d886cc89ab40612812bf5270da2015c0e16d142d3bf144552c6276bbc10" May 26 11:29:25.218850 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:25.218835 2551 scope.go:117] "RemoveContainer" containerID="5d11063a48aeb5c8202f2da48eaef621004e2ce0abb79249d01c08f47f79b77c" May 26 11:29:25.219021 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:25.219002 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-c82hq_openshift-console-operator(75997849-b606-4fd2-9aa5-37e7dee71456)\"" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" podUID="75997849-b606-4fd2-9aa5-37e7dee71456" May 26 11:29:25.368987 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:25.368957 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:25.369136 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:25.369060 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:33.369046364 +0000 UTC m=+129.065034377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : configmap references non-existent config key: service-ca.crt May 26 11:29:25.369136 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:25.369107 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:25.369253 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:25.369232 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:29:25.369312 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:25.369304 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:33.369278138 +0000 UTC m=+129.065266166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : secret "router-metrics-certs-default" not found May 26 11:29:26.221929 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:26.221880 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/1.log" May 26 11:29:26.222286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:26.222227 2551 scope.go:117] "RemoveContainer" containerID="5d11063a48aeb5c8202f2da48eaef621004e2ce0abb79249d01c08f47f79b77c" May 26 11:29:26.222411 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:26.222393 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-c82hq_openshift-console-operator(75997849-b606-4fd2-9aa5-37e7dee71456)\"" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" podUID="75997849-b606-4fd2-9aa5-37e7dee71456" May 26 11:29:27.284947 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.284914 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:27.285350 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:27.285061 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 11:29:27.285350 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:27.285142 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls podName:f13351a3-3126-49c9-b11c-45dc80e7824e nodeName:}" failed. No retries permitted until 2026-05-26 11:29:35.285127456 +0000 UTC m=+130.981115472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls") pod "cluster-samples-operator-697587599-mjbx4" (UID: "f13351a3-3126-49c9-b11c-45dc80e7824e") : secret "samples-operator-tls" not found May 26 11:29:27.544171 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.544091 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg"] May 26 11:29:27.546384 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.546369 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.548847 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.548818 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-b7pgc\"" May 26 11:29:27.548975 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.548820 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 26 11:29:27.549120 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.548973 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 26 11:29:27.549120 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.549043 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 26 11:29:27.549120 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.549095 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 26 11:29:27.558124 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.558103 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg"] May 26 11:29:27.687989 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.687961 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2lwb\" (UniqueName: \"kubernetes.io/projected/6be524d7-956b-4fbe-8dfd-16ad55714599-kube-api-access-g2lwb\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.688134 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.688015 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6be524d7-956b-4fbe-8dfd-16ad55714599-config\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.688134 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.688092 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6be524d7-956b-4fbe-8dfd-16ad55714599-serving-cert\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.788924 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.788899 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2lwb\" (UniqueName: \"kubernetes.io/projected/6be524d7-956b-4fbe-8dfd-16ad55714599-kube-api-access-g2lwb\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.789026 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.788949 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6be524d7-956b-4fbe-8dfd-16ad55714599-config\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.789026 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.788981 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6be524d7-956b-4fbe-8dfd-16ad55714599-serving-cert\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.789494 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.789450 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6be524d7-956b-4fbe-8dfd-16ad55714599-config\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.791086 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.791069 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6be524d7-956b-4fbe-8dfd-16ad55714599-serving-cert\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.796385 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.796333 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2lwb\" (UniqueName: \"kubernetes.io/projected/6be524d7-956b-4fbe-8dfd-16ad55714599-kube-api-access-g2lwb\") pod \"service-ca-operator-57b5b68b8-sqzrg\" (UID: \"6be524d7-956b-4fbe-8dfd-16ad55714599\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.854880 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.854859 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" May 26 11:29:27.967916 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:27.967893 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg"] May 26 11:29:27.972450 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:29:27.972417 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be524d7_956b_4fbe_8dfd_16ad55714599.slice/crio-09be377d6260892a5df9ae343da1bfced5ee9d16a9b33ecf05e848c546585823 WatchSource:0}: Error finding container 09be377d6260892a5df9ae343da1bfced5ee9d16a9b33ecf05e848c546585823: Status 404 returned error can't find the container with id 09be377d6260892a5df9ae343da1bfced5ee9d16a9b33ecf05e848c546585823 May 26 11:29:28.109370 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.109301 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c"] May 26 11:29:28.111870 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.111854 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c" May 26 11:29:28.114255 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.114239 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vp4qx\"" May 26 11:29:28.118781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.118383 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c"] May 26 11:29:28.192638 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.192612 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhr9b\" (UniqueName: \"kubernetes.io/projected/4f50b274-ac2a-44fd-825d-397c6863ece9-kube-api-access-dhr9b\") pod \"network-check-source-7f44b6dd87-vsp5c\" (UID: \"4f50b274-ac2a-44fd-825d-397c6863ece9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c" May 26 11:29:28.226861 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.226831 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" event={"ID":"6be524d7-956b-4fbe-8dfd-16ad55714599","Type":"ContainerStarted","Data":"09be377d6260892a5df9ae343da1bfced5ee9d16a9b33ecf05e848c546585823"} May 26 11:29:28.293598 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.293571 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhr9b\" (UniqueName: \"kubernetes.io/projected/4f50b274-ac2a-44fd-825d-397c6863ece9-kube-api-access-dhr9b\") pod \"network-check-source-7f44b6dd87-vsp5c\" (UID: \"4f50b274-ac2a-44fd-825d-397c6863ece9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c" May 26 11:29:28.301720 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.301697 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhr9b\" (UniqueName: \"kubernetes.io/projected/4f50b274-ac2a-44fd-825d-397c6863ece9-kube-api-access-dhr9b\") pod \"network-check-source-7f44b6dd87-vsp5c\" (UID: \"4f50b274-ac2a-44fd-825d-397c6863ece9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c" May 26 11:29:28.420905 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.420833 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c" May 26 11:29:28.551652 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:28.551619 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c"] May 26 11:29:28.554245 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:29:28.554219 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f50b274_ac2a_44fd_825d_397c6863ece9.slice/crio-7259be2247eeadab548eac6f8c9784bb3741ce0325bdb0f3cc4c863f987dc93d WatchSource:0}: Error finding container 7259be2247eeadab548eac6f8c9784bb3741ce0325bdb0f3cc4c863f987dc93d: Status 404 returned error can't find the container with id 7259be2247eeadab548eac6f8c9784bb3741ce0325bdb0f3cc4c863f987dc93d May 26 11:29:29.230410 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:29.230376 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c" event={"ID":"4f50b274-ac2a-44fd-825d-397c6863ece9","Type":"ContainerStarted","Data":"204b712bf9342b8548f000dffbc02b034bad4988416298568b56b6e18a81c4d2"} May 26 11:29:29.230410 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:29.230413 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c" event={"ID":"4f50b274-ac2a-44fd-825d-397c6863ece9","Type":"ContainerStarted","Data":"7259be2247eeadab548eac6f8c9784bb3741ce0325bdb0f3cc4c863f987dc93d"} May 26 11:29:29.245020 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:29.244976 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vsp5c" podStartSLOduration=1.24496343 podStartE2EDuration="1.24496343s" podCreationTimestamp="2026-05-26 11:29:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:29:29.244276681 +0000 UTC m=+124.940264715" watchObservedRunningTime="2026-05-26 11:29:29.24496343 +0000 UTC m=+124.940951580" May 26 11:29:30.234341 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:30.234308 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" event={"ID":"6be524d7-956b-4fbe-8dfd-16ad55714599","Type":"ContainerStarted","Data":"e911d0c1f0c50e67c571afe97c91be04533657b84b358dc135d76dda5f28a8c6"} May 26 11:29:30.252055 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:30.252005 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" podStartSLOduration=1.3794958529999999 podStartE2EDuration="3.251991657s" podCreationTimestamp="2026-05-26 11:29:27 +0000 UTC" firstStartedPulling="2026-05-26 11:29:27.974901525 +0000 UTC m=+123.670889538" lastFinishedPulling="2026-05-26 11:29:29.847397318 +0000 UTC m=+125.543385342" observedRunningTime="2026-05-26 11:29:30.251235985 +0000 UTC m=+125.947224022" watchObservedRunningTime="2026-05-26 11:29:30.251991657 +0000 UTC m=+125.947979691" May 26 11:29:31.789686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:31.789655 2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:31.789686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:31.789686 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:31.790100 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:31.790025 2551 scope.go:117] "RemoveContainer" containerID="5d11063a48aeb5c8202f2da48eaef621004e2ce0abb79249d01c08f47f79b77c" May 26 11:29:31.790229 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:31.790211 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-c82hq_openshift-console-operator(75997849-b606-4fd2-9aa5-37e7dee71456)\"" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" podUID="75997849-b606-4fd2-9aa5-37e7dee71456" May 26 11:29:33.435538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:33.435495 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:33.436001 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:33.435558 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:33.436001 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:33.435664 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 11:29:33.436001 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:33.435665 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:49.435648253 +0000 UTC m=+145.131636266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : configmap references non-existent config key: service-ca.crt May 26 11:29:33.436001 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:33.435711 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs podName:108c5513-15ce-42a7-ad35-290f855779d1 nodeName:}" failed. No retries permitted until 2026-05-26 11:29:49.435700293 +0000 UTC m=+145.131688306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs") pod "router-default-f86559754-rjjh7" (UID: "108c5513-15ce-42a7-ad35-290f855779d1") : secret "router-metrics-certs-default" not found May 26 11:29:34.544126 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:34.544088 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:29:34.544510 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:34.544203 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 11:29:34.544510 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:34.544263 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs podName:acb515e4-f4ef-437f-91bd-dadc3359247d nodeName:}" failed. No retries permitted until 2026-05-26 11:31:36.544250753 +0000 UTC m=+252.240238767 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs") pod "network-metrics-daemon-g4m6v" (UID: "acb515e4-f4ef-437f-91bd-dadc3359247d") : secret "metrics-daemon-secret" not found May 26 11:29:35.348143 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:35.348084 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:35.348315 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:35.348246 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 11:29:35.348355 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:35.348316 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls podName:f13351a3-3126-49c9-b11c-45dc80e7824e nodeName:}" failed. No retries permitted until 2026-05-26 11:29:51.348298893 +0000 UTC m=+147.044286910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls") pod "cluster-samples-operator-697587599-mjbx4" (UID: "f13351a3-3126-49c9-b11c-45dc80e7824e") : secret "samples-operator-tls" not found May 26 11:29:43.840227 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:43.840198 2551 scope.go:117] "RemoveContainer" containerID="5d11063a48aeb5c8202f2da48eaef621004e2ce0abb79249d01c08f47f79b77c" May 26 11:29:44.268601 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:44.268579 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:29:44.268947 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:44.268933 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/1.log" May 26 11:29:44.269006 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:44.268963 2551 generic.go:358] "Generic (PLEG): container finished" podID="75997849-b606-4fd2-9aa5-37e7dee71456" containerID="ce29f13a1403e6c2b9b89a9eb32fa271d03f5c628c4d2629b79dec1abc722aa7" exitCode=255 May 26 11:29:44.269006 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:44.268988 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" event={"ID":"75997849-b606-4fd2-9aa5-37e7dee71456","Type":"ContainerDied","Data":"ce29f13a1403e6c2b9b89a9eb32fa271d03f5c628c4d2629b79dec1abc722aa7"} May 26 11:29:44.269077 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:44.269015 2551 scope.go:117] "RemoveContainer" containerID="5d11063a48aeb5c8202f2da48eaef621004e2ce0abb79249d01c08f47f79b77c" May 26 11:29:44.269306 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:44.269290 2551 scope.go:117] "RemoveContainer" containerID="ce29f13a1403e6c2b9b89a9eb32fa271d03f5c628c4d2629b79dec1abc722aa7" May 26 11:29:44.269488 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:44.269470 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-c82hq_openshift-console-operator(75997849-b606-4fd2-9aa5-37e7dee71456)\"" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" podUID="75997849-b606-4fd2-9aa5-37e7dee71456" May 26 11:29:45.272586 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:45.272562 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:29:49.451761 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:49.451716 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:49.452139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:49.451808 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:49.452306 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:49.452289 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/108c5513-15ce-42a7-ad35-290f855779d1-service-ca-bundle\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:49.453987 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:49.453958 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/108c5513-15ce-42a7-ad35-290f855779d1-metrics-certs\") pod \"router-default-f86559754-rjjh7\" (UID: \"108c5513-15ce-42a7-ad35-290f855779d1\") " pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:49.465394 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:49.465378 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k7n5l\"" May 26 11:29:49.473592 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:49.473576 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:49.597630 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:49.597601 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f86559754-rjjh7"] May 26 11:29:49.600621 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:29:49.600583 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108c5513_15ce_42a7_ad35_290f855779d1.slice/crio-cb49a08260b22bb002675db307e6b0fa4fd62ec258b538883903be69a942cefe WatchSource:0}: Error finding container cb49a08260b22bb002675db307e6b0fa4fd62ec258b538883903be69a942cefe: Status 404 returned error can't find the container with id cb49a08260b22bb002675db307e6b0fa4fd62ec258b538883903be69a942cefe May 26 11:29:50.284812 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:50.284778 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f86559754-rjjh7" event={"ID":"108c5513-15ce-42a7-ad35-290f855779d1","Type":"ContainerStarted","Data":"d642836f61671744ad29e5d8421fc0e262005279a7586d4dafd87a83685aea26"} May 26 11:29:50.284812 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:50.284815 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f86559754-rjjh7" event={"ID":"108c5513-15ce-42a7-ad35-290f855779d1","Type":"ContainerStarted","Data":"cb49a08260b22bb002675db307e6b0fa4fd62ec258b538883903be69a942cefe"} May 26 11:29:50.303194 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:50.303157 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-f86559754-rjjh7" podStartSLOduration=33.303143418 podStartE2EDuration="33.303143418s" podCreationTimestamp="2026-05-26 11:29:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:29:50.302028633 +0000 UTC m=+145.998016667" watchObservedRunningTime="2026-05-26 11:29:50.303143418 +0000 UTC m=+145.999131453" May 26 11:29:50.474486 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:50.474436 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:50.476934 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:50.476915 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:51.287813 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.287779 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:51.288918 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.288898 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f86559754-rjjh7" May 26 11:29:51.365886 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.365856 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:51.368114 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.368085 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f13351a3-3126-49c9-b11c-45dc80e7824e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-mjbx4\" (UID: \"f13351a3-3126-49c9-b11c-45dc80e7824e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:51.600898 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.600814 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zc94w\"" May 26 11:29:51.608812 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.608790 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" May 26 11:29:51.722998 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.722842 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4"] May 26 11:29:51.789674 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.789648 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:51.789674 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.789676 2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:29:51.789995 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:51.789979 2551 scope.go:117] "RemoveContainer" containerID="ce29f13a1403e6c2b9b89a9eb32fa271d03f5c628c4d2629b79dec1abc722aa7" May 26 11:29:51.790150 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:51.790131 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-c82hq_openshift-console-operator(75997849-b606-4fd2-9aa5-37e7dee71456)\"" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" podUID="75997849-b606-4fd2-9aa5-37e7dee71456" May 26 11:29:52.291042 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:52.291010 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" event={"ID":"f13351a3-3126-49c9-b11c-45dc80e7824e","Type":"ContainerStarted","Data":"a88f545aa008d0ba75be176f2b2524de3a95f81a0791aac82ee91f8ab8eb562e"} May 26 11:29:54.297308 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:54.297272 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" event={"ID":"f13351a3-3126-49c9-b11c-45dc80e7824e","Type":"ContainerStarted","Data":"cbc2990b102d25e6661147f90f92b3bacc10f30a98676657e7cb0947b927add5"} May 26 11:29:54.297308 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:54.297309 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" event={"ID":"f13351a3-3126-49c9-b11c-45dc80e7824e","Type":"ContainerStarted","Data":"70e4a2f62790c1f13da5a1024649c870a2fc1e3a58d52728a358bbcb868b13f3"} May 26 11:29:54.313744 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:54.313703 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-mjbx4" podStartSLOduration=33.752589969 podStartE2EDuration="35.313690682s" podCreationTimestamp="2026-05-26 11:29:19 +0000 UTC" firstStartedPulling="2026-05-26 11:29:51.76361803 +0000 UTC m=+147.459606043" lastFinishedPulling="2026-05-26 11:29:53.324718729 +0000 UTC m=+149.020706756" observedRunningTime="2026-05-26 11:29:54.313008135 +0000 UTC m=+150.008996171" watchObservedRunningTime="2026-05-26 11:29:54.313690682 +0000 UTC m=+150.009678716" May 26 11:29:56.026088 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.026062 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tzmnj"] May 26 11:29:56.028614 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.028583 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.032340 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.032319 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r76dd\"" May 26 11:29:56.032906 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.032886 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 11:29:56.033479 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.033447 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 11:29:56.045554 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.045535 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tzmnj"] May 26 11:29:56.143093 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.142945 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4"] May 26 11:29:56.145056 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.145038 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78f74bb744-c5nxl"] May 26 11:29:56.145222 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.145198 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" May 26 11:29:56.146866 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.146848 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.148228 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.148206 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gs7f2\"" May 26 11:29:56.148839 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.148819 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 26 11:29:56.149362 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.149346 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 26 11:29:56.149656 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.149640 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-697bc\"" May 26 11:29:56.149732 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.149656 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 26 11:29:56.149732 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.149719 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 26 11:29:56.158931 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.158914 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 26 11:29:56.171039 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.168550 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4"] May 26 11:29:56.171039 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.169995 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f74bb744-c5nxl"] May 26 11:29:56.204245 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.204211 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ba5f17b-4318-4fc5-82b9-0a2b93191015-crio-socket\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.204245 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.204252 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ba5f17b-4318-4fc5-82b9-0a2b93191015-data-volume\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.204377 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.204290 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ba5f17b-4318-4fc5-82b9-0a2b93191015-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.204377 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.204343 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hk5j\" (UniqueName: \"kubernetes.io/projected/6ba5f17b-4318-4fc5-82b9-0a2b93191015-kube-api-access-2hk5j\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.204445 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.204392 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ba5f17b-4318-4fc5-82b9-0a2b93191015-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.223088 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.223069 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f74bb744-c5nxl"] May 26 11:29:56.223238 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:56.223216 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-qskzm registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" podUID="32ffeeda-ad13-4932-ac0e-6fec92b98266" May 26 11:29:56.301199 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.301138 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.304702 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304672 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ba5f17b-4318-4fc5-82b9-0a2b93191015-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.304813 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304711 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-image-registry-private-configuration\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.304813 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304743 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-tls\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.304813 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304769 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qskzm\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-kube-api-access-qskzm\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.304963 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304839 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-installation-pull-secrets\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.304963 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304867 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ba5f17b-4318-4fc5-82b9-0a2b93191015-crio-socket\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.304963 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304937 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.304963 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304945 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ba5f17b-4318-4fc5-82b9-0a2b93191015-crio-socket\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.305127 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.304935 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ba5f17b-4318-4fc5-82b9-0a2b93191015-data-volume\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.305127 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305081 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32ffeeda-ad13-4932-ac0e-6fec92b98266-ca-trust-extracted\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.305127 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305103 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-certificates\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.305127 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305118 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-bound-sa-token\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.305275 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305144 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ba5f17b-4318-4fc5-82b9-0a2b93191015-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.305275 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305167 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ba5f17b-4318-4fc5-82b9-0a2b93191015-data-volume\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.305275 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305194 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fb9e2041-22c8-40cf-a9c1-8f0395adf788-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4\" (UID: \"fb9e2041-22c8-40cf-a9c1-8f0395adf788\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" May 26 11:29:56.305275 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305219 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-trusted-ca\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.305403 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305278 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hk5j\" (UniqueName: \"kubernetes.io/projected/6ba5f17b-4318-4fc5-82b9-0a2b93191015-kube-api-access-2hk5j\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.305575 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.305558 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ba5f17b-4318-4fc5-82b9-0a2b93191015-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.307134 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.307115 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ba5f17b-4318-4fc5-82b9-0a2b93191015-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.318707 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.318687 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hk5j\" (UniqueName: \"kubernetes.io/projected/6ba5f17b-4318-4fc5-82b9-0a2b93191015-kube-api-access-2hk5j\") pod \"insights-runtime-extractor-tzmnj\" (UID: \"6ba5f17b-4318-4fc5-82b9-0a2b93191015\") " pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.338278 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.338258 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tzmnj" May 26 11:29:56.406197 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406169 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-image-registry-private-configuration\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.406321 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406203 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-tls\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.406321 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406223 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qskzm\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-kube-api-access-qskzm\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.406321 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406258 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-installation-pull-secrets\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.406321 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406290 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32ffeeda-ad13-4932-ac0e-6fec92b98266-ca-trust-extracted\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.406321 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406319 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-certificates\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.406603 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406342 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-bound-sa-token\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.406603 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406376 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fb9e2041-22c8-40cf-a9c1-8f0395adf788-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4\" (UID: \"fb9e2041-22c8-40cf-a9c1-8f0395adf788\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" May 26 11:29:56.406603 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.406398 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-trusted-ca\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.407167 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.407115 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32ffeeda-ad13-4932-ac0e-6fec92b98266-ca-trust-extracted\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.407358 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.407333 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-certificates\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.407665 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.407643 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-trusted-ca\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.409033 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.409010 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-image-registry-private-configuration\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.409173 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.409151 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fb9e2041-22c8-40cf-a9c1-8f0395adf788-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4\" (UID: \"fb9e2041-22c8-40cf-a9c1-8f0395adf788\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" May 26 11:29:56.410754 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.410708 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-tls\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.411518 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.411495 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-installation-pull-secrets\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.413840 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.413808 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-bound-sa-token\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.414780 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.414761 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qskzm\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-kube-api-access-qskzm\") pod \"image-registry-78f74bb744-c5nxl\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:56.455268 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.455217 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" May 26 11:29:56.457966 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.457944 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tzmnj"] May 26 11:29:56.461193 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:29:56.461167 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba5f17b_4318_4fc5_82b9_0a2b93191015.slice/crio-44bf437f5c8d2a4f9c116ef00f6cf9963dec538832fc270bd356579379d61d70 WatchSource:0}: Error finding container 44bf437f5c8d2a4f9c116ef00f6cf9963dec538832fc270bd356579379d61d70: Status 404 returned error can't find the container with id 44bf437f5c8d2a4f9c116ef00f6cf9963dec538832fc270bd356579379d61d70 May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.508710 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-certificates\") pod \"32ffeeda-ad13-4932-ac0e-6fec92b98266\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.508775 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32ffeeda-ad13-4932-ac0e-6fec92b98266-ca-trust-extracted\") pod \"32ffeeda-ad13-4932-ac0e-6fec92b98266\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.508798 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-bound-sa-token\") pod \"32ffeeda-ad13-4932-ac0e-6fec92b98266\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.508823 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-tls\") pod \"32ffeeda-ad13-4932-ac0e-6fec92b98266\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.508853 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-image-registry-private-configuration\") pod \"32ffeeda-ad13-4932-ac0e-6fec92b98266\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.508884 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qskzm\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-kube-api-access-qskzm\") pod \"32ffeeda-ad13-4932-ac0e-6fec92b98266\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.508905 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-installation-pull-secrets\") pod \"32ffeeda-ad13-4932-ac0e-6fec92b98266\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.508943 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-trusted-ca\") pod \"32ffeeda-ad13-4932-ac0e-6fec92b98266\" (UID: \"32ffeeda-ad13-4932-ac0e-6fec92b98266\") " May 26 11:29:56.509769 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.509430 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "32ffeeda-ad13-4932-ac0e-6fec92b98266" (UID: "32ffeeda-ad13-4932-ac0e-6fec92b98266"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:29:56.510254 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.509784 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "32ffeeda-ad13-4932-ac0e-6fec92b98266" (UID: "32ffeeda-ad13-4932-ac0e-6fec92b98266"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:29:56.510254 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.509989 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32ffeeda-ad13-4932-ac0e-6fec92b98266-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "32ffeeda-ad13-4932-ac0e-6fec92b98266" (UID: "32ffeeda-ad13-4932-ac0e-6fec92b98266"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:29:56.513435 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.513380 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "32ffeeda-ad13-4932-ac0e-6fec92b98266" (UID: "32ffeeda-ad13-4932-ac0e-6fec92b98266"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:29:56.514435 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.514385 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "32ffeeda-ad13-4932-ac0e-6fec92b98266" (UID: "32ffeeda-ad13-4932-ac0e-6fec92b98266"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:29:56.514925 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.514883 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "32ffeeda-ad13-4932-ac0e-6fec92b98266" (UID: "32ffeeda-ad13-4932-ac0e-6fec92b98266"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:29:56.516755 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.516721 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-kube-api-access-qskzm" (OuterVolumeSpecName: "kube-api-access-qskzm") pod "32ffeeda-ad13-4932-ac0e-6fec92b98266" (UID: "32ffeeda-ad13-4932-ac0e-6fec92b98266"). InnerVolumeSpecName "kube-api-access-qskzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:29:56.523290 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.523253 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "32ffeeda-ad13-4932-ac0e-6fec92b98266" (UID: "32ffeeda-ad13-4932-ac0e-6fec92b98266"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:29:56.593090 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.593023 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4"] May 26 11:29:56.595570 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:29:56.595546 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9e2041_22c8_40cf_a9c1_8f0395adf788.slice/crio-f6e3167a0bea902e411ddb89d4b62cb70a87c3443267341d5c3ba8b1f48a8ac0 WatchSource:0}: Error finding container f6e3167a0bea902e411ddb89d4b62cb70a87c3443267341d5c3ba8b1f48a8ac0: Status 404 returned error can't find the container with id f6e3167a0bea902e411ddb89d4b62cb70a87c3443267341d5c3ba8b1f48a8ac0 May 26 11:29:56.609608 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.609584 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:29:56.609608 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.609606 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-image-registry-private-configuration\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:29:56.609717 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.609616 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qskzm\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-kube-api-access-qskzm\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:29:56.609717 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.609626 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32ffeeda-ad13-4932-ac0e-6fec92b98266-installation-pull-secrets\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:29:56.609717 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.609637 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-trusted-ca\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:29:56.609717 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.609650 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32ffeeda-ad13-4932-ac0e-6fec92b98266-registry-certificates\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:29:56.609717 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.609662 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32ffeeda-ad13-4932-ac0e-6fec92b98266-ca-trust-extracted\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:29:56.609717 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:56.609671 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32ffeeda-ad13-4932-ac0e-6fec92b98266-bound-sa-token\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:29:57.305669 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:57.305638 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" event={"ID":"fb9e2041-22c8-40cf-a9c1-8f0395adf788","Type":"ContainerStarted","Data":"f6e3167a0bea902e411ddb89d4b62cb70a87c3443267341d5c3ba8b1f48a8ac0"} May 26 11:29:57.307403 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:57.307383 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f74bb744-c5nxl" May 26 11:29:57.307538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:57.307380 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tzmnj" event={"ID":"6ba5f17b-4318-4fc5-82b9-0a2b93191015","Type":"ContainerStarted","Data":"ca8f1e03562eda360b73647d53da2009cf62c3d27336c9ad67c8a14a02a969a4"} May 26 11:29:57.307538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:57.307510 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tzmnj" event={"ID":"6ba5f17b-4318-4fc5-82b9-0a2b93191015","Type":"ContainerStarted","Data":"c6503e94cd386723647b3da096e8b3a8b2c26b29f7d45bde876257be7684d8b6"} May 26 11:29:57.307538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:57.307532 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tzmnj" event={"ID":"6ba5f17b-4318-4fc5-82b9-0a2b93191015","Type":"ContainerStarted","Data":"44bf437f5c8d2a4f9c116ef00f6cf9963dec538832fc270bd356579379d61d70"} May 26 11:29:57.351404 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:57.351378 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f74bb744-c5nxl"] May 26 11:29:57.354884 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:57.354861 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78f74bb744-c5nxl"] May 26 11:29:58.311770 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:58.311732 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" event={"ID":"fb9e2041-22c8-40cf-a9c1-8f0395adf788","Type":"ContainerStarted","Data":"82cf319737cca24c6ec381088dab9eaa2cab3ba34f0fd9231287b87286e47a5e"} May 26 11:29:58.312204 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:58.311934 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" May 26 11:29:58.318195 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:58.318169 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" May 26 11:29:58.330882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:58.330839 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4" podStartSLOduration=1.293593952 podStartE2EDuration="2.330825894s" podCreationTimestamp="2026-05-26 11:29:56 +0000 UTC" firstStartedPulling="2026-05-26 11:29:56.597389767 +0000 UTC m=+152.293377781" lastFinishedPulling="2026-05-26 11:29:57.634621696 +0000 UTC m=+153.330609723" observedRunningTime="2026-05-26 11:29:58.329533536 +0000 UTC m=+154.025521571" watchObservedRunningTime="2026-05-26 11:29:58.330825894 +0000 UTC m=+154.026813929" May 26 11:29:58.842791 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:58.842761 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32ffeeda-ad13-4932-ac0e-6fec92b98266" path="/var/lib/kubelet/pods/32ffeeda-ad13-4932-ac0e-6fec92b98266/volumes" May 26 11:29:59.316086 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.316049 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tzmnj" event={"ID":"6ba5f17b-4318-4fc5-82b9-0a2b93191015","Type":"ContainerStarted","Data":"ed79ff8a0684676d9309d7dbb1172419f741b14c6f8e596fc685be048e55afc1"} May 26 11:29:59.333210 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.333168 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tzmnj" podStartSLOduration=1.225642876 podStartE2EDuration="3.333157729s" podCreationTimestamp="2026-05-26 11:29:56 +0000 UTC" firstStartedPulling="2026-05-26 11:29:56.544110361 +0000 UTC m=+152.240098374" lastFinishedPulling="2026-05-26 11:29:58.651625211 +0000 UTC m=+154.347613227" observedRunningTime="2026-05-26 11:29:59.331891119 +0000 UTC m=+155.027879153" watchObservedRunningTime="2026-05-26 11:29:59.333157729 +0000 UTC m=+155.029145763" May 26 11:29:59.437698 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.437672 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d"] May 26 11:29:59.440746 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.440732 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.444963 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.444945 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 26 11:29:59.445120 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.445020 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 11:29:59.445120 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.445075 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 11:29:59.445340 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.445326 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 26 11:29:59.445423 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.445345 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tt9ml\"" May 26 11:29:59.445561 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.445549 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 11:29:59.455890 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.455871 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d"] May 26 11:29:59.530998 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.530950 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptwwc\" (UniqueName: \"kubernetes.io/projected/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-kube-api-access-ptwwc\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.531179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.531009 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.531179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.531054 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.531179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.531091 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.631537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.631450 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwwc\" (UniqueName: \"kubernetes.io/projected/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-kube-api-access-ptwwc\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.631537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.631501 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.631537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.631530 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.631730 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.631554 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.631730 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:59.631656 2551 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 26 11:29:59.631730 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:29:59.631727 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-tls podName:1d872ce9-20ef-4bae-8870-4fb423c5e2c3 nodeName:}" failed. No retries permitted until 2026-05-26 11:30:00.131705949 +0000 UTC m=+155.827693976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-zwf8d" (UID: "1d872ce9-20ef-4bae-8870-4fb423c5e2c3") : secret "prometheus-operator-tls" not found May 26 11:29:59.632138 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.632121 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.633839 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.633822 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:29:59.639350 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:29:59.639329 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptwwc\" (UniqueName: \"kubernetes.io/projected/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-kube-api-access-ptwwc\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:30:00.135822 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:00.135784 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:30:00.138086 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:00.138064 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d872ce9-20ef-4bae-8870-4fb423c5e2c3-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zwf8d\" (UID: \"1d872ce9-20ef-4bae-8870-4fb423c5e2c3\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:30:00.349098 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:00.349071 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" May 26 11:30:00.466357 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:00.466334 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d"] May 26 11:30:00.468712 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:30:00.468683 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d872ce9_20ef_4bae_8870_4fb423c5e2c3.slice/crio-82446c2ca8be8e50edafd1417fe0c75b7ae3850f86f31463c790ae70ab7f7d63 WatchSource:0}: Error finding container 82446c2ca8be8e50edafd1417fe0c75b7ae3850f86f31463c790ae70ab7f7d63: Status 404 returned error can't find the container with id 82446c2ca8be8e50edafd1417fe0c75b7ae3850f86f31463c790ae70ab7f7d63 May 26 11:30:01.233498 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:01.233448 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5hw5n" podUID="8770d97f-a72b-484e-adad-4d6aaf94ccf5" May 26 11:30:01.239655 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:01.239625 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-x7kbt" podUID="74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d" May 26 11:30:01.321829 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:01.321803 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5hw5n" May 26 11:30:01.321993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:01.321793 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" event={"ID":"1d872ce9-20ef-4bae-8870-4fb423c5e2c3","Type":"ContainerStarted","Data":"82446c2ca8be8e50edafd1417fe0c75b7ae3850f86f31463c790ae70ab7f7d63"} May 26 11:30:02.325785 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:02.325747 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" event={"ID":"1d872ce9-20ef-4bae-8870-4fb423c5e2c3","Type":"ContainerStarted","Data":"35f1a0ef1a43ade2ef52fbba2c841fbdad4b4afe6c789f4b0b7bc26ab79aa631"} May 26 11:30:02.325785 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:02.325788 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" event={"ID":"1d872ce9-20ef-4bae-8870-4fb423c5e2c3","Type":"ContainerStarted","Data":"f9c1080daaee15795d88bd0bfb2725659ee90507a979a28d50f65e2f7ed9f2bc"} May 26 11:30:02.341411 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:02.341368 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zwf8d" podStartSLOduration=1.966641916 podStartE2EDuration="3.341354273s" podCreationTimestamp="2026-05-26 11:29:59 +0000 UTC" firstStartedPulling="2026-05-26 11:30:00.470583648 +0000 UTC m=+156.166571662" lastFinishedPulling="2026-05-26 11:30:01.845295997 +0000 UTC m=+157.541284019" observedRunningTime="2026-05-26 11:30:02.340723326 +0000 UTC m=+158.036711360" watchObservedRunningTime="2026-05-26 11:30:02.341354273 +0000 UTC m=+158.037342309" May 26 11:30:02.853850 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:02.853810 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g4m6v" podUID="acb515e4-f4ef-437f-91bd-dadc3359247d" May 26 11:30:03.768910 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.768879 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx"] May 26 11:30:03.772045 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.772029 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.774629 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.774604 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nxtwj\"" May 26 11:30:03.774750 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.774630 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 26 11:30:03.774750 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.774604 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 26 11:30:03.781919 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.781897 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx"] May 26 11:30:03.794407 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.794374 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w"] May 26 11:30:03.797316 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.797281 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.799441 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.799425 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 26 11:30:03.799686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.799669 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 26 11:30:03.799925 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.799909 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 26 11:30:03.800087 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.800075 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gfq86\"" May 26 11:30:03.805351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.805332 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8drmz"] May 26 11:30:03.808330 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.808311 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w"] May 26 11:30:03.808330 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.808325 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.810706 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.810687 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 11:30:03.810804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.810759 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k2glr\"" May 26 11:30:03.810804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.810738 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 11:30:03.810914 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.810762 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 11:30:03.864582 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864555 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.864712 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864589 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-tls\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.864712 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864641 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.864712 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864666 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-root\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.864802 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864713 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-accelerators-collector-config\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.864802 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864743 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c143aa33-9e54-479b-95a5-980dab1fd958-metrics-client-ca\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.864802 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864762 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.864802 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864780 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.864802 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864798 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-textfile\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.864985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864820 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-wtmp\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.864985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864838 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.864985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864855 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.864985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864887 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.864985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864903 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzlj\" (UniqueName: \"kubernetes.io/projected/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-api-access-jzzlj\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.864985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864932 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-sys\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.864985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864950 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59k8\" (UniqueName: \"kubernetes.io/projected/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-kube-api-access-b59k8\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.864985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.864982 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.865226 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.865006 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.865226 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.865026 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pqm9\" (UniqueName: \"kubernetes.io/projected/c143aa33-9e54-479b-95a5-980dab1fd958-kube-api-access-4pqm9\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.965911 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.965881 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-sys\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966031 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.965916 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b59k8\" (UniqueName: \"kubernetes.io/projected/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-kube-api-access-b59k8\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.966031 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.965976 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.966031 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966010 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.966192 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966054 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pqm9\" (UniqueName: \"kubernetes.io/projected/c143aa33-9e54-479b-95a5-980dab1fd958-kube-api-access-4pqm9\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966192 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966088 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.966192 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966114 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-sys\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966192 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966118 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-tls\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966192 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966162 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.966192 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966191 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-root\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966484 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:03.966198 2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 26 11:30:03.966484 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966223 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-accelerators-collector-config\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966484 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:03.966258 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-tls podName:c143aa33-9e54-479b-95a5-980dab1fd958 nodeName:}" failed. No retries permitted until 2026-05-26 11:30:04.466237957 +0000 UTC m=+160.162225969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-tls") pod "node-exporter-8drmz" (UID: "c143aa33-9e54-479b-95a5-980dab1fd958") : secret "node-exporter-tls" not found May 26 11:30:03.966484 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966265 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-root\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966484 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966277 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c143aa33-9e54-479b-95a5-980dab1fd958-metrics-client-ca\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966484 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966305 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.966796 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966533 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.966851 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966800 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.966851 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966824 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-accelerators-collector-config\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.966851 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966840 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-textfile\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.967005 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966888 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-wtmp\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.967005 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966920 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.967005 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966949 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.967005 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966918 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.967189 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.966996 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.967189 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.967023 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-wtmp\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.967189 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.967054 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzlj\" (UniqueName: \"kubernetes.io/projected/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-api-access-jzzlj\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.967189 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.967110 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-textfile\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.967189 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.967121 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c143aa33-9e54-479b-95a5-980dab1fd958-metrics-client-ca\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.967189 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:03.967178 2551 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 26 11:30:03.967499 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:03.967281 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-tls podName:30ea67f6-c95b-4c20-88d2-d9a8303d1b4d nodeName:}" failed. No retries permitted until 2026-05-26 11:30:04.467264702 +0000 UTC m=+160.163252722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-7jw5w" (UID: "30ea67f6-c95b-4c20-88d2-d9a8303d1b4d") : secret "kube-state-metrics-tls" not found May 26 11:30:03.967787 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.967765 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.967869 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.967814 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.968906 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.968882 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.969101 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.969082 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:03.969478 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.969433 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.969567 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.969547 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.974056 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.974030 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pqm9\" (UniqueName: \"kubernetes.io/projected/c143aa33-9e54-479b-95a5-980dab1fd958-kube-api-access-4pqm9\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:03.974134 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.974123 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59k8\" (UniqueName: \"kubernetes.io/projected/c8cd3d1b-0c0a-47c0-bd39-7009fa162d09-kube-api-access-b59k8\") pod \"openshift-state-metrics-9c959559f-k8qbx\" (UID: \"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:03.974211 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:03.974195 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzlj\" (UniqueName: \"kubernetes.io/projected/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-api-access-jzzlj\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:04.081023 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.080952 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" May 26 11:30:04.196795 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.196664 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx"] May 26 11:30:04.199161 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:30:04.199127 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cd3d1b_0c0a_47c0_bd39_7009fa162d09.slice/crio-067c4390e9337c6fce5a567c67dff57ca1488a116f46ef817be1310b89dc9948 WatchSource:0}: Error finding container 067c4390e9337c6fce5a567c67dff57ca1488a116f46ef817be1310b89dc9948: Status 404 returned error can't find the container with id 067c4390e9337c6fce5a567c67dff57ca1488a116f46ef817be1310b89dc9948 May 26 11:30:04.337899 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.337823 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" event={"ID":"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09","Type":"ContainerStarted","Data":"e33814cf1bfc10f3b2592364c90b14fd0dc28a40db55758a1e33f11d19447f9f"} May 26 11:30:04.337899 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.337861 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" event={"ID":"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09","Type":"ContainerStarted","Data":"31b9e88ea673c89065e69393c75c073c99d73d45c680bb0679f85b550fff859d"} May 26 11:30:04.337899 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.337872 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" event={"ID":"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09","Type":"ContainerStarted","Data":"067c4390e9337c6fce5a567c67dff57ca1488a116f46ef817be1310b89dc9948"} May 26 11:30:04.472064 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.472025 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:04.472335 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.472155 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-tls\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:04.474310 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.474289 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c143aa33-9e54-479b-95a5-980dab1fd958-node-exporter-tls\") pod \"node-exporter-8drmz\" (UID: \"c143aa33-9e54-479b-95a5-980dab1fd958\") " pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:04.474387 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.474344 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30ea67f6-c95b-4c20-88d2-d9a8303d1b4d-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-7jw5w\" (UID: \"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:04.705557 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.705490 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" May 26 11:30:04.718202 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.718178 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8drmz" May 26 11:30:04.725568 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:30:04.725541 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc143aa33_9e54_479b_95a5_980dab1fd958.slice/crio-94e737de1695682530b7ad5ef13903d9004949672158fc11e91e54d3b444e30b WatchSource:0}: Error finding container 94e737de1695682530b7ad5ef13903d9004949672158fc11e91e54d3b444e30b: Status 404 returned error can't find the container with id 94e737de1695682530b7ad5ef13903d9004949672158fc11e91e54d3b444e30b May 26 11:30:04.844156 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:30:04.844123 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ea67f6_c95b_4c20_88d2_d9a8303d1b4d.slice/crio-a2b8542ceec4feb642f21580f1be958c3da284f41c71c5c4f5ef4f96a5946b81 WatchSource:0}: Error finding container a2b8542ceec4feb642f21580f1be958c3da284f41c71c5c4f5ef4f96a5946b81: Status 404 returned error can't find the container with id a2b8542ceec4feb642f21580f1be958c3da284f41c71c5c4f5ef4f96a5946b81 May 26 11:30:04.844569 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.844172 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w"] May 26 11:30:04.853559 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.853539 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:30:04.857532 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.857511 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.859883 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.859852 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 26 11:30:04.859992 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.859947 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 26 11:30:04.860151 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.860007 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 26 11:30:04.860220 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.860146 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 26 11:30:04.860306 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.860248 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 26 11:30:04.860306 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.860280 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 26 11:30:04.860420 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.860309 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 26 11:30:04.860420 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.860399 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bwlwz\"" May 26 11:30:04.860898 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.860814 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 26 11:30:04.861332 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.861092 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 26 11:30:04.872206 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.872179 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:30:04.875928 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.875906 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876034 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.875997 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876097 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876054 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876153 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876086 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876300 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876141 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876300 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876178 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-web-config\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876300 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876224 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876300 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876292 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876321 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876377 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876416 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876480 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6lv\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-kube-api-access-vp6lv\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.876537 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.876505 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-config-out\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.978692 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.978664 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.978983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.978710 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.978983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.978770 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.978983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.978808 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.978983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.978852 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6lv\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-kube-api-access-vp6lv\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.978983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.978879 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-config-out\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.978983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.978911 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.979318 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.979275 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.979374 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.979335 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.979374 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.979368 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.979489 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.979407 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.979489 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.979435 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-web-config\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.979592 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.979485 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.979641 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:04.979590 2551 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 26 11:30:04.979687 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:04.979655 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle podName:7e670243-60fb-4282-9e68-51037ce39880 nodeName:}" failed. No retries permitted until 2026-05-26 11:30:05.479633734 +0000 UTC m=+161.175621747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7e670243-60fb-4282-9e68-51037ce39880") : configmap references non-existent config key: ca-bundle.crt May 26 11:30:04.979687 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:30:04.979677 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls podName:7e670243-60fb-4282-9e68-51037ce39880 nodeName:}" failed. No retries permitted until 2026-05-26 11:30:05.47966678 +0000 UTC m=+161.175654794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7e670243-60fb-4282-9e68-51037ce39880") : secret "alertmanager-main-tls" not found May 26 11:30:04.979925 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.979858 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.980578 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.980537 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.982246 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.982219 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-config-out\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.982846 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.982721 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.983215 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.983170 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.983762 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.983721 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.984254 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.984116 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.984254 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.984216 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.984388 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.984287 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.987739 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.987695 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-web-config\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:04.987834 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:04.987782 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6lv\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-kube-api-access-vp6lv\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:05.342523 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:05.342487 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8drmz" event={"ID":"c143aa33-9e54-479b-95a5-980dab1fd958","Type":"ContainerStarted","Data":"94e737de1695682530b7ad5ef13903d9004949672158fc11e91e54d3b444e30b"} May 26 11:30:05.345661 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:05.345631 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" event={"ID":"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d","Type":"ContainerStarted","Data":"a2b8542ceec4feb642f21580f1be958c3da284f41c71c5c4f5ef4f96a5946b81"} May 26 11:30:05.484382 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:05.484345 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:05.484592 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:05.484393 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:05.485312 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:05.485283 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:05.487450 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:05.487413 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:05.770222 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:05.770191 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 11:30:05.840199 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:05.840173 2551 scope.go:117] "RemoveContainer" containerID="ce29f13a1403e6c2b9b89a9eb32fa271d03f5c628c4d2629b79dec1abc722aa7" May 26 11:30:06.191822 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.191481 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:30:06.191822 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.191554 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:30:06.194273 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.194230 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8770d97f-a72b-484e-adad-4d6aaf94ccf5-metrics-tls\") pod \"dns-default-5hw5n\" (UID: \"8770d97f-a72b-484e-adad-4d6aaf94ccf5\") " pod="openshift-dns/dns-default-5hw5n" May 26 11:30:06.194449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.194429 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d-cert\") pod \"ingress-canary-x7kbt\" (UID: \"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d\") " pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:30:06.272977 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.272934 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:30:06.277968 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:30:06.277939 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e670243_60fb_4282_9e68_51037ce39880.slice/crio-444351983b9cfa7303200daf3faf13ebdda284501091b948c601c79871385e91 WatchSource:0}: Error finding container 444351983b9cfa7303200daf3faf13ebdda284501091b948c601c79871385e91: Status 404 returned error can't find the container with id 444351983b9cfa7303200daf3faf13ebdda284501091b948c601c79871385e91 May 26 11:30:06.358005 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.357982 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:30:06.358132 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.358078 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" event={"ID":"75997849-b606-4fd2-9aa5-37e7dee71456","Type":"ContainerStarted","Data":"060e29643fbc88cf41cf02e53da061bbfb178edc980e411344cc28dfeff42956"} May 26 11:30:06.358498 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.358441 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:30:06.361678 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.361361 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8drmz" event={"ID":"c143aa33-9e54-479b-95a5-980dab1fd958","Type":"ContainerStarted","Data":"fe15fc16a085483b86351ea5c039b68403843424d5fa309901bcb20fdf07fb40"} May 26 11:30:06.363147 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.363063 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerStarted","Data":"444351983b9cfa7303200daf3faf13ebdda284501091b948c601c79871385e91"} May 26 11:30:06.366407 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.366259 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" event={"ID":"c8cd3d1b-0c0a-47c0-bd39-7009fa162d09","Type":"ContainerStarted","Data":"ecd8e0e1f6869390aa945ae1c18a012925273671f04ed8f2c036410cefe5db5b"} May 26 11:30:06.369930 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.369868 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" event={"ID":"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d","Type":"ContainerStarted","Data":"b1167c572f792efda6bebe01cd311a8d2f4bbdfa68cfcf71d5c9c1e989a55293"} May 26 11:30:06.369930 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.369897 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" event={"ID":"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d","Type":"ContainerStarted","Data":"d56f10a0c58d622a9e1752d0c0c5cebbb1543e0ea1f4ca061e92d869a75fcf6f"} May 26 11:30:06.376723 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.376665 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" podStartSLOduration=43.712727406 podStartE2EDuration="45.376650042s" podCreationTimestamp="2026-05-26 11:29:21 +0000 UTC" firstStartedPulling="2026-05-26 11:29:21.908126434 +0000 UTC m=+117.604114460" lastFinishedPulling="2026-05-26 11:29:23.57204908 +0000 UTC m=+119.268037096" observedRunningTime="2026-05-26 11:30:06.375163905 +0000 UTC m=+162.071151941" watchObservedRunningTime="2026-05-26 11:30:06.376650042 +0000 UTC m=+162.072638078" May 26 11:30:06.411110 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.411065 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-k8qbx" podStartSLOduration=2.444816012 podStartE2EDuration="3.411049676s" podCreationTimestamp="2026-05-26 11:30:03 +0000 UTC" firstStartedPulling="2026-05-26 11:30:04.313795019 +0000 UTC m=+160.009783031" lastFinishedPulling="2026-05-26 11:30:05.280028674 +0000 UTC m=+160.976016695" observedRunningTime="2026-05-26 11:30:06.409633713 +0000 UTC m=+162.105621759" watchObservedRunningTime="2026-05-26 11:30:06.411049676 +0000 UTC m=+162.107037710" May 26 11:30:06.425437 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.425411 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqkc6\"" May 26 11:30:06.433559 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.433537 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5hw5n" May 26 11:30:06.558934 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.558910 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5hw5n"] May 26 11:30:06.561737 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:30:06.561704 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8770d97f_a72b_484e_adad_4d6aaf94ccf5.slice/crio-6f1e690d7c22ba8fcb4dfc3d650949f8e402f71cde6fb586969ced6c17049680 WatchSource:0}: Error finding container 6f1e690d7c22ba8fcb4dfc3d650949f8e402f71cde6fb586969ced6c17049680: Status 404 returned error can't find the container with id 6f1e690d7c22ba8fcb4dfc3d650949f8e402f71cde6fb586969ced6c17049680 May 26 11:30:06.696339 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:06.696271 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-c82hq" May 26 11:30:07.374995 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:07.374910 2551 generic.go:358] "Generic (PLEG): container finished" podID="c143aa33-9e54-479b-95a5-980dab1fd958" containerID="fe15fc16a085483b86351ea5c039b68403843424d5fa309901bcb20fdf07fb40" exitCode=0 May 26 11:30:07.374995 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:07.374982 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8drmz" event={"ID":"c143aa33-9e54-479b-95a5-980dab1fd958","Type":"ContainerDied","Data":"fe15fc16a085483b86351ea5c039b68403843424d5fa309901bcb20fdf07fb40"} May 26 11:30:07.376301 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:07.376272 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5hw5n" event={"ID":"8770d97f-a72b-484e-adad-4d6aaf94ccf5","Type":"ContainerStarted","Data":"6f1e690d7c22ba8fcb4dfc3d650949f8e402f71cde6fb586969ced6c17049680"} May 26 11:30:07.378869 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:07.378743 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" event={"ID":"30ea67f6-c95b-4c20-88d2-d9a8303d1b4d","Type":"ContainerStarted","Data":"694f91e632d4f5ee96bd9d7ea06955b36c98525487fdfb3ef67ccf7d59e89cc6"} May 26 11:30:07.409920 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:07.409853 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7jw5w" podStartSLOduration=3.1241779100000002 podStartE2EDuration="4.409837715s" podCreationTimestamp="2026-05-26 11:30:03 +0000 UTC" firstStartedPulling="2026-05-26 11:30:04.846129228 +0000 UTC m=+160.542117242" lastFinishedPulling="2026-05-26 11:30:06.131789028 +0000 UTC m=+161.827777047" observedRunningTime="2026-05-26 11:30:07.408724613 +0000 UTC m=+163.104712680" watchObservedRunningTime="2026-05-26 11:30:07.409837715 +0000 UTC m=+163.105825750" May 26 11:30:08.383844 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.383803 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8drmz" event={"ID":"c143aa33-9e54-479b-95a5-980dab1fd958","Type":"ContainerStarted","Data":"0236f60918ee534efa76f16e4c01ac3d3269301496cb852843c736011ef3a2aa"} May 26 11:30:08.384263 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.383849 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8drmz" event={"ID":"c143aa33-9e54-479b-95a5-980dab1fd958","Type":"ContainerStarted","Data":"411d088c79f1765a967e66a04a1e62c93ba192b7e80ae95a5a932e02d4ea6133"} May 26 11:30:08.385086 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.385063 2551 generic.go:358] "Generic (PLEG): container finished" podID="7e670243-60fb-4282-9e68-51037ce39880" containerID="460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238" exitCode=0 May 26 11:30:08.385186 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.385136 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerDied","Data":"460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238"} May 26 11:30:08.386553 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.386515 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5hw5n" event={"ID":"8770d97f-a72b-484e-adad-4d6aaf94ccf5","Type":"ContainerStarted","Data":"16a29f08b5df24397e787e065889dee9cad46ea1cdf4a3aa0d4173cd4c7f87da"} May 26 11:30:08.386553 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.386547 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5hw5n" event={"ID":"8770d97f-a72b-484e-adad-4d6aaf94ccf5","Type":"ContainerStarted","Data":"47fcbb8a8a7584e9826089ae5041c7f839e1018b18354c488742186721c006d8"} May 26 11:30:08.386756 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.386712 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5hw5n" May 26 11:30:08.401745 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.401709 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8drmz" podStartSLOduration=4.001746027 podStartE2EDuration="5.401699017s" podCreationTimestamp="2026-05-26 11:30:03 +0000 UTC" firstStartedPulling="2026-05-26 11:30:04.727257326 +0000 UTC m=+160.423245343" lastFinishedPulling="2026-05-26 11:30:06.127210313 +0000 UTC m=+161.823198333" observedRunningTime="2026-05-26 11:30:08.400591122 +0000 UTC m=+164.096579169" watchObservedRunningTime="2026-05-26 11:30:08.401699017 +0000 UTC m=+164.097687051" May 26 11:30:08.464386 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:08.464335 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-5hw5n" podStartSLOduration=129.060107372 podStartE2EDuration="2m10.464319803s" podCreationTimestamp="2026-05-26 11:27:58 +0000 UTC" firstStartedPulling="2026-05-26 11:30:06.563730747 +0000 UTC m=+162.259718761" lastFinishedPulling="2026-05-26 11:30:07.967943177 +0000 UTC m=+163.663931192" observedRunningTime="2026-05-26 11:30:08.46321871 +0000 UTC m=+164.159206769" watchObservedRunningTime="2026-05-26 11:30:08.464319803 +0000 UTC m=+164.160307838" May 26 11:30:09.955184 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.955155 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:30:09.961337 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.961315 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.963987 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.964196 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.964340 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.964699 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.964874 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4h8z6\"" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.965020 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5tkgmqahgefc2\"" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.965159 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.965302 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 11:30:09.965748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.965636 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 11:30:09.967221 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.966934 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 11:30:09.967221 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.966953 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 11:30:09.967221 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.966977 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 11:30:09.967221 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.967091 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 11:30:09.967221 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.967173 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 11:30:09.968447 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.968427 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 11:30:09.975286 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:09.975269 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:30:10.031196 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031168 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031313 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031294 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031389 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031376 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-config\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031443 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031407 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031523 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031510 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031576 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031545 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031630 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031593 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031688 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031621 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031688 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031672 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031809 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031793 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031866 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031821 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031920 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031883 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.031980 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031927 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5qc7\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-kube-api-access-m5qc7\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.032035 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.031985 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.032088 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.032018 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.032088 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.032060 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.032191 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.032154 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.032241 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.032200 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133518 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133490 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133622 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133527 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133622 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133550 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133622 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133572 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5qc7\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-kube-api-access-m5qc7\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133622 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133587 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133622 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133607 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133782 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133624 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133782 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133661 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133782 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133676 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133782 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133704 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133782 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133721 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133782 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133746 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-config\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133782 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133762 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.133782 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133781 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.134000 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133803 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.134000 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133817 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.134000 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133834 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.134000 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.133850 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.134919 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.134888 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.137163 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.135943 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.137163 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.136815 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.137163 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.137071 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.138115 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.137515 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.138115 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.137961 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.138278 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.138211 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.138657 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.138636 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.138978 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.138955 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.140087 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.140067 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.140581 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.140534 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-config\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.140581 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.140546 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.140831 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.140806 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.141373 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.141341 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.141491 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.141404 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.142206 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.142152 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.142520 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.142434 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.144941 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.144920 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5qc7\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-kube-api-access-m5qc7\") pod \"prometheus-k8s-0\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.284989 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.284953 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:10.399866 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.399831 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerStarted","Data":"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620"} May 26 11:30:10.399866 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.399866 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerStarted","Data":"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651"} May 26 11:30:10.400059 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.399876 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerStarted","Data":"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77"} May 26 11:30:10.400059 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.399885 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerStarted","Data":"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784"} May 26 11:30:10.400059 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.399897 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerStarted","Data":"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9"} May 26 11:30:10.431362 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:10.431334 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:30:10.433310 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:30:10.433278 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3f72f2_997a_4948_a966_033d0ff718a4.slice/crio-f02019ed96b6e981cf7c94979371605de629b7d1cad46f7a9aa00a9d0dc7905f WatchSource:0}: Error finding container f02019ed96b6e981cf7c94979371605de629b7d1cad46f7a9aa00a9d0dc7905f: Status 404 returned error can't find the container with id f02019ed96b6e981cf7c94979371605de629b7d1cad46f7a9aa00a9d0dc7905f May 26 11:30:11.404826 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:11.404793 2551 generic.go:358] "Generic (PLEG): container finished" podID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" exitCode=0 May 26 11:30:11.405272 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:11.404887 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerDied","Data":"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0"} May 26 11:30:11.405272 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:11.404928 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerStarted","Data":"f02019ed96b6e981cf7c94979371605de629b7d1cad46f7a9aa00a9d0dc7905f"} May 26 11:30:11.407649 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:11.407625 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerStarted","Data":"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3"} May 26 11:30:11.456786 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:11.456739 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.880151569 podStartE2EDuration="7.45672704s" podCreationTimestamp="2026-05-26 11:30:04 +0000 UTC" firstStartedPulling="2026-05-26 11:30:06.28019515 +0000 UTC m=+161.976183167" lastFinishedPulling="2026-05-26 11:30:10.856770619 +0000 UTC m=+166.552758638" observedRunningTime="2026-05-26 11:30:11.454962223 +0000 UTC m=+167.150950257" watchObservedRunningTime="2026-05-26 11:30:11.45672704 +0000 UTC m=+167.152715074" May 26 11:30:13.839328 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:13.839279 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:30:13.842726 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:13.842706 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gmhr4\"" May 26 11:30:13.850105 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:13.850084 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7kbt" May 26 11:30:14.420793 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:14.420633 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerStarted","Data":"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2"} May 26 11:30:14.448463 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:14.448422 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7kbt"] May 26 11:30:14.451690 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:30:14.451663 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fb53b6_5b7a_4b1d_a25f_8ffc33071e7d.slice/crio-3ae352fca5ced0a2114b1c7ee33281ba557bafca976f13c312a292dc7c40cf9f WatchSource:0}: Error finding container 3ae352fca5ced0a2114b1c7ee33281ba557bafca976f13c312a292dc7c40cf9f: Status 404 returned error can't find the container with id 3ae352fca5ced0a2114b1c7ee33281ba557bafca976f13c312a292dc7c40cf9f May 26 11:30:15.432538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:15.432499 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerStarted","Data":"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f"} May 26 11:30:15.434107 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:15.434079 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7kbt" event={"ID":"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d","Type":"ContainerStarted","Data":"3ae352fca5ced0a2114b1c7ee33281ba557bafca976f13c312a292dc7c40cf9f"} May 26 11:30:17.443410 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:17.443379 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerStarted","Data":"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849"} May 26 11:30:17.443410 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:17.443412 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerStarted","Data":"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9"} May 26 11:30:17.443948 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:17.443422 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerStarted","Data":"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1"} May 26 11:30:17.443948 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:17.443430 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerStarted","Data":"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24"} May 26 11:30:17.444739 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:17.444714 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7kbt" event={"ID":"74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d","Type":"ContainerStarted","Data":"55519974bcee2f24cc0f75a58965acd673b1a010ea363b8c4f97414025541abb"} May 26 11:30:17.470787 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:17.470737 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.304157853 podStartE2EDuration="8.470722628s" podCreationTimestamp="2026-05-26 11:30:09 +0000 UTC" firstStartedPulling="2026-05-26 11:30:11.406169261 +0000 UTC m=+167.102157287" lastFinishedPulling="2026-05-26 11:30:16.572734036 +0000 UTC m=+172.268722062" observedRunningTime="2026-05-26 11:30:17.469093982 +0000 UTC m=+173.165082018" watchObservedRunningTime="2026-05-26 11:30:17.470722628 +0000 UTC m=+173.166710663" May 26 11:30:17.484676 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:17.484633 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x7kbt" podStartSLOduration=137.366990767 podStartE2EDuration="2m19.484616904s" podCreationTimestamp="2026-05-26 11:27:58 +0000 UTC" firstStartedPulling="2026-05-26 11:30:14.453483151 +0000 UTC m=+170.149471165" lastFinishedPulling="2026-05-26 11:30:16.57110929 +0000 UTC m=+172.267097302" observedRunningTime="2026-05-26 11:30:17.483110816 +0000 UTC m=+173.179098848" watchObservedRunningTime="2026-05-26 11:30:17.484616904 +0000 UTC m=+173.180604991" May 26 11:30:18.392074 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:18.392047 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5hw5n" May 26 11:30:18.839687 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:18.839656 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:30:20.285316 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:20.285284 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:30:40.517615 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:40.517553 2551 generic.go:358] "Generic (PLEG): container finished" podID="2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7" containerID="c54af7ea8996d6339dcac9e6245386f631778f1e84d24661eec76bd6a6bedeb4" exitCode=0 May 26 11:30:40.517989 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:40.517626 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-688p8" event={"ID":"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7","Type":"ContainerDied","Data":"c54af7ea8996d6339dcac9e6245386f631778f1e84d24661eec76bd6a6bedeb4"} May 26 11:30:40.517989 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:40.517959 2551 scope.go:117] "RemoveContainer" containerID="c54af7ea8996d6339dcac9e6245386f631778f1e84d24661eec76bd6a6bedeb4" May 26 11:30:40.519025 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:40.518995 2551 generic.go:358] "Generic (PLEG): container finished" podID="6be524d7-956b-4fbe-8dfd-16ad55714599" containerID="e911d0c1f0c50e67c571afe97c91be04533657b84b358dc135d76dda5f28a8c6" exitCode=0 May 26 11:30:40.519129 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:40.519023 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" event={"ID":"6be524d7-956b-4fbe-8dfd-16ad55714599","Type":"ContainerDied","Data":"e911d0c1f0c50e67c571afe97c91be04533657b84b358dc135d76dda5f28a8c6"} May 26 11:30:40.519290 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:40.519273 2551 scope.go:117] "RemoveContainer" containerID="e911d0c1f0c50e67c571afe97c91be04533657b84b358dc135d76dda5f28a8c6" May 26 11:30:41.523825 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:41.523794 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sqzrg" event={"ID":"6be524d7-956b-4fbe-8dfd-16ad55714599","Type":"ContainerStarted","Data":"1a15ce8f8ae6fb45b34856ae1dcaf4f3df8b4a19725fe39983d582efd8987118"} May 26 11:30:41.525329 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:30:41.525306 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-688p8" event={"ID":"2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7","Type":"ContainerStarted","Data":"3a44269b09f32085c998bd8ad2bd0fee61aa77a6f8c9c62fb2a125345013210d"} May 26 11:31:10.285633 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:10.285598 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:10.301150 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:10.301127 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:10.628836 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:10.628760 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:24.040439 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.040409 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:31:24.040889 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.040859 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="alertmanager" containerID="cri-o://4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9" gracePeriod=120 May 26 11:31:24.040953 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.040923 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy-web" containerID="cri-o://c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77" gracePeriod=120 May 26 11:31:24.041012 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.040955 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy" containerID="cri-o://98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651" gracePeriod=120 May 26 11:31:24.041060 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.040940 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="config-reloader" containerID="cri-o://1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784" gracePeriod=120 May 26 11:31:24.041060 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.040878 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy-metric" containerID="cri-o://d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620" gracePeriod=120 May 26 11:31:24.041060 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.041047 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="prom-label-proxy" containerID="cri-o://ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3" gracePeriod=120 May 26 11:31:24.657139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.657110 2551 generic.go:358] "Generic (PLEG): container finished" podID="7e670243-60fb-4282-9e68-51037ce39880" containerID="ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3" exitCode=0 May 26 11:31:24.657139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.657136 2551 generic.go:358] "Generic (PLEG): container finished" podID="7e670243-60fb-4282-9e68-51037ce39880" containerID="98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651" exitCode=0 May 26 11:31:24.657139 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.657143 2551 generic.go:358] "Generic (PLEG): container finished" podID="7e670243-60fb-4282-9e68-51037ce39880" containerID="1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784" exitCode=0 May 26 11:31:24.657371 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.657150 2551 generic.go:358] "Generic (PLEG): container finished" podID="7e670243-60fb-4282-9e68-51037ce39880" containerID="4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9" exitCode=0 May 26 11:31:24.657371 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.657178 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerDied","Data":"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3"} May 26 11:31:24.657371 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.657205 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerDied","Data":"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651"} May 26 11:31:24.657371 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.657214 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerDied","Data":"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784"} May 26 11:31:24.657371 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:24.657222 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerDied","Data":"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9"} May 26 11:31:25.374804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.374777 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.470686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470658 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.470686 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470693 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-config-out\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.470893 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470724 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp6lv\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-kube-api-access-vp6lv\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.470893 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470744 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-web-config\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.470893 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470764 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-tls-assets\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.470893 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470787 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.470893 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470847 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-main-db\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.471140 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470900 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-metrics-client-ca\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.471140 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470924 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-cluster-tls-config\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.471140 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470949 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-config-volume\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.471140 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.470998 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.471140 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.471028 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.471140 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.471063 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-web\") pod \"7e670243-60fb-4282-9e68-51037ce39880\" (UID: \"7e670243-60fb-4282-9e68-51037ce39880\") " May 26 11:31:25.472072 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.471786 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:31:25.472072 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.471649 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:31:25.472210 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.472173 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:31:25.473767 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.473727 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:25.474507 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.474030 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:31:25.474507 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.474114 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-config-out" (OuterVolumeSpecName: "config-out") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:31:25.474876 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.474847 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-kube-api-access-vp6lv" (OuterVolumeSpecName: "kube-api-access-vp6lv") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "kube-api-access-vp6lv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:31:25.474975 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.474896 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:25.475126 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.475103 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:25.475214 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.475192 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-config-volume" (OuterVolumeSpecName: "config-volume") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:25.475393 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.475371 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:25.478129 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.478105 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:25.484248 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.484228 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-web-config" (OuterVolumeSpecName: "web-config") pod "7e670243-60fb-4282-9e68-51037ce39880" (UID: "7e670243-60fb-4282-9e68-51037ce39880"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:25.572470 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572421 2551 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-metrics-client-ca\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572470 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572450 2551 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-cluster-tls-config\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572478 2551 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-config-volume\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572488 2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572498 2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572508 2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572517 2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-secret-alertmanager-main-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572525 2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-config-out\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572534 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp6lv\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-kube-api-access-vp6lv\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572542 2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e670243-60fb-4282-9e68-51037ce39880-web-config\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572549 2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e670243-60fb-4282-9e68-51037ce39880-tls-assets\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572557 2551 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.572595 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.572565 2551 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e670243-60fb-4282-9e68-51037ce39880-alertmanager-main-db\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:25.662884 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.662807 2551 generic.go:358] "Generic (PLEG): container finished" podID="7e670243-60fb-4282-9e68-51037ce39880" containerID="d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620" exitCode=0 May 26 11:31:25.662884 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.662832 2551 generic.go:358] "Generic (PLEG): container finished" podID="7e670243-60fb-4282-9e68-51037ce39880" containerID="c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77" exitCode=0 May 26 11:31:25.662884 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.662876 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerDied","Data":"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620"} May 26 11:31:25.663087 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.662907 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerDied","Data":"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77"} May 26 11:31:25.663087 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.662908 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.663087 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.662920 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e670243-60fb-4282-9e68-51037ce39880","Type":"ContainerDied","Data":"444351983b9cfa7303200daf3faf13ebdda284501091b948c601c79871385e91"} May 26 11:31:25.663087 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.662935 2551 scope.go:117] "RemoveContainer" containerID="ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3" May 26 11:31:25.670409 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.670395 2551 scope.go:117] "RemoveContainer" containerID="d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620" May 26 11:31:25.676773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.676755 2551 scope.go:117] "RemoveContainer" containerID="98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651" May 26 11:31:25.682884 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.682865 2551 scope.go:117] "RemoveContainer" containerID="c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77" May 26 11:31:25.689963 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.689941 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:31:25.690175 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.690163 2551 scope.go:117] "RemoveContainer" containerID="1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784" May 26 11:31:25.693056 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.693032 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:31:25.696786 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.696771 2551 scope.go:117] "RemoveContainer" containerID="4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9" May 26 11:31:25.702942 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.702926 2551 scope.go:117] "RemoveContainer" containerID="460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238" May 26 11:31:25.708927 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.708910 2551 scope.go:117] "RemoveContainer" containerID="ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3" May 26 11:31:25.709162 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:25.709142 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3\": container with ID starting with ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3 not found: ID does not exist" containerID="ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3" May 26 11:31:25.709211 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.709171 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3"} err="failed to get container status \"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3\": rpc error: code = NotFound desc = could not find container \"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3\": container with ID starting with ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3 not found: ID does not exist" May 26 11:31:25.709211 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.709202 2551 scope.go:117] "RemoveContainer" containerID="d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620" May 26 11:31:25.709411 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:25.709395 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620\": container with ID starting with d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620 not found: ID does not exist" containerID="d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620" May 26 11:31:25.709449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.709415 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620"} err="failed to get container status \"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620\": rpc error: code = NotFound desc = could not find container \"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620\": container with ID starting with d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620 not found: ID does not exist" May 26 11:31:25.709449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.709428 2551 scope.go:117] "RemoveContainer" containerID="98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651" May 26 11:31:25.709644 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:25.709629 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651\": container with ID starting with 98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651 not found: ID does not exist" containerID="98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651" May 26 11:31:25.709688 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.709648 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651"} err="failed to get container status \"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651\": rpc error: code = NotFound desc = could not find container \"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651\": container with ID starting with 98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651 not found: ID does not exist" May 26 11:31:25.709688 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.709662 2551 scope.go:117] "RemoveContainer" containerID="c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77" May 26 11:31:25.709842 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:25.709827 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77\": container with ID starting with c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77 not found: ID does not exist" containerID="c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77" May 26 11:31:25.709885 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.709847 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77"} err="failed to get container status \"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77\": rpc error: code = NotFound desc = could not find container \"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77\": container with ID starting with c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77 not found: ID does not exist" May 26 11:31:25.709885 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.709858 2551 scope.go:117] "RemoveContainer" containerID="1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784" May 26 11:31:25.710097 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:25.710080 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784\": container with ID starting with 1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784 not found: ID does not exist" containerID="1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784" May 26 11:31:25.710134 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.710103 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784"} err="failed to get container status \"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784\": rpc error: code = NotFound desc = could not find container \"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784\": container with ID starting with 1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784 not found: ID does not exist" May 26 11:31:25.710134 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.710118 2551 scope.go:117] "RemoveContainer" containerID="4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9" May 26 11:31:25.710327 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:25.710306 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9\": container with ID starting with 4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9 not found: ID does not exist" containerID="4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9" May 26 11:31:25.710378 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.710333 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9"} err="failed to get container status \"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9\": rpc error: code = NotFound desc = could not find container \"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9\": container with ID starting with 4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9 not found: ID does not exist" May 26 11:31:25.710378 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.710347 2551 scope.go:117] "RemoveContainer" containerID="460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238" May 26 11:31:25.710559 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:25.710541 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238\": container with ID starting with 460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238 not found: ID does not exist" containerID="460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238" May 26 11:31:25.710623 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.710565 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238"} err="failed to get container status \"460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238\": rpc error: code = NotFound desc = could not find container \"460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238\": container with ID starting with 460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238 not found: ID does not exist" May 26 11:31:25.710623 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.710586 2551 scope.go:117] "RemoveContainer" containerID="ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3" May 26 11:31:25.710819 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.710799 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3"} err="failed to get container status \"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3\": rpc error: code = NotFound desc = could not find container \"ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3\": container with ID starting with ec5f830be5b561b286aa494a54625f321229110d4744422a829ca9d2a67ce3b3 not found: ID does not exist" May 26 11:31:25.710866 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.710819 2551 scope.go:117] "RemoveContainer" containerID="d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620" May 26 11:31:25.711030 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711016 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620"} err="failed to get container status \"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620\": rpc error: code = NotFound desc = could not find container \"d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620\": container with ID starting with d43f1bdc7bce76fd1135148fdc0104f64c7f00bb140c65e774fd6046a2f10620 not found: ID does not exist" May 26 11:31:25.711066 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711030 2551 scope.go:117] "RemoveContainer" containerID="98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651" May 26 11:31:25.711211 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711197 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651"} err="failed to get container status \"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651\": rpc error: code = NotFound desc = could not find container \"98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651\": container with ID starting with 98c9f815ad2fa417f0ab039c9c1254c0422bb21791b4efa4dc76911a749d8651 not found: ID does not exist" May 26 11:31:25.711265 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711212 2551 scope.go:117] "RemoveContainer" containerID="c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77" May 26 11:31:25.711388 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711361 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77"} err="failed to get container status \"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77\": rpc error: code = NotFound desc = could not find container \"c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77\": container with ID starting with c92ef27f20b86de4911757c2322ceb37addf0b88b5baf2f1f8111f05dce9aa77 not found: ID does not exist" May 26 11:31:25.711425 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711389 2551 scope.go:117] "RemoveContainer" containerID="1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784" May 26 11:31:25.711623 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711601 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784"} err="failed to get container status \"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784\": rpc error: code = NotFound desc = could not find container \"1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784\": container with ID starting with 1c9bcd0de1e649a0c7fff0ff235774b0ec8c3d299537e53cfe1cf33b5c74c784 not found: ID does not exist" May 26 11:31:25.711623 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711622 2551 scope.go:117] "RemoveContainer" containerID="4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9" May 26 11:31:25.711837 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711821 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9"} err="failed to get container status \"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9\": rpc error: code = NotFound desc = could not find container \"4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9\": container with ID starting with 4095553547d86a15c01e107bb875a8736c0007f8512e108337fa9ea564cabbe9 not found: ID does not exist" May 26 11:31:25.711837 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.711836 2551 scope.go:117] "RemoveContainer" containerID="460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238" May 26 11:31:25.712061 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.712042 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238"} err="failed to get container status \"460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238\": rpc error: code = NotFound desc = could not find container \"460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238\": container with ID starting with 460bacec019479f6b9ba5ab68c980607ff7f5101cb5d4234744cf336670ae238 not found: ID does not exist" May 26 11:31:25.724161 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724141 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:31:25.724417 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724406 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="prom-label-proxy" May 26 11:31:25.724500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724419 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="prom-label-proxy" May 26 11:31:25.724500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724431 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy-web" May 26 11:31:25.724500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724437 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy-web" May 26 11:31:25.724500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724445 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy" May 26 11:31:25.724500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724450 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy" May 26 11:31:25.724500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724490 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="alertmanager" May 26 11:31:25.724500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724498 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="alertmanager" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724509 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="init-config-reloader" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724514 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="init-config-reloader" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724525 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="config-reloader" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724530 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="config-reloader" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724539 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy-metric" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724544 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy-metric" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724587 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="alertmanager" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724594 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy-web" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724601 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="config-reloader" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724607 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy-metric" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724614 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="prom-label-proxy" May 26 11:31:25.724711 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.724619 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e670243-60fb-4282-9e68-51037ce39880" containerName="kube-rbac-proxy" May 26 11:31:25.727827 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.727810 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.730697 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.730599 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bwlwz\"" May 26 11:31:25.730697 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.730599 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 26 11:31:25.730697 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.730641 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 26 11:31:25.730697 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.730603 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 26 11:31:25.730697 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.730618 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 26 11:31:25.731218 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.730736 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 26 11:31:25.731218 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.730783 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 26 11:31:25.731218 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.731111 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 26 11:31:25.731218 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.731127 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 26 11:31:25.736113 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.736097 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 26 11:31:25.741809 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.741787 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:31:25.874644 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874615 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874656 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874675 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5061ddd8-8384-404c-ab84-9d1faeab6c4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874694 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-web-config\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874744 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5061ddd8-8384-404c-ab84-9d1faeab6c4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874929 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874793 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5061ddd8-8384-404c-ab84-9d1faeab6c4f-config-out\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874929 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874822 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874929 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874842 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5061ddd8-8384-404c-ab84-9d1faeab6c4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874929 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874901 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5061ddd8-8384-404c-ab84-9d1faeab6c4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.874929 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874919 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.875103 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874948 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rlkn\" (UniqueName: \"kubernetes.io/projected/5061ddd8-8384-404c-ab84-9d1faeab6c4f-kube-api-access-7rlkn\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.875103 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874971 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.875103 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.874990 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976200 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976171 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976348 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976213 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5061ddd8-8384-404c-ab84-9d1faeab6c4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976348 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976270 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5061ddd8-8384-404c-ab84-9d1faeab6c4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976348 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976293 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976348 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976321 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rlkn\" (UniqueName: \"kubernetes.io/projected/5061ddd8-8384-404c-ab84-9d1faeab6c4f-kube-api-access-7rlkn\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976564 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976495 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976564 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976536 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976658 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976574 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976658 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976622 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976658 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976652 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5061ddd8-8384-404c-ab84-9d1faeab6c4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976801 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976689 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-web-config\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976801 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976715 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5061ddd8-8384-404c-ab84-9d1faeab6c4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976801 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976758 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5061ddd8-8384-404c-ab84-9d1faeab6c4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.976801 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.976753 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5061ddd8-8384-404c-ab84-9d1faeab6c4f-config-out\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.977204 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.977181 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5061ddd8-8384-404c-ab84-9d1faeab6c4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.979325 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.979302 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.979449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.979330 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5061ddd8-8384-404c-ab84-9d1faeab6c4f-config-out\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.979449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.979378 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.979449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.979426 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5061ddd8-8384-404c-ab84-9d1faeab6c4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.979449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.979440 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.979697 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.979591 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.979759 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.979714 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.979854 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.979837 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-web-config\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.980034 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.980015 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5061ddd8-8384-404c-ab84-9d1faeab6c4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.981136 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.981120 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5061ddd8-8384-404c-ab84-9d1faeab6c4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:25.986941 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:25.986920 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rlkn\" (UniqueName: \"kubernetes.io/projected/5061ddd8-8384-404c-ab84-9d1faeab6c4f-kube-api-access-7rlkn\") pod \"alertmanager-main-0\" (UID: \"5061ddd8-8384-404c-ab84-9d1faeab6c4f\") " pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:26.037541 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:26.037520 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 11:31:26.168399 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:26.168379 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 11:31:26.170418 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:31:26.170394 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5061ddd8_8384_404c_ab84_9d1faeab6c4f.slice/crio-a56702956ecb5ce45d69cd2c831ea7dc501345e6e851b2c2283941353e4b23fa WatchSource:0}: Error finding container a56702956ecb5ce45d69cd2c831ea7dc501345e6e851b2c2283941353e4b23fa: Status 404 returned error can't find the container with id a56702956ecb5ce45d69cd2c831ea7dc501345e6e851b2c2283941353e4b23fa May 26 11:31:26.668165 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:26.668084 2551 generic.go:358] "Generic (PLEG): container finished" podID="5061ddd8-8384-404c-ab84-9d1faeab6c4f" containerID="0ea2b29728fa08adea101a950dee2b547ef22154eac5c28964820febe4fee905" exitCode=0 May 26 11:31:26.668165 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:26.668150 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5061ddd8-8384-404c-ab84-9d1faeab6c4f","Type":"ContainerDied","Data":"0ea2b29728fa08adea101a950dee2b547ef22154eac5c28964820febe4fee905"} May 26 11:31:26.668555 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:26.668169 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5061ddd8-8384-404c-ab84-9d1faeab6c4f","Type":"ContainerStarted","Data":"a56702956ecb5ce45d69cd2c831ea7dc501345e6e851b2c2283941353e4b23fa"} May 26 11:31:26.844353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:26.844280 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e670243-60fb-4282-9e68-51037ce39880" path="/var/lib/kubelet/pods/7e670243-60fb-4282-9e68-51037ce39880/volumes" May 26 11:31:27.674073 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:27.674039 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5061ddd8-8384-404c-ab84-9d1faeab6c4f","Type":"ContainerStarted","Data":"585fd94772e8e2316022164d790b4ab09f6db904286904bd3221379b3a1939d2"} May 26 11:31:27.674073 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:27.674073 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5061ddd8-8384-404c-ab84-9d1faeab6c4f","Type":"ContainerStarted","Data":"0c96acb9e388007b9cf9bba54c421700e8a82a297e703985fd47df62c6668f3e"} May 26 11:31:27.674551 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:27.674088 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5061ddd8-8384-404c-ab84-9d1faeab6c4f","Type":"ContainerStarted","Data":"6dde59473408116aee49b78bd3b7caa0ea9fa8f35340bc0a65fa21240e3678fb"} May 26 11:31:27.674551 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:27.674100 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5061ddd8-8384-404c-ab84-9d1faeab6c4f","Type":"ContainerStarted","Data":"d6bcf4eeacbe131f5fbed455450ca42c5117bfdeb4de28687d9ebe8c5a813ba8"} May 26 11:31:27.674551 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:27.674111 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5061ddd8-8384-404c-ab84-9d1faeab6c4f","Type":"ContainerStarted","Data":"26797680787f166f7ff78801f3e37d0eea2b4b66a3b422134e4f37127e9707ff"} May 26 11:31:27.674551 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:27.674123 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5061ddd8-8384-404c-ab84-9d1faeab6c4f","Type":"ContainerStarted","Data":"0577b7369aa8a526658775ba4c547b4ade1a3262cdf5068b5a35bbdac56e1222"} May 26 11:31:27.708386 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:27.708331 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.708312576 podStartE2EDuration="2.708312576s" podCreationTimestamp="2026-05-26 11:31:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:31:27.704518704 +0000 UTC m=+243.400506736" watchObservedRunningTime="2026-05-26 11:31:27.708312576 +0000 UTC m=+243.404300611" May 26 11:31:28.074819 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.074783 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt"] May 26 11:31:28.077959 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.077931 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.080899 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.080752 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 26 11:31:28.080899 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.080785 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zpvl7\"" May 26 11:31:28.080899 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.080809 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 26 11:31:28.080899 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.080788 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 26 11:31:28.080899 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.080861 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 26 11:31:28.081249 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.081232 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 26 11:31:28.086022 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.085994 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 26 11:31:28.089796 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.089769 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt"] May 26 11:31:28.196114 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.196082 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.196114 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.196118 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-federate-client-tls\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.196349 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.196137 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.196349 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.196153 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vj8q\" (UniqueName: \"kubernetes.io/projected/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-kube-api-access-4vj8q\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.196349 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.196175 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-serving-certs-ca-bundle\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.196349 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.196225 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-secret-telemeter-client\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.196349 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.196240 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-telemeter-client-tls\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.196349 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.196303 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-metrics-client-ca\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.297093 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.297056 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.297282 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.297102 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-federate-client-tls\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.297282 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.297195 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.297282 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.297222 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vj8q\" (UniqueName: \"kubernetes.io/projected/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-kube-api-access-4vj8q\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.297282 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.297258 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-serving-certs-ca-bundle\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.297514 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.297333 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-secret-telemeter-client\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.297514 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.297359 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-telemeter-client-tls\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.297514 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.297421 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-metrics-client-ca\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.298141 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.298113 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-serving-certs-ca-bundle\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.298269 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.298115 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.298269 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.298122 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-metrics-client-ca\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.299820 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.299791 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-federate-client-tls\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.299918 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.299848 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.299974 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.299951 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-secret-telemeter-client\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.300016 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.299974 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-telemeter-client-tls\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.305268 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.305245 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vj8q\" (UniqueName: \"kubernetes.io/projected/a5bde192-1eb9-4b4c-ad5e-a695d64a239a-kube-api-access-4vj8q\") pod \"telemeter-client-5fcb68fb89-r9mzt\" (UID: \"a5bde192-1eb9-4b4c-ad5e-a695d64a239a\") " pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.363764 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.363682 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:31:28.364362 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.364299 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy" containerID="cri-o://7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" gracePeriod=600 May 26 11:31:28.364362 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.364328 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="thanos-sidecar" containerID="cri-o://ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" gracePeriod=600 May 26 11:31:28.364538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.364355 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="prometheus" containerID="cri-o://242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" gracePeriod=600 May 26 11:31:28.364538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.364305 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy-web" containerID="cri-o://14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" gracePeriod=600 May 26 11:31:28.364538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.364333 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="config-reloader" containerID="cri-o://0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" gracePeriod=600 May 26 11:31:28.364538 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.364340 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" gracePeriod=600 May 26 11:31:28.390957 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.390911 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" May 26 11:31:28.542136 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.542007 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt"] May 26 11:31:28.544488 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:31:28.544446 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5bde192_1eb9_4b4c_ad5e_a695d64a239a.slice/crio-00e267f9b919078c80a0e473a6faea967ce8c111d9af3e624d36f08f3c2e2513 WatchSource:0}: Error finding container 00e267f9b919078c80a0e473a6faea967ce8c111d9af3e624d36f08f3c2e2513: Status 404 returned error can't find the container with id 00e267f9b919078c80a0e473a6faea967ce8c111d9af3e624d36f08f3c2e2513 May 26 11:31:28.627041 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.627017 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:28.680616 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.680581 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" event={"ID":"a5bde192-1eb9-4b4c-ad5e-a695d64a239a","Type":"ContainerStarted","Data":"00e267f9b919078c80a0e473a6faea967ce8c111d9af3e624d36f08f3c2e2513"} May 26 11:31:28.683604 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683580 2551 generic.go:358] "Generic (PLEG): container finished" podID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" exitCode=0 May 26 11:31:28.683604 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683603 2551 generic.go:358] "Generic (PLEG): container finished" podID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" exitCode=0 May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683612 2551 generic.go:358] "Generic (PLEG): container finished" podID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" exitCode=0 May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683618 2551 generic.go:358] "Generic (PLEG): container finished" podID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" exitCode=0 May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683623 2551 generic.go:358] "Generic (PLEG): container finished" podID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" exitCode=0 May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683628 2551 generic.go:358] "Generic (PLEG): container finished" podID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" exitCode=0 May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683661 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerDied","Data":"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849"} May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683694 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerDied","Data":"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9"} May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683700 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683708 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerDied","Data":"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1"} May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683724 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerDied","Data":"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24"} May 26 11:31:28.683773 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683749 2551 scope.go:117] "RemoveContainer" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" May 26 11:31:28.684237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.683737 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerDied","Data":"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f"} May 26 11:31:28.684237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.684222 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerDied","Data":"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2"} May 26 11:31:28.684328 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.684244 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea3f72f2-997a-4948-a966-033d0ff718a4","Type":"ContainerDied","Data":"f02019ed96b6e981cf7c94979371605de629b7d1cad46f7a9aa00a9d0dc7905f"} May 26 11:31:28.696950 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.696924 2551 scope.go:117] "RemoveContainer" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" May 26 11:31:28.704745 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.704726 2551 scope.go:117] "RemoveContainer" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" May 26 11:31:28.712165 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.712141 2551 scope.go:117] "RemoveContainer" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" May 26 11:31:28.718297 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.718281 2551 scope.go:117] "RemoveContainer" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" May 26 11:31:28.724599 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.724578 2551 scope.go:117] "RemoveContainer" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" May 26 11:31:28.730881 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.730867 2551 scope.go:117] "RemoveContainer" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" May 26 11:31:28.736567 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.736540 2551 scope.go:117] "RemoveContainer" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" May 26 11:31:28.736806 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:28.736786 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": container with ID starting with 92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849 not found: ID does not exist" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" May 26 11:31:28.736868 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.736818 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849"} err="failed to get container status \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": rpc error: code = NotFound desc = could not find container \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": container with ID starting with 92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849 not found: ID does not exist" May 26 11:31:28.736868 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.736841 2551 scope.go:117] "RemoveContainer" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" May 26 11:31:28.737062 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:28.737046 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": container with ID starting with 7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9 not found: ID does not exist" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" May 26 11:31:28.737103 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737065 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9"} err="failed to get container status \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": rpc error: code = NotFound desc = could not find container \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": container with ID starting with 7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9 not found: ID does not exist" May 26 11:31:28.737103 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737078 2551 scope.go:117] "RemoveContainer" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" May 26 11:31:28.737274 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:28.737260 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": container with ID starting with 14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1 not found: ID does not exist" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" May 26 11:31:28.737309 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737278 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1"} err="failed to get container status \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": rpc error: code = NotFound desc = could not find container \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": container with ID starting with 14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1 not found: ID does not exist" May 26 11:31:28.737309 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737290 2551 scope.go:117] "RemoveContainer" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" May 26 11:31:28.737570 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:28.737554 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": container with ID starting with ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24 not found: ID does not exist" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" May 26 11:31:28.737620 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737572 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24"} err="failed to get container status \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": rpc error: code = NotFound desc = could not find container \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": container with ID starting with ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24 not found: ID does not exist" May 26 11:31:28.737620 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737584 2551 scope.go:117] "RemoveContainer" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" May 26 11:31:28.737754 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:28.737740 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": container with ID starting with 0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f not found: ID does not exist" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" May 26 11:31:28.737790 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737766 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f"} err="failed to get container status \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": rpc error: code = NotFound desc = could not find container \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": container with ID starting with 0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f not found: ID does not exist" May 26 11:31:28.737790 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737777 2551 scope.go:117] "RemoveContainer" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" May 26 11:31:28.737944 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:28.737930 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": container with ID starting with 242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2 not found: ID does not exist" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" May 26 11:31:28.737983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737948 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2"} err="failed to get container status \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": rpc error: code = NotFound desc = could not find container \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": container with ID starting with 242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2 not found: ID does not exist" May 26 11:31:28.737983 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.737959 2551 scope.go:117] "RemoveContainer" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" May 26 11:31:28.738200 ip-10-0-133-99 kubenswrapper[2551]: E0526 11:31:28.738182 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": container with ID starting with 2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0 not found: ID does not exist" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" May 26 11:31:28.738237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.738205 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0"} err="failed to get container status \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": rpc error: code = NotFound desc = could not find container \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": container with ID starting with 2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0 not found: ID does not exist" May 26 11:31:28.738237 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.738220 2551 scope.go:117] "RemoveContainer" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" May 26 11:31:28.738419 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.738400 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849"} err="failed to get container status \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": rpc error: code = NotFound desc = could not find container \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": container with ID starting with 92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849 not found: ID does not exist" May 26 11:31:28.738500 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.738421 2551 scope.go:117] "RemoveContainer" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" May 26 11:31:28.738678 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.738658 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9"} err="failed to get container status \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": rpc error: code = NotFound desc = could not find container \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": container with ID starting with 7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9 not found: ID does not exist" May 26 11:31:28.738678 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.738677 2551 scope.go:117] "RemoveContainer" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" May 26 11:31:28.738882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.738866 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1"} err="failed to get container status \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": rpc error: code = NotFound desc = could not find container \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": container with ID starting with 14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1 not found: ID does not exist" May 26 11:31:28.738882 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.738881 2551 scope.go:117] "RemoveContainer" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" May 26 11:31:28.739065 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739049 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24"} err="failed to get container status \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": rpc error: code = NotFound desc = could not find container \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": container with ID starting with ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24 not found: ID does not exist" May 26 11:31:28.739108 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739065 2551 scope.go:117] "RemoveContainer" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" May 26 11:31:28.739232 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739211 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f"} err="failed to get container status \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": rpc error: code = NotFound desc = could not find container \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": container with ID starting with 0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f not found: ID does not exist" May 26 11:31:28.739232 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739231 2551 scope.go:117] "RemoveContainer" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" May 26 11:31:28.739397 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739383 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2"} err="failed to get container status \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": rpc error: code = NotFound desc = could not find container \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": container with ID starting with 242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2 not found: ID does not exist" May 26 11:31:28.739439 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739398 2551 scope.go:117] "RemoveContainer" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" May 26 11:31:28.739590 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739574 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0"} err="failed to get container status \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": rpc error: code = NotFound desc = could not find container \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": container with ID starting with 2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0 not found: ID does not exist" May 26 11:31:28.739640 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739590 2551 scope.go:117] "RemoveContainer" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" May 26 11:31:28.739783 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739768 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849"} err="failed to get container status \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": rpc error: code = NotFound desc = could not find container \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": container with ID starting with 92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849 not found: ID does not exist" May 26 11:31:28.739783 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739782 2551 scope.go:117] "RemoveContainer" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" May 26 11:31:28.739994 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739975 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9"} err="failed to get container status \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": rpc error: code = NotFound desc = could not find container \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": container with ID starting with 7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9 not found: ID does not exist" May 26 11:31:28.740067 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.739996 2551 scope.go:117] "RemoveContainer" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" May 26 11:31:28.740213 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740196 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1"} err="failed to get container status \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": rpc error: code = NotFound desc = could not find container \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": container with ID starting with 14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1 not found: ID does not exist" May 26 11:31:28.740272 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740213 2551 scope.go:117] "RemoveContainer" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" May 26 11:31:28.740383 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740366 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24"} err="failed to get container status \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": rpc error: code = NotFound desc = could not find container \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": container with ID starting with ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24 not found: ID does not exist" May 26 11:31:28.740448 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740385 2551 scope.go:117] "RemoveContainer" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" May 26 11:31:28.740592 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740577 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f"} err="failed to get container status \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": rpc error: code = NotFound desc = could not find container \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": container with ID starting with 0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f not found: ID does not exist" May 26 11:31:28.740639 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740592 2551 scope.go:117] "RemoveContainer" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" May 26 11:31:28.740786 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740770 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2"} err="failed to get container status \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": rpc error: code = NotFound desc = could not find container \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": container with ID starting with 242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2 not found: ID does not exist" May 26 11:31:28.740828 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740786 2551 scope.go:117] "RemoveContainer" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" May 26 11:31:28.740995 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740969 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0"} err="failed to get container status \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": rpc error: code = NotFound desc = could not find container \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": container with ID starting with 2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0 not found: ID does not exist" May 26 11:31:28.741037 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.740995 2551 scope.go:117] "RemoveContainer" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" May 26 11:31:28.741183 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741166 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849"} err="failed to get container status \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": rpc error: code = NotFound desc = could not find container \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": container with ID starting with 92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849 not found: ID does not exist" May 26 11:31:28.741243 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741184 2551 scope.go:117] "RemoveContainer" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" May 26 11:31:28.741379 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741363 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9"} err="failed to get container status \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": rpc error: code = NotFound desc = could not find container \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": container with ID starting with 7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9 not found: ID does not exist" May 26 11:31:28.741428 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741379 2551 scope.go:117] "RemoveContainer" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" May 26 11:31:28.741563 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741547 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1"} err="failed to get container status \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": rpc error: code = NotFound desc = could not find container \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": container with ID starting with 14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1 not found: ID does not exist" May 26 11:31:28.741602 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741563 2551 scope.go:117] "RemoveContainer" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" May 26 11:31:28.741754 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741739 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24"} err="failed to get container status \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": rpc error: code = NotFound desc = could not find container \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": container with ID starting with ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24 not found: ID does not exist" May 26 11:31:28.741799 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741754 2551 scope.go:117] "RemoveContainer" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" May 26 11:31:28.741960 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741937 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f"} err="failed to get container status \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": rpc error: code = NotFound desc = could not find container \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": container with ID starting with 0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f not found: ID does not exist" May 26 11:31:28.741997 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.741963 2551 scope.go:117] "RemoveContainer" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" May 26 11:31:28.742160 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742144 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2"} err="failed to get container status \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": rpc error: code = NotFound desc = could not find container \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": container with ID starting with 242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2 not found: ID does not exist" May 26 11:31:28.742194 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742161 2551 scope.go:117] "RemoveContainer" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" May 26 11:31:28.742365 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742349 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0"} err="failed to get container status \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": rpc error: code = NotFound desc = could not find container \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": container with ID starting with 2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0 not found: ID does not exist" May 26 11:31:28.742411 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742365 2551 scope.go:117] "RemoveContainer" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" May 26 11:31:28.742568 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742551 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849"} err="failed to get container status \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": rpc error: code = NotFound desc = could not find container \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": container with ID starting with 92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849 not found: ID does not exist" May 26 11:31:28.742568 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742566 2551 scope.go:117] "RemoveContainer" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" May 26 11:31:28.742750 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742733 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9"} err="failed to get container status \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": rpc error: code = NotFound desc = could not find container \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": container with ID starting with 7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9 not found: ID does not exist" May 26 11:31:28.742789 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742750 2551 scope.go:117] "RemoveContainer" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" May 26 11:31:28.742950 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742934 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1"} err="failed to get container status \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": rpc error: code = NotFound desc = could not find container \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": container with ID starting with 14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1 not found: ID does not exist" May 26 11:31:28.743050 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.742948 2551 scope.go:117] "RemoveContainer" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" May 26 11:31:28.743115 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743101 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24"} err="failed to get container status \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": rpc error: code = NotFound desc = could not find container \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": container with ID starting with ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24 not found: ID does not exist" May 26 11:31:28.743151 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743115 2551 scope.go:117] "RemoveContainer" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" May 26 11:31:28.743274 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743261 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f"} err="failed to get container status \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": rpc error: code = NotFound desc = could not find container \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": container with ID starting with 0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f not found: ID does not exist" May 26 11:31:28.743314 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743274 2551 scope.go:117] "RemoveContainer" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" May 26 11:31:28.743566 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743546 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2"} err="failed to get container status \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": rpc error: code = NotFound desc = could not find container \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": container with ID starting with 242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2 not found: ID does not exist" May 26 11:31:28.743621 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743566 2551 scope.go:117] "RemoveContainer" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" May 26 11:31:28.743742 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743728 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0"} err="failed to get container status \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": rpc error: code = NotFound desc = could not find container \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": container with ID starting with 2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0 not found: ID does not exist" May 26 11:31:28.743783 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743742 2551 scope.go:117] "RemoveContainer" containerID="92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849" May 26 11:31:28.743885 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743866 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849"} err="failed to get container status \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": rpc error: code = NotFound desc = could not find container \"92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849\": container with ID starting with 92c5d66ebef1eb51e28bd254de7252e971e755bf2a735d061136ab37014b8849 not found: ID does not exist" May 26 11:31:28.743926 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.743885 2551 scope.go:117] "RemoveContainer" containerID="7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9" May 26 11:31:28.744095 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744080 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9"} err="failed to get container status \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": rpc error: code = NotFound desc = could not find container \"7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9\": container with ID starting with 7f870d5b8f7e04714cd72ca661282d4d8769bea839d2f964445e2eced33185d9 not found: ID does not exist" May 26 11:31:28.744095 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744094 2551 scope.go:117] "RemoveContainer" containerID="14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1" May 26 11:31:28.744275 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744260 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1"} err="failed to get container status \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": rpc error: code = NotFound desc = could not find container \"14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1\": container with ID starting with 14403cc3d9b024162af24f075eeee4b8b7d16b2278fcd6c4d8d42c2b6148eab1 not found: ID does not exist" May 26 11:31:28.744320 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744275 2551 scope.go:117] "RemoveContainer" containerID="ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24" May 26 11:31:28.744468 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744442 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24"} err="failed to get container status \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": rpc error: code = NotFound desc = could not find container \"ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24\": container with ID starting with ea65777e258f0768e4793064b66c22f9a2d03ceec0b3713e51cebec415c8fd24 not found: ID does not exist" May 26 11:31:28.744513 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744470 2551 scope.go:117] "RemoveContainer" containerID="0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f" May 26 11:31:28.744691 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744674 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f"} err="failed to get container status \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": rpc error: code = NotFound desc = could not find container \"0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f\": container with ID starting with 0993f48d8cbba9de9732a6dfa41bead28208576ba5c0a2e3295b302f9afb778f not found: ID does not exist" May 26 11:31:28.744732 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744692 2551 scope.go:117] "RemoveContainer" containerID="242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2" May 26 11:31:28.744895 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744878 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2"} err="failed to get container status \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": rpc error: code = NotFound desc = could not find container \"242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2\": container with ID starting with 242fbf75a6754e1a0ad7c7293d83c1a34fe6ca9f303d0ad26d326d6f00cc67a2 not found: ID does not exist" May 26 11:31:28.744895 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.744893 2551 scope.go:117] "RemoveContainer" containerID="2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0" May 26 11:31:28.745073 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.745055 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0"} err="failed to get container status \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": rpc error: code = NotFound desc = could not find container \"2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0\": container with ID starting with 2060a046349d2ded45ae8ea3b5222e2d9462afa5279c182d1e7403a722ec86e0 not found: ID does not exist" May 26 11:31:28.802016 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.801992 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802124 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802027 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-rulefiles-0\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802124 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802062 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-trusted-ca-bundle\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802124 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802112 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-tls-assets\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802276 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802142 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-serving-certs-ca-bundle\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802276 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802170 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-db\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802276 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802220 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-web-config\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802276 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802245 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-kube-rbac-proxy\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802276 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802270 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-tls\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802547 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802324 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-grpc-tls\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802547 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802350 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-thanos-prometheus-http-client-file\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802547 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802381 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-kubelet-serving-ca-bundle\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802547 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802423 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-metrics-client-certs\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802547 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802479 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5qc7\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-kube-api-access-m5qc7\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802547 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802533 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802810 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802558 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-config-out\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802810 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802589 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-config\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802810 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802616 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-metrics-client-ca\") pod \"ea3f72f2-997a-4948-a966-033d0ff718a4\" (UID: \"ea3f72f2-997a-4948-a966-033d0ff718a4\") " May 26 11:31:28.802810 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.802759 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:31:28.803176 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.803123 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.804427 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.803906 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:31:28.804427 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.804199 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:31:28.804703 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.804677 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:31:28.804897 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.804696 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:31:28.804897 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.804750 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.805028 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.804954 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:31:28.805133 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.805109 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 11:31:28.805527 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.805499 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-kube-api-access-m5qc7" (OuterVolumeSpecName: "kube-api-access-m5qc7") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "kube-api-access-m5qc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:31:28.806322 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.806283 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.806958 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.806924 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.806958 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.806946 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-config" (OuterVolumeSpecName: "config") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.807096 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.807079 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-config-out" (OuterVolumeSpecName: "config-out") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 11:31:28.807171 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.807150 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.807294 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.807272 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.807429 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.807411 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.808592 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.808565 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.816250 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.816230 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-web-config" (OuterVolumeSpecName: "web-config") pod "ea3f72f2-997a-4948-a966-033d0ff718a4" (UID: "ea3f72f2-997a-4948-a966-033d0ff718a4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 11:31:28.903726 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903676 2551 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-grpc-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903726 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903697 2551 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903726 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903708 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903726 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903718 2551 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-metrics-client-certs\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903726 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903727 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5qc7\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-kube-api-access-m5qc7\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903736 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903747 2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-config-out\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903755 2551 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-config\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903774 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-configmap-metrics-client-ca\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903783 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903792 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903800 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903809 2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea3f72f2-997a-4948-a966-033d0ff718a4-tls-assets\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903818 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea3f72f2-997a-4948-a966-033d0ff718a4-prometheus-k8s-db\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903826 2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-web-config\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903835 2551 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-kube-rbac-proxy\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:28.903938 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:28.903843 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea3f72f2-997a-4948-a966-033d0ff718a4-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:31:29.001387 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.001365 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:31:29.005224 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.005203 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:31:29.032916 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.032893 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:31:29.033201 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033189 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="config-reloader" May 26 11:31:29.033240 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033206 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="config-reloader" May 26 11:31:29.033240 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033216 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="thanos-sidecar" May 26 11:31:29.033240 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033221 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="thanos-sidecar" May 26 11:31:29.033240 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033238 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033243 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033251 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="prometheus" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033256 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="prometheus" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033265 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy-web" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033272 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy-web" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033280 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy-thanos" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033288 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy-thanos" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033300 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="init-config-reloader" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033306 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="init-config-reloader" May 26 11:31:29.033351 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033350 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy-web" May 26 11:31:29.033638 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033360 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="thanos-sidecar" May 26 11:31:29.033638 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033369 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy" May 26 11:31:29.033638 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033378 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="config-reloader" May 26 11:31:29.033638 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033383 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="kube-rbac-proxy-thanos" May 26 11:31:29.033638 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.033390 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" containerName="prometheus" May 26 11:31:29.037204 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.037188 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.040040 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.040022 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 11:31:29.040135 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.040115 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 11:31:29.040273 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.040251 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 11:31:29.040504 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.040489 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 11:31:29.041209 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.040913 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 11:31:29.041209 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.041000 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4h8z6\"" May 26 11:31:29.041209 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.041009 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 11:31:29.041209 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.041078 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 11:31:29.041448 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.041234 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 11:31:29.041448 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.041319 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 11:31:29.041578 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.041557 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 11:31:29.041628 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.041578 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 11:31:29.042023 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.042008 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5tkgmqahgefc2\"" May 26 11:31:29.044179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.044107 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 11:31:29.047180 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.047164 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 11:31:29.052631 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.052612 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:31:29.206985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.206911 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.206985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.206966 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb9c69f9-e9f4-41d1-871c-c77825042f55-config-out\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207191 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207037 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207191 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207065 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjqz\" (UniqueName: \"kubernetes.io/projected/bb9c69f9-e9f4-41d1-871c-c77825042f55-kube-api-access-zjjqz\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207191 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207092 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207191 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207161 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207377 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207197 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207377 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207256 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207377 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207331 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207377 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207360 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207588 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207406 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-config\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207588 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207475 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb9c69f9-e9f4-41d1-871c-c77825042f55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207588 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207511 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207588 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207533 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207584 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207624 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-web-config\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207651 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.207781 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.207676 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.308910 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.308871 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309039 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.308923 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309039 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.308962 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309039 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309008 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb9c69f9-e9f4-41d1-871c-c77825042f55-config-out\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309053 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309083 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjqz\" (UniqueName: \"kubernetes.io/projected/bb9c69f9-e9f4-41d1-871c-c77825042f55-kube-api-access-zjjqz\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309109 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309150 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309179 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309174 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309211 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309243 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309270 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309305 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-config\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309343 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb9c69f9-e9f4-41d1-871c-c77825042f55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309380 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309408 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309437 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.309845 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309497 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-web-config\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.310002 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.309969 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.310167 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.310131 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.310244 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.310210 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.310811 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.310784 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.312481 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.312038 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bb9c69f9-e9f4-41d1-871c-c77825042f55-config-out\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.312481 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.312293 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315104 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.312975 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315104 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.313673 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315104 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.313808 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315104 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.314001 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bb9c69f9-e9f4-41d1-871c-c77825042f55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315104 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.314212 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315104 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.314718 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-config\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315524 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.315448 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315677 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.315627 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-web-config\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.315847 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.315827 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.316030 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.316011 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bb9c69f9-e9f4-41d1-871c-c77825042f55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.316393 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.316366 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb9c69f9-e9f4-41d1-871c-c77825042f55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.319855 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.319833 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjqz\" (UniqueName: \"kubernetes.io/projected/bb9c69f9-e9f4-41d1-871c-c77825042f55-kube-api-access-zjjqz\") pod \"prometheus-k8s-0\" (UID: \"bb9c69f9-e9f4-41d1-871c-c77825042f55\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.347698 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.347675 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:29.509750 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.509625 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 11:31:29.512952 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:31:29.512761 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9c69f9_e9f4_41d1_871c_c77825042f55.slice/crio-d09d85158c77d060224cc2b812ed083cd0895132cb1b98aab3eff6914145335a WatchSource:0}: Error finding container d09d85158c77d060224cc2b812ed083cd0895132cb1b98aab3eff6914145335a: Status 404 returned error can't find the container with id d09d85158c77d060224cc2b812ed083cd0895132cb1b98aab3eff6914145335a May 26 11:31:29.688850 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.688819 2551 generic.go:358] "Generic (PLEG): container finished" podID="bb9c69f9-e9f4-41d1-871c-c77825042f55" containerID="ef70f1021ebcaf24caa64bb69e68d50cf4afa2b59ee0986436a91cda6627a789" exitCode=0 May 26 11:31:29.689235 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.688855 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bb9c69f9-e9f4-41d1-871c-c77825042f55","Type":"ContainerDied","Data":"ef70f1021ebcaf24caa64bb69e68d50cf4afa2b59ee0986436a91cda6627a789"} May 26 11:31:29.689235 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:29.688893 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bb9c69f9-e9f4-41d1-871c-c77825042f55","Type":"ContainerStarted","Data":"d09d85158c77d060224cc2b812ed083cd0895132cb1b98aab3eff6914145335a"} May 26 11:31:30.694346 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.694317 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" event={"ID":"a5bde192-1eb9-4b4c-ad5e-a695d64a239a","Type":"ContainerStarted","Data":"99004b0ac013c83330c71af4b8406d74cd19928d3e0be4ea761808fdef34a1af"} May 26 11:31:30.694717 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.694355 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" event={"ID":"a5bde192-1eb9-4b4c-ad5e-a695d64a239a","Type":"ContainerStarted","Data":"1261f91fa295ebb47a4ec54678db8d50a543bae3552d5df2b0dd45e4ab36cd7c"} May 26 11:31:30.694717 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.694369 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" event={"ID":"a5bde192-1eb9-4b4c-ad5e-a695d64a239a","Type":"ContainerStarted","Data":"a128c492f8d86e53b6c52dc9f27524831fbb7da6b35b09de2e7cab421ff86b8e"} May 26 11:31:30.697353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.697320 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bb9c69f9-e9f4-41d1-871c-c77825042f55","Type":"ContainerStarted","Data":"d4c0426265ba26050dd82c71e3b70838bdae6393af351ae5e9c9d8ded03a9445"} May 26 11:31:30.697353 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.697352 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bb9c69f9-e9f4-41d1-871c-c77825042f55","Type":"ContainerStarted","Data":"12cb1b0d0072beaf4fa32760a706f9cec516ed37513260bb2cc6aa3e8847b438"} May 26 11:31:30.697639 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.697366 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bb9c69f9-e9f4-41d1-871c-c77825042f55","Type":"ContainerStarted","Data":"7996c69dbe5e786955853fd9bae96fb08dd0e885dd11df98ab086bd7acbf75b8"} May 26 11:31:30.697639 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.697378 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bb9c69f9-e9f4-41d1-871c-c77825042f55","Type":"ContainerStarted","Data":"59c977c1e9f9d7169f31761f7c4cbe8a9dd2c900ddbbb601f3989845afe6e9bc"} May 26 11:31:30.697639 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.697389 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bb9c69f9-e9f4-41d1-871c-c77825042f55","Type":"ContainerStarted","Data":"8ef97ee84a68e78caf7d4768f86bf145851644ed1eeb4ae892b06f87076edd85"} May 26 11:31:30.697639 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.697422 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bb9c69f9-e9f4-41d1-871c-c77825042f55","Type":"ContainerStarted","Data":"b995b0fea475a28e243f01af401c8c180af6b703f5d24fef3999ec2144d40b6c"} May 26 11:31:30.717964 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.717924 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fcb68fb89-r9mzt" podStartSLOduration=0.749415653 podStartE2EDuration="2.717910499s" podCreationTimestamp="2026-05-26 11:31:28 +0000 UTC" firstStartedPulling="2026-05-26 11:31:28.54637531 +0000 UTC m=+244.242363326" lastFinishedPulling="2026-05-26 11:31:30.514870159 +0000 UTC m=+246.210858172" observedRunningTime="2026-05-26 11:31:30.715771945 +0000 UTC m=+246.411759981" watchObservedRunningTime="2026-05-26 11:31:30.717910499 +0000 UTC m=+246.413898577" May 26 11:31:30.743085 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.743010 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.74299558 podStartE2EDuration="1.74299558s" podCreationTimestamp="2026-05-26 11:31:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:31:30.74153646 +0000 UTC m=+246.437524494" watchObservedRunningTime="2026-05-26 11:31:30.74299558 +0000 UTC m=+246.438983615" May 26 11:31:30.844061 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:30.844033 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea3f72f2-997a-4948-a966-033d0ff718a4" path="/var/lib/kubelet/pods/ea3f72f2-997a-4948-a966-033d0ff718a4/volumes" May 26 11:31:34.348276 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:34.348244 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:31:36.578539 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:36.578427 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:31:36.580794 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:36.580773 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acb515e4-f4ef-437f-91bd-dadc3359247d-metrics-certs\") pod \"network-metrics-daemon-g4m6v\" (UID: \"acb515e4-f4ef-437f-91bd-dadc3359247d\") " pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:31:36.849748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:36.849676 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jz9wk\"" May 26 11:31:36.851732 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:36.851716 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g4m6v" May 26 11:31:36.975010 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:36.974901 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g4m6v"] May 26 11:31:36.978136 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:31:36.978107 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb515e4_f4ef_437f_91bd_dadc3359247d.slice/crio-d5c2fa0ea8549bfb3cb0e9c4908a0a6e2fe1d9cf965e2125ae0fda86e0636b04 WatchSource:0}: Error finding container d5c2fa0ea8549bfb3cb0e9c4908a0a6e2fe1d9cf965e2125ae0fda86e0636b04: Status 404 returned error can't find the container with id d5c2fa0ea8549bfb3cb0e9c4908a0a6e2fe1d9cf965e2125ae0fda86e0636b04 May 26 11:31:37.719633 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:37.719600 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g4m6v" event={"ID":"acb515e4-f4ef-437f-91bd-dadc3359247d","Type":"ContainerStarted","Data":"d5c2fa0ea8549bfb3cb0e9c4908a0a6e2fe1d9cf965e2125ae0fda86e0636b04"} May 26 11:31:38.723953 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:38.723918 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g4m6v" event={"ID":"acb515e4-f4ef-437f-91bd-dadc3359247d","Type":"ContainerStarted","Data":"1bbde6e3a056e870f960f0b6256f2c1d6b226eb645c2c56457d55cc41905417d"} May 26 11:31:38.723953 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:38.723956 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g4m6v" event={"ID":"acb515e4-f4ef-437f-91bd-dadc3359247d","Type":"ContainerStarted","Data":"469223a771af148c11a7df6924845888e661d1fe93e5e65113230990856ab029"} May 26 11:31:38.742962 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:31:38.742915 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g4m6v" podStartSLOduration=253.760892493 podStartE2EDuration="4m14.742902625s" podCreationTimestamp="2026-05-26 11:27:24 +0000 UTC" firstStartedPulling="2026-05-26 11:31:36.980255689 +0000 UTC m=+252.676243701" lastFinishedPulling="2026-05-26 11:31:37.96226581 +0000 UTC m=+253.658253833" observedRunningTime="2026-05-26 11:31:38.741574439 +0000 UTC m=+254.437562476" watchObservedRunningTime="2026-05-26 11:31:38.742902625 +0000 UTC m=+254.438890677" May 26 11:32:24.722993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:32:24.722963 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:32:24.723370 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:32:24.723028 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:32:24.730993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:32:24.730970 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:32:24.731108 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:32:24.731039 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:32:24.737005 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:32:24.736991 2551 kubelet.go:1628] "Image garbage collection succeeded" May 26 11:32:29.348423 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:32:29.348388 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:32:29.364302 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:32:29.364266 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:32:29.879792 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:32:29.879767 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 11:33:25.310579 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.310498 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-c6fjm"] May 26 11:33:25.313687 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.313669 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.316808 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.316790 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 11:33:25.336516 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.336497 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c6fjm"] May 26 11:33:25.358327 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.358306 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a31fa4ba-d296-4ffa-a496-8435fe894279-kubelet-config\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.358409 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.358336 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a31fa4ba-d296-4ffa-a496-8435fe894279-original-pull-secret\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.358449 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.358437 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a31fa4ba-d296-4ffa-a496-8435fe894279-dbus\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.459034 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.459003 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a31fa4ba-d296-4ffa-a496-8435fe894279-dbus\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.459234 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.459092 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a31fa4ba-d296-4ffa-a496-8435fe894279-kubelet-config\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.459234 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.459123 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a31fa4ba-d296-4ffa-a496-8435fe894279-original-pull-secret\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.459234 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.459179 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a31fa4ba-d296-4ffa-a496-8435fe894279-dbus\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.459234 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.459191 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a31fa4ba-d296-4ffa-a496-8435fe894279-kubelet-config\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.461399 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.461378 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a31fa4ba-d296-4ffa-a496-8435fe894279-original-pull-secret\") pod \"global-pull-secret-syncer-c6fjm\" (UID: \"a31fa4ba-d296-4ffa-a496-8435fe894279\") " pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.622849 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.622775 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c6fjm" May 26 11:33:25.759039 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.759010 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c6fjm"] May 26 11:33:25.761829 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:33:25.761801 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31fa4ba_d296_4ffa_a496_8435fe894279.slice/crio-5f15aed3b6cdbf213dbbb62dcf1d6615ad16ec1c604e3cfe05ebc9544f37aada WatchSource:0}: Error finding container 5f15aed3b6cdbf213dbbb62dcf1d6615ad16ec1c604e3cfe05ebc9544f37aada: Status 404 returned error can't find the container with id 5f15aed3b6cdbf213dbbb62dcf1d6615ad16ec1c604e3cfe05ebc9544f37aada May 26 11:33:25.768243 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:25.767168 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 11:33:26.027468 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:26.027433 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c6fjm" event={"ID":"a31fa4ba-d296-4ffa-a496-8435fe894279","Type":"ContainerStarted","Data":"5f15aed3b6cdbf213dbbb62dcf1d6615ad16ec1c604e3cfe05ebc9544f37aada"} May 26 11:33:30.040423 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:33:30.040388 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c6fjm" event={"ID":"a31fa4ba-d296-4ffa-a496-8435fe894279","Type":"ContainerStarted","Data":"f5372260858c2a3e8dc5d4cbcfeeec5641c8d1fa96898b6d9addea39fd323eaf"} May 26 11:37:24.750791 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:37:24.750766 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:37:24.752827 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:37:24.752804 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:37:24.754864 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:37:24.754844 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:37:24.756788 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:37:24.756765 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:42:19.604080 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.604028 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c6fjm" podStartSLOduration=530.741284382 podStartE2EDuration="8m54.604013805s" podCreationTimestamp="2026-05-26 11:33:25 +0000 UTC" firstStartedPulling="2026-05-26 11:33:25.767366869 +0000 UTC m=+361.463354888" lastFinishedPulling="2026-05-26 11:33:29.630096288 +0000 UTC m=+365.326084311" observedRunningTime="2026-05-26 11:33:30.097599875 +0000 UTC m=+365.793587920" watchObservedRunningTime="2026-05-26 11:42:19.604013805 +0000 UTC m=+895.300001841" May 26 11:42:19.604678 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.604660 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-init-8l8hv"] May 26 11:42:19.606872 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.606858 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8l8hv" May 26 11:42:19.610408 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.610389 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 26 11:42:19.611387 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.611366 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 26 11:42:19.611496 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.611369 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" May 26 11:42:19.611496 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.611371 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-4zcqw\"" May 26 11:42:19.620902 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.620884 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-8l8hv"] May 26 11:42:19.747748 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.747718 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txfsr\" (UniqueName: \"kubernetes.io/projected/b0bf938b-1752-4aa0-a313-e8209324bd34-kube-api-access-txfsr\") pod \"s3-init-8l8hv\" (UID: \"b0bf938b-1752-4aa0-a313-e8209324bd34\") " pod="kserve/s3-init-8l8hv" May 26 11:42:19.848307 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.848281 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txfsr\" (UniqueName: \"kubernetes.io/projected/b0bf938b-1752-4aa0-a313-e8209324bd34-kube-api-access-txfsr\") pod \"s3-init-8l8hv\" (UID: \"b0bf938b-1752-4aa0-a313-e8209324bd34\") " pod="kserve/s3-init-8l8hv" May 26 11:42:19.860348 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.860289 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txfsr\" (UniqueName: \"kubernetes.io/projected/b0bf938b-1752-4aa0-a313-e8209324bd34-kube-api-access-txfsr\") pod \"s3-init-8l8hv\" (UID: \"b0bf938b-1752-4aa0-a313-e8209324bd34\") " pod="kserve/s3-init-8l8hv" May 26 11:42:19.926803 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:19.926781 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8l8hv" May 26 11:42:20.054213 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:20.050735 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-8l8hv"] May 26 11:42:20.055720 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:20.055698 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 11:42:20.593913 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:20.593853 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8l8hv" event={"ID":"b0bf938b-1752-4aa0-a313-e8209324bd34","Type":"ContainerStarted","Data":"f34cbfba1c32d8ffca45b68f39bed8f67faa1829ea09d18f018036bef3e3215e"} May 26 11:42:24.607405 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:24.607325 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8l8hv" event={"ID":"b0bf938b-1752-4aa0-a313-e8209324bd34","Type":"ContainerStarted","Data":"79c763a2b93d006dfa68a8207fccceb3e53e20c09c77e7a4e973acd1dddad93c"} May 26 11:42:24.627716 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:24.627669 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-init-8l8hv" podStartSLOduration=1.344283917 podStartE2EDuration="5.627655503s" podCreationTimestamp="2026-05-26 11:42:19 +0000 UTC" firstStartedPulling="2026-05-26 11:42:20.055879995 +0000 UTC m=+895.751868022" lastFinishedPulling="2026-05-26 11:42:24.339251595 +0000 UTC m=+900.035239608" observedRunningTime="2026-05-26 11:42:24.625119554 +0000 UTC m=+900.321107590" watchObservedRunningTime="2026-05-26 11:42:24.627655503 +0000 UTC m=+900.323643537" May 26 11:42:24.782188 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:24.782150 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:42:24.785177 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:24.785154 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:42:24.786141 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:24.786119 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:42:24.789136 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:24.789114 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:42:27.619074 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:27.619001 2551 generic.go:358] "Generic (PLEG): container finished" podID="b0bf938b-1752-4aa0-a313-e8209324bd34" containerID="79c763a2b93d006dfa68a8207fccceb3e53e20c09c77e7a4e973acd1dddad93c" exitCode=0 May 26 11:42:27.619409 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:27.619074 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8l8hv" event={"ID":"b0bf938b-1752-4aa0-a313-e8209324bd34","Type":"ContainerDied","Data":"79c763a2b93d006dfa68a8207fccceb3e53e20c09c77e7a4e973acd1dddad93c"} May 26 11:42:28.744029 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:28.744010 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8l8hv" May 26 11:42:28.828626 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:28.828600 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txfsr\" (UniqueName: \"kubernetes.io/projected/b0bf938b-1752-4aa0-a313-e8209324bd34-kube-api-access-txfsr\") pod \"b0bf938b-1752-4aa0-a313-e8209324bd34\" (UID: \"b0bf938b-1752-4aa0-a313-e8209324bd34\") " May 26 11:42:28.830575 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:28.830552 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0bf938b-1752-4aa0-a313-e8209324bd34-kube-api-access-txfsr" (OuterVolumeSpecName: "kube-api-access-txfsr") pod "b0bf938b-1752-4aa0-a313-e8209324bd34" (UID: "b0bf938b-1752-4aa0-a313-e8209324bd34"). InnerVolumeSpecName "kube-api-access-txfsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:42:28.929879 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:28.929829 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txfsr\" (UniqueName: \"kubernetes.io/projected/b0bf938b-1752-4aa0-a313-e8209324bd34-kube-api-access-txfsr\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:42:29.625993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:29.625962 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8l8hv" event={"ID":"b0bf938b-1752-4aa0-a313-e8209324bd34","Type":"ContainerDied","Data":"f34cbfba1c32d8ffca45b68f39bed8f67faa1829ea09d18f018036bef3e3215e"} May 26 11:42:29.625993 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:29.625992 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8l8hv" May 26 11:42:29.626226 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:29.625994 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f34cbfba1c32d8ffca45b68f39bed8f67faa1829ea09d18f018036bef3e3215e" May 26 11:42:39.218557 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.218525 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-l2qzx"] May 26 11:42:39.218908 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.218847 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0bf938b-1752-4aa0-a313-e8209324bd34" containerName="s3-init" May 26 11:42:39.218908 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.218858 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0bf938b-1752-4aa0-a313-e8209324bd34" containerName="s3-init" May 26 11:42:39.218982 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.218912 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0bf938b-1752-4aa0-a313-e8209324bd34" containerName="s3-init" May 26 11:42:39.220771 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.220753 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-l2qzx" May 26 11:42:39.223764 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.223744 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 26 11:42:39.224723 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.224704 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 26 11:42:39.224723 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.224719 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" May 26 11:42:39.224878 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.224719 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-4zcqw\"" May 26 11:42:39.230655 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.230634 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-l2qzx"] May 26 11:42:39.312519 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.312482 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkhn5\" (UniqueName: \"kubernetes.io/projected/91289406-27cd-4e64-acc0-5ea1489893b2-kube-api-access-vkhn5\") pod \"s3-tls-init-custom-l2qzx\" (UID: \"91289406-27cd-4e64-acc0-5ea1489893b2\") " pod="kserve/s3-tls-init-custom-l2qzx" May 26 11:42:39.413532 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.413503 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkhn5\" (UniqueName: \"kubernetes.io/projected/91289406-27cd-4e64-acc0-5ea1489893b2-kube-api-access-vkhn5\") pod \"s3-tls-init-custom-l2qzx\" (UID: \"91289406-27cd-4e64-acc0-5ea1489893b2\") " pod="kserve/s3-tls-init-custom-l2qzx" May 26 11:42:39.422037 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.422014 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkhn5\" (UniqueName: \"kubernetes.io/projected/91289406-27cd-4e64-acc0-5ea1489893b2-kube-api-access-vkhn5\") pod \"s3-tls-init-custom-l2qzx\" (UID: \"91289406-27cd-4e64-acc0-5ea1489893b2\") " pod="kserve/s3-tls-init-custom-l2qzx" May 26 11:42:39.540140 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.540066 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-l2qzx" May 26 11:42:39.661864 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:39.661771 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-l2qzx"] May 26 11:42:39.664518 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:42:39.664493 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91289406_27cd_4e64_acc0_5ea1489893b2.slice/crio-e6716dd87cddc99932b35c9f3ed13436cad5e294a3d53c3ece782fc177a01365 WatchSource:0}: Error finding container e6716dd87cddc99932b35c9f3ed13436cad5e294a3d53c3ece782fc177a01365: Status 404 returned error can't find the container with id e6716dd87cddc99932b35c9f3ed13436cad5e294a3d53c3ece782fc177a01365 May 26 11:42:40.661829 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:40.661796 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-l2qzx" event={"ID":"91289406-27cd-4e64-acc0-5ea1489893b2","Type":"ContainerStarted","Data":"e363fc2e13fc3f0a6f297d020cbfd97377d1f6b49cb69cd4851725ce6e089902"} May 26 11:42:40.661829 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:40.661830 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-l2qzx" event={"ID":"91289406-27cd-4e64-acc0-5ea1489893b2","Type":"ContainerStarted","Data":"e6716dd87cddc99932b35c9f3ed13436cad5e294a3d53c3ece782fc177a01365"} May 26 11:42:40.677644 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:40.677598 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-l2qzx" podStartSLOduration=1.677582298 podStartE2EDuration="1.677582298s" podCreationTimestamp="2026-05-26 11:42:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:42:40.67638556 +0000 UTC m=+916.372373594" watchObservedRunningTime="2026-05-26 11:42:40.677582298 +0000 UTC m=+916.373570335" May 26 11:42:44.674627 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:44.674592 2551 generic.go:358] "Generic (PLEG): container finished" podID="91289406-27cd-4e64-acc0-5ea1489893b2" containerID="e363fc2e13fc3f0a6f297d020cbfd97377d1f6b49cb69cd4851725ce6e089902" exitCode=0 May 26 11:42:44.674987 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:44.674654 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-l2qzx" event={"ID":"91289406-27cd-4e64-acc0-5ea1489893b2","Type":"ContainerDied","Data":"e363fc2e13fc3f0a6f297d020cbfd97377d1f6b49cb69cd4851725ce6e089902"} May 26 11:42:45.802074 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:45.802052 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-l2qzx" May 26 11:42:45.965663 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:45.965598 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkhn5\" (UniqueName: \"kubernetes.io/projected/91289406-27cd-4e64-acc0-5ea1489893b2-kube-api-access-vkhn5\") pod \"91289406-27cd-4e64-acc0-5ea1489893b2\" (UID: \"91289406-27cd-4e64-acc0-5ea1489893b2\") " May 26 11:42:45.967569 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:45.967547 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91289406-27cd-4e64-acc0-5ea1489893b2-kube-api-access-vkhn5" (OuterVolumeSpecName: "kube-api-access-vkhn5") pod "91289406-27cd-4e64-acc0-5ea1489893b2" (UID: "91289406-27cd-4e64-acc0-5ea1489893b2"). InnerVolumeSpecName "kube-api-access-vkhn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:42:46.066440 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:46.066412 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkhn5\" (UniqueName: \"kubernetes.io/projected/91289406-27cd-4e64-acc0-5ea1489893b2-kube-api-access-vkhn5\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:42:46.681080 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:46.681054 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-l2qzx" May 26 11:42:46.681241 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:46.681055 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-l2qzx" event={"ID":"91289406-27cd-4e64-acc0-5ea1489893b2","Type":"ContainerDied","Data":"e6716dd87cddc99932b35c9f3ed13436cad5e294a3d53c3ece782fc177a01365"} May 26 11:42:46.681241 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:46.681158 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6716dd87cddc99932b35c9f3ed13436cad5e294a3d53c3ece782fc177a01365" May 26 11:42:49.455358 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.455329 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-grllw"] May 26 11:42:49.455804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.455678 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91289406-27cd-4e64-acc0-5ea1489893b2" containerName="s3-tls-init-custom" May 26 11:42:49.455804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.455691 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="91289406-27cd-4e64-acc0-5ea1489893b2" containerName="s3-tls-init-custom" May 26 11:42:49.455804 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.455759 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="91289406-27cd-4e64-acc0-5ea1489893b2" containerName="s3-tls-init-custom" May 26 11:42:49.480573 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.480549 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-grllw"] May 26 11:42:49.480722 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.480649 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-grllw" May 26 11:42:49.483398 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.483379 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 26 11:42:49.483398 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.483389 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" May 26 11:42:49.483577 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.483379 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-4zcqw\"" May 26 11:42:49.483577 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.483380 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 26 11:42:49.492336 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.492317 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kklm8\" (UniqueName: \"kubernetes.io/projected/6aa349fe-14db-4fa7-86e6-ff0037fdbdab-kube-api-access-kklm8\") pod \"s3-tls-init-serving-grllw\" (UID: \"6aa349fe-14db-4fa7-86e6-ff0037fdbdab\") " pod="kserve/s3-tls-init-serving-grllw" May 26 11:42:49.593526 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.593497 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kklm8\" (UniqueName: \"kubernetes.io/projected/6aa349fe-14db-4fa7-86e6-ff0037fdbdab-kube-api-access-kklm8\") pod \"s3-tls-init-serving-grllw\" (UID: \"6aa349fe-14db-4fa7-86e6-ff0037fdbdab\") " pod="kserve/s3-tls-init-serving-grllw" May 26 11:42:49.601661 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.601638 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kklm8\" (UniqueName: \"kubernetes.io/projected/6aa349fe-14db-4fa7-86e6-ff0037fdbdab-kube-api-access-kklm8\") pod \"s3-tls-init-serving-grllw\" (UID: \"6aa349fe-14db-4fa7-86e6-ff0037fdbdab\") " pod="kserve/s3-tls-init-serving-grllw" May 26 11:42:49.802553 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.802524 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-grllw" May 26 11:42:49.925200 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:49.925177 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-grllw"] May 26 11:42:49.927198 ip-10-0-133-99 kubenswrapper[2551]: W0526 11:42:49.927170 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6aa349fe_14db_4fa7_86e6_ff0037fdbdab.slice/crio-50adcacc8b3fa5c2f87c31c4739a9e4f4eb87327b599236f143ef81b750dec7f WatchSource:0}: Error finding container 50adcacc8b3fa5c2f87c31c4739a9e4f4eb87327b599236f143ef81b750dec7f: Status 404 returned error can't find the container with id 50adcacc8b3fa5c2f87c31c4739a9e4f4eb87327b599236f143ef81b750dec7f May 26 11:42:50.694682 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:50.694637 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-grllw" event={"ID":"6aa349fe-14db-4fa7-86e6-ff0037fdbdab","Type":"ContainerStarted","Data":"43bdd1c156172b7800d6f9906379a0102d057d1c51a6d23ce618266f2c30277a"} May 26 11:42:50.694682 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:50.694686 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-grllw" event={"ID":"6aa349fe-14db-4fa7-86e6-ff0037fdbdab","Type":"ContainerStarted","Data":"50adcacc8b3fa5c2f87c31c4739a9e4f4eb87327b599236f143ef81b750dec7f"} May 26 11:42:50.710657 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:50.710613 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-grllw" podStartSLOduration=1.710599982 podStartE2EDuration="1.710599982s" podCreationTimestamp="2026-05-26 11:42:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 11:42:50.710310788 +0000 UTC m=+926.406298825" watchObservedRunningTime="2026-05-26 11:42:50.710599982 +0000 UTC m=+926.406588016" May 26 11:42:55.710845 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:55.710811 2551 generic.go:358] "Generic (PLEG): container finished" podID="6aa349fe-14db-4fa7-86e6-ff0037fdbdab" containerID="43bdd1c156172b7800d6f9906379a0102d057d1c51a6d23ce618266f2c30277a" exitCode=0 May 26 11:42:55.711221 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:55.710851 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-grllw" event={"ID":"6aa349fe-14db-4fa7-86e6-ff0037fdbdab","Type":"ContainerDied","Data":"43bdd1c156172b7800d6f9906379a0102d057d1c51a6d23ce618266f2c30277a"} May 26 11:42:56.836931 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:56.836905 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-grllw" May 26 11:42:56.857066 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:56.857041 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kklm8\" (UniqueName: \"kubernetes.io/projected/6aa349fe-14db-4fa7-86e6-ff0037fdbdab-kube-api-access-kklm8\") pod \"6aa349fe-14db-4fa7-86e6-ff0037fdbdab\" (UID: \"6aa349fe-14db-4fa7-86e6-ff0037fdbdab\") " May 26 11:42:56.859203 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:56.859179 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa349fe-14db-4fa7-86e6-ff0037fdbdab-kube-api-access-kklm8" (OuterVolumeSpecName: "kube-api-access-kklm8") pod "6aa349fe-14db-4fa7-86e6-ff0037fdbdab" (UID: "6aa349fe-14db-4fa7-86e6-ff0037fdbdab"). InnerVolumeSpecName "kube-api-access-kklm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 11:42:56.957802 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:56.957773 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kklm8\" (UniqueName: \"kubernetes.io/projected/6aa349fe-14db-4fa7-86e6-ff0037fdbdab-kube-api-access-kklm8\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 11:42:57.717965 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:57.717930 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-grllw" event={"ID":"6aa349fe-14db-4fa7-86e6-ff0037fdbdab","Type":"ContainerDied","Data":"50adcacc8b3fa5c2f87c31c4739a9e4f4eb87327b599236f143ef81b750dec7f"} May 26 11:42:57.717965 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:57.717964 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50adcacc8b3fa5c2f87c31c4739a9e4f4eb87327b599236f143ef81b750dec7f" May 26 11:42:57.717965 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:42:57.717939 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-grllw" May 26 11:47:24.806347 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:47:24.806321 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:47:24.812692 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:47:24.812673 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:47:24.813414 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:47:24.813393 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:47:24.817102 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:47:24.817087 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:52:24.832588 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:52:24.832555 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:52:24.836303 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:52:24.836282 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:52:24.837578 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:52:24.837561 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:52:24.848073 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:52:24.848054 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:57:24.862038 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:57:24.862012 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:57:24.865609 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:57:24.865586 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 11:57:24.868312 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:57:24.868295 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 11:57:24.871985 ip-10-0-133-99 kubenswrapper[2551]: I0526 11:57:24.871968 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:02:24.886438 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:02:24.886409 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:02:24.889725 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:02:24.889704 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:02:24.892191 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:02:24.892174 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:02:24.895354 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:02:24.895339 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:07:24.909430 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:07:24.909332 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:07:24.913240 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:07:24.913189 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:07:24.915819 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:07:24.915800 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:07:24.919489 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:07:24.919473 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:12:24.933509 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:12:24.933388 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:12:24.937750 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:12:24.937299 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:12:24.939719 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:12:24.939697 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:12:24.943324 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:12:24.943308 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:17:24.956887 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:17:24.956787 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:17:24.961020 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:17:24.960302 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:17:24.964203 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:17:24.964186 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:17:24.967573 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:17:24.967558 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:22:24.981693 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:22:24.981667 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:22:24.985399 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:22:24.985377 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:22:24.987626 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:22:24.987607 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:22:24.991221 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:22:24.991204 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:27:25.006110 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:27:25.005998 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:27:25.012560 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:27:25.012542 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:27:25.014667 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:27:25.014647 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:27:25.018278 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:27:25.018253 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:32:25.031833 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:32:25.031722 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:32:25.035668 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:32:25.035224 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:32:25.038707 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:32:25.038686 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:32:25.042146 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:32:25.042129 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:36:29.003808 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:36:29.003758 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-99.ec2.internal" podUID="f60ea2db76896f8a68dfa4cecb6168b4" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" May 26 12:37:25.058109 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:25.057994 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:37:25.061851 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:25.061823 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:37:25.063994 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:25.063974 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:37:25.067405 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:25.067390 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:37:47.389019 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.388981 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qvxgp/must-gather-hsx9h"] May 26 12:37:47.389434 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.389311 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa349fe-14db-4fa7-86e6-ff0037fdbdab" containerName="s3-tls-init-serving" May 26 12:37:47.389434 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.389322 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa349fe-14db-4fa7-86e6-ff0037fdbdab" containerName="s3-tls-init-serving" May 26 12:37:47.389434 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.389380 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="6aa349fe-14db-4fa7-86e6-ff0037fdbdab" containerName="s3-tls-init-serving" May 26 12:37:47.392339 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.392324 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:37:47.395028 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.395007 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvxgp\"/\"openshift-service-ca.crt\"" May 26 12:37:47.395167 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.395007 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvxgp\"/\"kube-root-ca.crt\"" May 26 12:37:47.399844 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.399401 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvxgp/must-gather-hsx9h"] May 26 12:37:47.546622 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.546590 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnsv9\" (UniqueName: \"kubernetes.io/projected/c044b0ab-0b5c-413c-b0ea-227bef73f426-kube-api-access-tnsv9\") pod \"must-gather-hsx9h\" (UID: \"c044b0ab-0b5c-413c-b0ea-227bef73f426\") " pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:37:47.546622 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.546626 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c044b0ab-0b5c-413c-b0ea-227bef73f426-must-gather-output\") pod \"must-gather-hsx9h\" (UID: \"c044b0ab-0b5c-413c-b0ea-227bef73f426\") " pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:37:47.647364 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.647276 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnsv9\" (UniqueName: \"kubernetes.io/projected/c044b0ab-0b5c-413c-b0ea-227bef73f426-kube-api-access-tnsv9\") pod \"must-gather-hsx9h\" (UID: \"c044b0ab-0b5c-413c-b0ea-227bef73f426\") " pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:37:47.647364 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.647318 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c044b0ab-0b5c-413c-b0ea-227bef73f426-must-gather-output\") pod \"must-gather-hsx9h\" (UID: \"c044b0ab-0b5c-413c-b0ea-227bef73f426\") " pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:37:47.647709 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.647683 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c044b0ab-0b5c-413c-b0ea-227bef73f426-must-gather-output\") pod \"must-gather-hsx9h\" (UID: \"c044b0ab-0b5c-413c-b0ea-227bef73f426\") " pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:37:47.656850 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.656825 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnsv9\" (UniqueName: \"kubernetes.io/projected/c044b0ab-0b5c-413c-b0ea-227bef73f426-kube-api-access-tnsv9\") pod \"must-gather-hsx9h\" (UID: \"c044b0ab-0b5c-413c-b0ea-227bef73f426\") " pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:37:47.709851 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.709832 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:37:47.831130 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.831108 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvxgp/must-gather-hsx9h"] May 26 12:37:47.833709 ip-10-0-133-99 kubenswrapper[2551]: W0526 12:37:47.833675 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc044b0ab_0b5c_413c_b0ea_227bef73f426.slice/crio-d556c85baeca2414dcd40fd74f74c9ff8be31b53fc25f7dc6461cca14e904919 WatchSource:0}: Error finding container d556c85baeca2414dcd40fd74f74c9ff8be31b53fc25f7dc6461cca14e904919: Status 404 returned error can't find the container with id d556c85baeca2414dcd40fd74f74c9ff8be31b53fc25f7dc6461cca14e904919 May 26 12:37:47.835256 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:47.835240 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 12:37:48.473874 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:48.473836 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" event={"ID":"c044b0ab-0b5c-413c-b0ea-227bef73f426","Type":"ContainerStarted","Data":"d556c85baeca2414dcd40fd74f74c9ff8be31b53fc25f7dc6461cca14e904919"} May 26 12:37:54.496358 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:54.496316 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" event={"ID":"c044b0ab-0b5c-413c-b0ea-227bef73f426","Type":"ContainerStarted","Data":"14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120"} May 26 12:37:54.496761 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:54.496363 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" event={"ID":"c044b0ab-0b5c-413c-b0ea-227bef73f426","Type":"ContainerStarted","Data":"e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29"} May 26 12:37:54.513129 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:37:54.513076 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" podStartSLOduration=1.564914129 podStartE2EDuration="7.513062786s" podCreationTimestamp="2026-05-26 12:37:47 +0000 UTC" firstStartedPulling="2026-05-26 12:37:47.835379562 +0000 UTC m=+4223.531367576" lastFinishedPulling="2026-05-26 12:37:53.783528204 +0000 UTC m=+4229.479516233" observedRunningTime="2026-05-26 12:37:54.511323604 +0000 UTC m=+4230.207311641" watchObservedRunningTime="2026-05-26 12:37:54.513062786 +0000 UTC m=+4230.209050821" May 26 12:38:14.562287 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:14.562255 2551 generic.go:358] "Generic (PLEG): container finished" podID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerID="e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29" exitCode=0 May 26 12:38:14.562689 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:14.562333 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" event={"ID":"c044b0ab-0b5c-413c-b0ea-227bef73f426","Type":"ContainerDied","Data":"e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29"} May 26 12:38:14.562689 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:14.562670 2551 scope.go:117] "RemoveContainer" containerID="e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29" May 26 12:38:15.470757 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:15.470723 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qvxgp_must-gather-hsx9h_c044b0ab-0b5c-413c-b0ea-227bef73f426/gather/0.log" May 26 12:38:18.897155 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:18.897126 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c6fjm_a31fa4ba-d296-4ffa-a496-8435fe894279/global-pull-secret-syncer/0.log" May 26 12:38:19.106177 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:19.106150 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c4sq2_b8afd26c-8164-4985-8d0f-1ca259f05391/konnectivity-agent/0.log" May 26 12:38:19.130930 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:19.130901 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-99.ec2.internal_f60ea2db76896f8a68dfa4cecb6168b4/haproxy/0.log" May 26 12:38:20.949962 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:20.949933 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-qvxgp/must-gather-hsx9h"] May 26 12:38:20.950328 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:20.950124 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerName="copy" containerID="cri-o://14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120" gracePeriod=2 May 26 12:38:20.954316 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:20.954272 2551 status_manager.go:895] "Failed to get status for pod" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" err="pods \"must-gather-hsx9h\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-qvxgp\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 26 12:38:20.954480 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:20.954444 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-qvxgp/must-gather-hsx9h"] May 26 12:38:21.180791 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.180770 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qvxgp_must-gather-hsx9h_c044b0ab-0b5c-413c-b0ea-227bef73f426/copy/0.log" May 26 12:38:21.181123 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.181106 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:38:21.183614 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.183589 2551 status_manager.go:895] "Failed to get status for pod" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" err="pods \"must-gather-hsx9h\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-qvxgp\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 26 12:38:21.242923 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.242901 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c044b0ab-0b5c-413c-b0ea-227bef73f426-must-gather-output\") pod \"c044b0ab-0b5c-413c-b0ea-227bef73f426\" (UID: \"c044b0ab-0b5c-413c-b0ea-227bef73f426\") " May 26 12:38:21.243028 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.242966 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnsv9\" (UniqueName: \"kubernetes.io/projected/c044b0ab-0b5c-413c-b0ea-227bef73f426-kube-api-access-tnsv9\") pod \"c044b0ab-0b5c-413c-b0ea-227bef73f426\" (UID: \"c044b0ab-0b5c-413c-b0ea-227bef73f426\") " May 26 12:38:21.245416 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.245199 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c044b0ab-0b5c-413c-b0ea-227bef73f426-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "c044b0ab-0b5c-413c-b0ea-227bef73f426" (UID: "c044b0ab-0b5c-413c-b0ea-227bef73f426"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 12:38:21.249620 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.249564 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c044b0ab-0b5c-413c-b0ea-227bef73f426-kube-api-access-tnsv9" (OuterVolumeSpecName: "kube-api-access-tnsv9") pod "c044b0ab-0b5c-413c-b0ea-227bef73f426" (UID: "c044b0ab-0b5c-413c-b0ea-227bef73f426"). InnerVolumeSpecName "kube-api-access-tnsv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 12:38:21.344093 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.344051 2551 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c044b0ab-0b5c-413c-b0ea-227bef73f426-must-gather-output\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 12:38:21.344093 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.344087 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnsv9\" (UniqueName: \"kubernetes.io/projected/c044b0ab-0b5c-413c-b0ea-227bef73f426-kube-api-access-tnsv9\") on node \"ip-10-0-133-99.ec2.internal\" DevicePath \"\"" May 26 12:38:21.582923 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.582834 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-qvxgp_must-gather-hsx9h_c044b0ab-0b5c-413c-b0ea-227bef73f426/copy/0.log" May 26 12:38:21.583182 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.583158 2551 generic.go:358] "Generic (PLEG): container finished" podID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerID="14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120" exitCode=143 May 26 12:38:21.583261 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.583224 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" May 26 12:38:21.583312 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.583241 2551 scope.go:117] "RemoveContainer" containerID="14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120" May 26 12:38:21.585848 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.585821 2551 status_manager.go:895] "Failed to get status for pod" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" err="pods \"must-gather-hsx9h\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-qvxgp\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 26 12:38:21.590913 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.590894 2551 scope.go:117] "RemoveContainer" containerID="e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29" May 26 12:38:21.593350 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.593326 2551 status_manager.go:895] "Failed to get status for pod" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" pod="openshift-must-gather-qvxgp/must-gather-hsx9h" err="pods \"must-gather-hsx9h\" is forbidden: User \"system:node:ip-10-0-133-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-qvxgp\": no relationship found between node 'ip-10-0-133-99.ec2.internal' and this object" May 26 12:38:21.602542 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.602527 2551 scope.go:117] "RemoveContainer" containerID="14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120" May 26 12:38:21.602761 ip-10-0-133-99 kubenswrapper[2551]: E0526 12:38:21.602744 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120\": container with ID starting with 14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120 not found: ID does not exist" containerID="14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120" May 26 12:38:21.602812 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.602767 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120"} err="failed to get container status \"14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120\": rpc error: code = NotFound desc = could not find container \"14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120\": container with ID starting with 14e9fdbb3c9d56890f14bbc8b509701e5dcb0f738e4626d2279d669cb0821120 not found: ID does not exist" May 26 12:38:21.602812 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.602784 2551 scope.go:117] "RemoveContainer" containerID="e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29" May 26 12:38:21.602967 ip-10-0-133-99 kubenswrapper[2551]: E0526 12:38:21.602950 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29\": container with ID starting with e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29 not found: ID does not exist" containerID="e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29" May 26 12:38:21.603006 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:21.602973 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29"} err="failed to get container status \"e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29\": rpc error: code = NotFound desc = could not find container \"e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29\": container with ID starting with e6d3f113f763a60379f09f46938fa9c3ad0bbfe9b91f0f35e95bac1cd6b3df29 not found: ID does not exist" May 26 12:38:22.660737 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.660664 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5061ddd8-8384-404c-ab84-9d1faeab6c4f/alertmanager/0.log" May 26 12:38:22.686800 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.686778 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5061ddd8-8384-404c-ab84-9d1faeab6c4f/config-reloader/0.log" May 26 12:38:22.710611 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.710590 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5061ddd8-8384-404c-ab84-9d1faeab6c4f/kube-rbac-proxy-web/0.log" May 26 12:38:22.731678 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.731657 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5061ddd8-8384-404c-ab84-9d1faeab6c4f/kube-rbac-proxy/0.log" May 26 12:38:22.754876 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.754857 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5061ddd8-8384-404c-ab84-9d1faeab6c4f/kube-rbac-proxy-metric/0.log" May 26 12:38:22.778886 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.778866 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5061ddd8-8384-404c-ab84-9d1faeab6c4f/prom-label-proxy/0.log" May 26 12:38:22.804775 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.804756 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5061ddd8-8384-404c-ab84-9d1faeab6c4f/init-config-reloader/0.log" May 26 12:38:22.843188 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.843161 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" path="/var/lib/kubelet/pods/c044b0ab-0b5c-413c-b0ea-227bef73f426/volumes" May 26 12:38:22.887714 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.887692 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-7jw5w_30ea67f6-c95b-4c20-88d2-d9a8303d1b4d/kube-state-metrics/0.log" May 26 12:38:22.916129 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.916065 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-7jw5w_30ea67f6-c95b-4c20-88d2-d9a8303d1b4d/kube-rbac-proxy-main/0.log" May 26 12:38:22.936576 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:22.936557 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-7jw5w_30ea67f6-c95b-4c20-88d2-d9a8303d1b4d/kube-rbac-proxy-self/0.log" May 26 12:38:23.017591 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.017567 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8drmz_c143aa33-9e54-479b-95a5-980dab1fd958/node-exporter/0.log" May 26 12:38:23.041905 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.041884 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8drmz_c143aa33-9e54-479b-95a5-980dab1fd958/kube-rbac-proxy/0.log" May 26 12:38:23.067977 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.067960 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8drmz_c143aa33-9e54-479b-95a5-980dab1fd958/init-textfile/0.log" May 26 12:38:23.254220 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.254198 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-k8qbx_c8cd3d1b-0c0a-47c0-bd39-7009fa162d09/kube-rbac-proxy-main/0.log" May 26 12:38:23.279659 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.279638 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-k8qbx_c8cd3d1b-0c0a-47c0-bd39-7009fa162d09/kube-rbac-proxy-self/0.log" May 26 12:38:23.306825 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.306804 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-k8qbx_c8cd3d1b-0c0a-47c0-bd39-7009fa162d09/openshift-state-metrics/0.log" May 26 12:38:23.353432 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.353410 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bb9c69f9-e9f4-41d1-871c-c77825042f55/prometheus/0.log" May 26 12:38:23.370902 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.370885 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bb9c69f9-e9f4-41d1-871c-c77825042f55/config-reloader/0.log" May 26 12:38:23.398029 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.398008 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bb9c69f9-e9f4-41d1-871c-c77825042f55/thanos-sidecar/0.log" May 26 12:38:23.426175 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.426154 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bb9c69f9-e9f4-41d1-871c-c77825042f55/kube-rbac-proxy-web/0.log" May 26 12:38:23.450013 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.449992 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bb9c69f9-e9f4-41d1-871c-c77825042f55/kube-rbac-proxy/0.log" May 26 12:38:23.493779 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.493722 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bb9c69f9-e9f4-41d1-871c-c77825042f55/kube-rbac-proxy-thanos/0.log" May 26 12:38:23.528686 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.528668 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bb9c69f9-e9f4-41d1-871c-c77825042f55/init-config-reloader/0.log" May 26 12:38:23.574405 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.574377 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zwf8d_1d872ce9-20ef-4bae-8870-4fb423c5e2c3/prometheus-operator/0.log" May 26 12:38:23.611768 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.611749 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zwf8d_1d872ce9-20ef-4bae-8870-4fb423c5e2c3/kube-rbac-proxy/0.log" May 26 12:38:23.643590 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.643573 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-xwkr4_fb9e2041-22c8-40cf-a9c1-8f0395adf788/prometheus-operator-admission-webhook/0.log" May 26 12:38:23.688110 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.688093 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fcb68fb89-r9mzt_a5bde192-1eb9-4b4c-ad5e-a695d64a239a/telemeter-client/0.log" May 26 12:38:23.718690 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.718673 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fcb68fb89-r9mzt_a5bde192-1eb9-4b4c-ad5e-a695d64a239a/reload/0.log" May 26 12:38:23.744016 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:23.743963 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fcb68fb89-r9mzt_a5bde192-1eb9-4b4c-ad5e-a695d64a239a/kube-rbac-proxy/0.log" May 26 12:38:25.283280 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.283253 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/2.log" May 26 12:38:25.287356 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.287330 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-c82hq_75997849-b606-4fd2-9aa5-37e7dee71456/console-operator/3.log" May 26 12:38:25.770941 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.770909 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn"] May 26 12:38:25.771299 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.771283 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerName="gather" May 26 12:38:25.771387 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.771302 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerName="gather" May 26 12:38:25.771387 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.771322 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerName="copy" May 26 12:38:25.771387 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.771330 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerName="copy" May 26 12:38:25.771557 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.771408 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerName="copy" May 26 12:38:25.771557 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.771424 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="c044b0ab-0b5c-413c-b0ea-227bef73f426" containerName="gather" May 26 12:38:25.776542 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.776522 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.779398 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.779374 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-964gc\"/\"openshift-service-ca.crt\"" May 26 12:38:25.780377 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.780358 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-964gc\"/\"default-dockercfg-tzckk\"" May 26 12:38:25.780483 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.780376 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-964gc\"/\"kube-root-ca.crt\"" May 26 12:38:25.783652 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.783546 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn"] May 26 12:38:25.883366 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.883336 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-proc\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.883538 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.883374 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-sys\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.883538 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.883450 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-lib-modules\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.883538 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.883505 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-podres\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.883538 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.883532 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hhg\" (UniqueName: \"kubernetes.io/projected/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-kube-api-access-p4hhg\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984701 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984670 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-lib-modules\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984828 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984710 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-podres\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984828 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984747 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hhg\" (UniqueName: \"kubernetes.io/projected/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-kube-api-access-p4hhg\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984828 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984769 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-proc\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984828 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984809 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-sys\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984976 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984827 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-lib-modules\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984976 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984850 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-podres\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984976 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984862 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-proc\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.984976 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.984889 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-sys\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:25.994478 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:25.994433 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hhg\" (UniqueName: \"kubernetes.io/projected/da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6-kube-api-access-p4hhg\") pod \"perf-node-gather-daemonset-7hbgn\" (UID: \"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6\") " pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:26.086625 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.086567 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:26.209931 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.209901 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn"] May 26 12:38:26.213069 ip-10-0-133-99 kubenswrapper[2551]: W0526 12:38:26.213044 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda9fdd4b_0ea5_4a2f_82b7_1e70ca3937b6.slice/crio-6f9f637280b6f6bbb34c8155f921508987f19d60c08479f6e61d42f7f285eb87 WatchSource:0}: Error finding container 6f9f637280b6f6bbb34c8155f921508987f19d60c08479f6e61d42f7f285eb87: Status 404 returned error can't find the container with id 6f9f637280b6f6bbb34c8155f921508987f19d60c08479f6e61d42f7f285eb87 May 26 12:38:26.600178 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.600143 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" event={"ID":"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6","Type":"ContainerStarted","Data":"771c3d2430eeca3b93aed3c7eed7019c33a9f20864b0e3c85a15e7f8fec5c21c"} May 26 12:38:26.600178 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.600179 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" event={"ID":"da9fdd4b-0ea5-4a2f-82b7-1e70ca3937b6","Type":"ContainerStarted","Data":"6f9f637280b6f6bbb34c8155f921508987f19d60c08479f6e61d42f7f285eb87"} May 26 12:38:26.600628 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.600203 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:26.617102 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.617060 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" podStartSLOduration=1.617047583 podStartE2EDuration="1.617047583s" podCreationTimestamp="2026-05-26 12:38:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 12:38:26.616376285 +0000 UTC m=+4262.312364321" watchObservedRunningTime="2026-05-26 12:38:26.617047583 +0000 UTC m=+4262.313035617" May 26 12:38:26.750428 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.750403 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5hw5n_8770d97f-a72b-484e-adad-4d6aaf94ccf5/dns/0.log" May 26 12:38:26.770517 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.770488 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5hw5n_8770d97f-a72b-484e-adad-4d6aaf94ccf5/kube-rbac-proxy/0.log" May 26 12:38:26.877999 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:26.877939 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4jd2t_cc09abf0-cb77-4d17-a560-eaa1c8e1ff4b/dns-node-resolver/0.log" May 26 12:38:27.377198 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:27.377152 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2wvg7_f9660178-e587-4a86-8f62-9cd0d0c00bff/node-ca/0.log" May 26 12:38:28.084645 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:28.084617 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f86559754-rjjh7_108c5513-15ce-42a7-ad35-290f855779d1/router/0.log" May 26 12:38:28.465939 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:28.465839 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7kbt_74fb53b6-5b7a-4b1d-a25f-8ffc33071e7d/serve-healthcheck-canary/0.log" May 26 12:38:28.807273 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:28.807241 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-688p8_2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7/insights-operator/0.log" May 26 12:38:28.808390 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:28.808372 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-688p8_2ec8f60b-37b2-4944-aa0d-ebeb8ed812d7/insights-operator/1.log" May 26 12:38:28.946252 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:28.946228 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tzmnj_6ba5f17b-4318-4fc5-82b9-0a2b93191015/kube-rbac-proxy/0.log" May 26 12:38:28.965143 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:28.965117 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tzmnj_6ba5f17b-4318-4fc5-82b9-0a2b93191015/exporter/0.log" May 26 12:38:28.986409 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:28.986386 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tzmnj_6ba5f17b-4318-4fc5-82b9-0a2b93191015/extractor/0.log" May 26 12:38:31.496867 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:31.496833 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-8l8hv_b0bf938b-1752-4aa0-a313-e8209324bd34/s3-init/0.log" May 26 12:38:31.522317 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:31.522292 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-l2qzx_91289406-27cd-4e64-acc0-5ea1489893b2/s3-tls-init-custom/0.log" May 26 12:38:31.546865 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:31.546823 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-grllw_6aa349fe-14db-4fa7-86e6-ff0037fdbdab/s3-tls-init-serving/0.log" May 26 12:38:32.612244 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:32.612218 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-964gc/perf-node-gather-daemonset-7hbgn" May 26 12:38:36.821691 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:36.821669 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8r62z_ff5bcaeb-5c08-44ef-80db-805c692c448e/kube-multus/0.log" May 26 12:38:37.240077 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.240042 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdqzv_b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39/kube-multus-additional-cni-plugins/0.log" May 26 12:38:37.259110 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.259090 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdqzv_b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39/egress-router-binary-copy/0.log" May 26 12:38:37.277933 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.277914 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdqzv_b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39/cni-plugins/0.log" May 26 12:38:37.303767 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.303716 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdqzv_b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39/bond-cni-plugin/0.log" May 26 12:38:37.330739 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.330718 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdqzv_b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39/routeoverride-cni/0.log" May 26 12:38:37.349896 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.349881 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdqzv_b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39/whereabouts-cni-bincopy/0.log" May 26 12:38:37.369167 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.369151 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdqzv_b2e506cb-3f64-4c8b-aaf7-d25fe4e58b39/whereabouts-cni/0.log" May 26 12:38:37.467782 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.467757 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g4m6v_acb515e4-f4ef-437f-91bd-dadc3359247d/network-metrics-daemon/0.log" May 26 12:38:37.489022 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:37.489000 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g4m6v_acb515e4-f4ef-437f-91bd-dadc3359247d/kube-rbac-proxy/0.log" May 26 12:38:38.656974 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.656947 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-controller/0.log" May 26 12:38:38.676692 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.676672 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/0.log" May 26 12:38:38.696547 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.696524 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovn-acl-logging/1.log" May 26 12:38:38.715758 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.715739 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/kube-rbac-proxy-node/0.log" May 26 12:38:38.741783 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.741762 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/kube-rbac-proxy-ovn-metrics/0.log" May 26 12:38:38.758308 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.758288 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/northd/0.log" May 26 12:38:38.778999 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.778984 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/nbdb/0.log" May 26 12:38:38.798978 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.798958 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/sbdb/0.log" May 26 12:38:38.908608 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:38.908555 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqqr2_a46be309-5eae-4bf4-80b7-0a502bba5d91/ovnkube-controller/0.log" May 26 12:38:40.251342 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:40.251308 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-vsp5c_4f50b274-ac2a-44fd-825d-397c6863ece9/check-endpoints/0.log" May 26 12:38:40.316320 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:40.316290 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pf5kc_d453e52d-629c-4f97-b043-946bcf90cdb4/network-check-target-container/0.log" May 26 12:38:41.142679 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:41.142653 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9q4g2_e7976c98-bddc-4048-a62f-1a1dea4cfbf0/iptables-alerter/0.log" May 26 12:38:41.823864 ip-10-0-133-99 kubenswrapper[2551]: I0526 12:38:41.823807 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tqwph_251764ab-9b6f-46fb-b545-1959683a49f2/tuned/0.log"