May 28 17:41:10.032805 ip-10-0-132-117 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 17:41:10.032817 ip-10-0-132-117 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 17:41:10.032825 ip-10-0-132-117 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 17:41:10.033033 ip-10-0-132-117 systemd[1]: Failed to start Kubernetes Kubelet. May 28 17:41:19.360406 ip-10-0-132-117 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. May 28 17:41:19.360423 ip-10-0-132-117 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ab0ab8a78ce74922a26918e2d506e418 -- May 28 17:43:33.432098 ip-10-0-132-117 systemd[1]: Starting Kubernetes Kubelet... May 28 17:43:33.936063 ip-10-0-132-117 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:43:33.936063 ip-10-0-132-117 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 17:43:33.936063 ip-10-0-132-117 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:43:33.936063 ip-10-0-132-117 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 17:43:33.936063 ip-10-0-132-117 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 17:43:33.937862 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.937751 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 17:43:33.940741 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940727 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:43:33.940741 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940741 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940746 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940749 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940752 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940755 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940758 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940763 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940768 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940771 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940781 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940784 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940787 2563 feature_gate.go:328] unrecognized feature gate: Example May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940790 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940793 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940795 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940799 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940817 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940822 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:43:33.940818 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940826 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940829 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940832 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940836 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940840 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940843 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940846 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940849 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940851 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940854 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940856 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940859 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940861 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940864 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940866 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940869 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940871 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940874 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940877 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940880 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:43:33.941251 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940883 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940885 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940887 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940890 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940892 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940895 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940897 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940900 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940902 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940904 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940907 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940910 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940913 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940915 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940919 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940922 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940925 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940927 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940930 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940932 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:43:33.941735 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940934 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940937 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940940 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940942 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940945 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940947 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940950 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940953 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940955 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940958 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940960 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940963 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940968 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940972 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940976 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940979 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940982 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940984 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940987 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:43:33.942241 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940989 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940992 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940995 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.940997 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941000 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941003 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941005 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941009 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941406 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941411 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941414 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941417 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941420 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941422 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941425 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941429 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941432 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941435 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941438 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941440 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:43:33.942699 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941443 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941446 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941448 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941451 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941454 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941457 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941459 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941462 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941465 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941467 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941470 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941472 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941474 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941477 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941480 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941483 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941485 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941488 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941490 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941494 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:43:33.943227 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941497 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941499 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941502 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941504 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941507 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941510 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941512 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941515 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941517 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941520 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941522 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941525 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941527 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941530 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941532 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941534 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941537 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941539 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941542 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:43:33.943719 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941545 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941547 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941550 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941552 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941555 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941557 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941560 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941562 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941565 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941568 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941570 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941573 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941575 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941578 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941580 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941583 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941585 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941588 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941591 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:43:33.944191 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941593 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941595 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941598 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941600 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941604 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941606 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941609 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941611 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941614 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941616 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941618 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941621 2563 feature_gate.go:328] unrecognized feature gate: Example May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941625 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941629 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941632 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.941634 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943287 2563 flags.go:64] FLAG: --address="0.0.0.0" May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943297 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943304 2563 flags.go:64] FLAG: --anonymous-auth="true" May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943308 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943314 2563 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 17:43:33.944657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943318 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943322 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943328 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943331 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943334 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943337 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943341 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943344 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943347 2563 flags.go:64] FLAG: --cgroup-root="" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943350 2563 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943353 2563 flags.go:64] FLAG: --client-ca-file="" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943356 2563 flags.go:64] FLAG: --cloud-config="" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943359 2563 flags.go:64] FLAG: --cloud-provider="external" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943362 2563 flags.go:64] FLAG: --cluster-dns="[]" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943367 2563 flags.go:64] FLAG: --cluster-domain="" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943370 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943373 2563 flags.go:64] FLAG: --config-dir="" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943376 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943379 2563 flags.go:64] FLAG: --container-log-max-files="5" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943384 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943387 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943390 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943393 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943396 2563 flags.go:64] FLAG: --contention-profiling="false" May 28 17:43:33.945187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943399 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943403 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943406 2563 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943410 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943414 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943417 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943420 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943423 2563 flags.go:64] FLAG: --enable-load-reader="false" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943426 2563 flags.go:64] FLAG: --enable-server="true" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943430 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943435 2563 flags.go:64] FLAG: --event-burst="100" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943438 2563 flags.go:64] FLAG: --event-qps="50" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943441 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943444 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943447 2563 flags.go:64] FLAG: --eviction-hard="" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943451 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943454 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943457 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943460 2563 flags.go:64] FLAG: --eviction-soft="" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943463 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943466 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943469 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943472 2563 flags.go:64] FLAG: --experimental-mounter-path="" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943475 2563 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943478 2563 flags.go:64] FLAG: --fail-swap-on="true" May 28 17:43:33.945767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943481 2563 flags.go:64] FLAG: --feature-gates="" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943485 2563 flags.go:64] FLAG: --file-check-frequency="20s" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943489 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943492 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943495 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943498 2563 flags.go:64] FLAG: --healthz-port="10248" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943501 2563 flags.go:64] FLAG: --help="false" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943504 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-132-117.ec2.internal" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943508 2563 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943511 2563 flags.go:64] FLAG: --http-check-frequency="20s" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943514 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943519 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943522 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943525 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943528 2563 flags.go:64] FLAG: --image-service-endpoint="" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943531 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943535 2563 flags.go:64] FLAG: --kube-api-burst="100" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943538 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943541 2563 flags.go:64] FLAG: --kube-api-qps="50" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943544 2563 flags.go:64] FLAG: --kube-reserved="" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943547 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943550 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943553 2563 flags.go:64] FLAG: --kubelet-cgroups="" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943556 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 17:43:33.946392 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943559 2563 flags.go:64] FLAG: --lock-file="" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943562 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943565 2563 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943568 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943573 2563 flags.go:64] FLAG: --log-json-split-stream="false" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943576 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943579 2563 flags.go:64] FLAG: --log-text-split-stream="false" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943582 2563 flags.go:64] FLAG: --logging-format="text" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943585 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943588 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943592 2563 flags.go:64] FLAG: --manifest-url="" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943595 2563 flags.go:64] FLAG: --manifest-url-header="" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943599 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943602 2563 flags.go:64] FLAG: --max-open-files="1000000" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943607 2563 flags.go:64] FLAG: --max-pods="110" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943610 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943613 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943616 2563 flags.go:64] FLAG: --memory-manager-policy="None" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943620 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943623 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943626 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943629 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943637 2563 flags.go:64] FLAG: --node-status-max-images="50" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943640 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943643 2563 flags.go:64] FLAG: --oom-score-adj="-999" May 28 17:43:33.946976 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943646 2563 flags.go:64] FLAG: --pod-cidr="" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943649 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943655 2563 flags.go:64] FLAG: --pod-manifest-path="" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943658 2563 flags.go:64] FLAG: --pod-max-pids="-1" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943661 2563 flags.go:64] FLAG: --pods-per-core="0" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943664 2563 flags.go:64] FLAG: --port="10250" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943667 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943670 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01089366ce6edc069" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943673 2563 flags.go:64] FLAG: --qos-reserved="" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943676 2563 flags.go:64] FLAG: --read-only-port="10255" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943679 2563 flags.go:64] FLAG: --register-node="true" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943682 2563 flags.go:64] FLAG: --register-schedulable="true" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943685 2563 flags.go:64] FLAG: --register-with-taints="" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943688 2563 flags.go:64] FLAG: --registry-burst="10" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943691 2563 flags.go:64] FLAG: --registry-qps="5" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943694 2563 flags.go:64] FLAG: --reserved-cpus="" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943697 2563 flags.go:64] FLAG: --reserved-memory="" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943701 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943704 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943708 2563 flags.go:64] FLAG: --rotate-certificates="false" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943711 2563 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943714 2563 flags.go:64] FLAG: --runonce="false" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943717 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943720 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943723 2563 flags.go:64] FLAG: --seccomp-default="false" May 28 17:43:33.947611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943726 2563 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943730 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943733 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943736 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943740 2563 flags.go:64] FLAG: --storage-driver-password="root" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943747 2563 flags.go:64] FLAG: --storage-driver-secure="false" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943750 2563 flags.go:64] FLAG: --storage-driver-table="stats" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943753 2563 flags.go:64] FLAG: --storage-driver-user="root" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943756 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943759 2563 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943762 2563 flags.go:64] FLAG: --system-cgroups="" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943765 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943771 2563 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943773 2563 flags.go:64] FLAG: --tls-cert-file="" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943776 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943781 2563 flags.go:64] FLAG: --tls-min-version="" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943784 2563 flags.go:64] FLAG: --tls-private-key-file="" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943786 2563 flags.go:64] FLAG: --topology-manager-policy="none" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943789 2563 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943792 2563 flags.go:64] FLAG: --topology-manager-scope="container" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943795 2563 flags.go:64] FLAG: --v="2" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943800 2563 flags.go:64] FLAG: --version="false" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943817 2563 flags.go:64] FLAG: --vmodule="" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943823 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.943828 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 17:43:33.948346 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943925 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943928 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943931 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943934 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943938 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943941 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943944 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943947 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943949 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943952 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943955 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943958 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943962 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943964 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943967 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943970 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943972 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943975 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943978 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943981 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:43:33.948981 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943983 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943986 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943989 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943991 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943994 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943996 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.943999 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944002 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944004 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944007 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944009 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944013 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944016 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944018 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944021 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944023 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944026 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944028 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944031 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:43:33.949481 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944033 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944036 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944039 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944042 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944044 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944049 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944053 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944057 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944061 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944064 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944067 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944069 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944072 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944075 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944077 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944080 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944082 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944085 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944087 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:43:33.949967 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944090 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944092 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944095 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944097 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944100 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944106 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944109 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944111 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944114 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944116 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944119 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944122 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944125 2563 feature_gate.go:328] unrecognized feature gate: Example May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944127 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944130 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944132 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944136 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944139 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944143 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944146 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:43:33.950433 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944148 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:43:33.950993 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944151 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:43:33.950993 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944153 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:43:33.950993 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944156 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:43:33.950993 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944158 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:43:33.950993 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944161 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:43:33.950993 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944163 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:43:33.950993 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.944166 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:43:33.950993 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.944948 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:43:33.953799 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.953773 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 17:43:33.953799 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.953797 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953864 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953871 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953874 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953877 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953881 2563 feature_gate.go:328] unrecognized feature gate: Example May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953884 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953886 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953889 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953892 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953895 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953898 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953900 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953903 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953907 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953911 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953914 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953917 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953920 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:43:33.953959 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953923 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953925 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953928 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953930 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953933 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953935 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953938 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953941 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953944 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953947 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953949 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953952 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953954 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953957 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953960 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953963 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953966 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953968 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953971 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953974 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:43:33.954471 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953977 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953979 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953982 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953984 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953987 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953990 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953992 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953995 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.953998 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954019 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954022 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954025 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954028 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954031 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954033 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954036 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954038 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954041 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954044 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954047 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:43:33.954988 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954049 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954052 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954055 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954058 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954061 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954066 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954068 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954071 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954074 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954077 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954080 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954082 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954085 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954087 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954090 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954092 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954095 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954097 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954099 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:43:33.955470 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954102 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954105 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954108 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954110 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954113 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954116 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954118 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954121 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954123 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.954129 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954253 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954260 2563 feature_gate.go:328] unrecognized feature gate: Example May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954263 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954266 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954270 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954273 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 17:43:33.955951 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954276 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954279 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954281 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954284 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954287 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954290 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954294 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954298 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954300 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954303 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954306 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954308 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954311 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954313 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954316 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954319 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954322 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954324 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954327 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 17:43:33.956345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954329 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954331 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954334 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954337 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954339 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954342 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954344 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954347 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954349 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954352 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954355 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954357 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954360 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954363 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954365 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954369 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954373 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954376 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 17:43:33.956820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954378 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954381 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954384 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954386 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954389 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954391 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954394 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954396 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954399 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954401 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954403 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954406 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954414 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954416 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954419 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954421 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954424 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954426 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954429 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954431 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 17:43:33.957264 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954434 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954437 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954439 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954442 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954445 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954448 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954450 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954453 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954455 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954458 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954461 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954464 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954467 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954469 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954472 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954475 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954477 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954480 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954483 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954485 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 17:43:33.957745 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954488 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 17:43:33.958268 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954491 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 17:43:33.958268 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:33.954493 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 17:43:33.958268 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.954498 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 17:43:33.958268 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.955391 2563 server.go:962] "Client rotation is on, will bootstrap in background" May 28 17:43:33.960439 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.960425 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 17:43:33.961509 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.961498 2563 server.go:1019] "Starting client certificate rotation" May 28 17:43:33.961615 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.961598 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 17:43:33.961678 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.961645 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 17:43:33.990583 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.990556 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 17:43:33.992490 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:33.992464 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 17:43:34.010082 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.010057 2563 log.go:25] "Validated CRI v1 runtime API" May 28 17:43:34.018201 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.018181 2563 log.go:25] "Validated CRI v1 image API" May 28 17:43:34.019715 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.019693 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 17:43:34.021050 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.021033 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 17:43:34.026168 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.026149 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8768128b-2411-4f0a-8963-8e7d543b4703:/dev/nvme0n1p4 b6300e20-138a-454f-8e52-973b4dd4b733:/dev/nvme0n1p3] May 28 17:43:34.026250 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.026169 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 17:43:34.030580 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.030475 2563 manager.go:217] Machine: {Timestamp:2026-05-28 17:43:34.029953547 +0000 UTC m=+0.462952361 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098561 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dd7a4aee9e67b35ab781dcf571f6b SystemUUID:ec2dd7a4-aee9-e67b-35ab-781dcf571f6b BootID:ab0ab8a7-8ce7-4922-a269-18e2d506e418 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:4d:99:ef:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:4d:99:ef:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:3e:06:a4:bd:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 17:43:34.031641 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.031629 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 17:43:34.031762 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.031750 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 17:43:34.034023 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.034001 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 17:43:34.034161 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.034025 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 17:43:34.034208 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.034171 2563 topology_manager.go:138] "Creating topology manager with none policy" May 28 17:43:34.034208 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.034179 2563 container_manager_linux.go:306] "Creating device plugin manager" May 28 17:43:34.034208 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.034187 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 17:43:34.035116 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.035105 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 17:43:34.037311 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.037300 2563 state_mem.go:36] "Initialized new in-memory state store" May 28 17:43:34.037584 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.037575 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 17:43:34.040110 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.040100 2563 kubelet.go:491] "Attempting to sync node with API server" May 28 17:43:34.040145 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.040114 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 17:43:34.040145 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.040125 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 17:43:34.040145 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.040135 2563 kubelet.go:397] "Adding apiserver pod source" May 28 17:43:34.040145 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.040144 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 17:43:34.041406 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.041393 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 17:43:34.041452 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.041413 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 17:43:34.044623 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.044606 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l7zc4" May 28 17:43:34.045038 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.045019 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 17:43:34.047262 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.047248 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 17:43:34.048193 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048179 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048197 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048203 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048218 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048227 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048233 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048240 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048245 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048252 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 17:43:34.048258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048258 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 17:43:34.048496 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048272 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 17:43:34.048649 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.048640 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 17:43:34.049660 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.049650 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 17:43:34.049660 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.049660 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 17:43:34.051250 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.051232 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l7zc4" May 28 17:43:34.053112 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.053098 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 17:43:34.053170 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.053135 2563 server.go:1295] "Started kubelet" May 28 17:43:34.053232 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.053203 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 17:43:34.053317 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.053258 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 17:43:34.053372 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.053340 2563 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 17:43:34.053767 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.053724 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 17:43:34.053767 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.053726 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 17:43:34.053899 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.053884 2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 17:43:34.053901 ip-10-0-132-117 systemd[1]: Started Kubernetes Kubelet. May 28 17:43:34.055436 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.055419 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 17:43:34.056583 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.056561 2563 server.go:317] "Adding debug handlers to kubelet server" May 28 17:43:34.064288 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.064269 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 17:43:34.064414 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.064345 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 17:43:34.064605 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.064584 2563 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 17:43:34.064605 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.064601 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 17:43:34.064753 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.064741 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 17:43:34.064846 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.064835 2563 reconstruct.go:97] "Volume reconstruction finished" May 28 17:43:34.064914 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.064847 2563 reconciler.go:26] "Reconciler: start to sync state" May 28 17:43:34.065440 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.065400 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 17:43:34.065582 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.065566 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.066486 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.066464 2563 factory.go:55] Registering systemd factory May 28 17:43:34.066594 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.066577 2563 factory.go:223] Registration of the systemd container factory successfully May 28 17:43:34.066977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.066955 2563 factory.go:153] Registering CRI-O factory May 28 17:43:34.067059 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.066980 2563 factory.go:223] Registration of the crio container factory successfully May 28 17:43:34.067131 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.067088 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 17:43:34.067131 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.067109 2563 factory.go:103] Registering Raw factory May 28 17:43:34.067131 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.067125 2563 manager.go:1196] Started watching for new ooms in manager May 28 17:43:34.067605 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.067583 2563 manager.go:319] Starting recovery of all containers May 28 17:43:34.070283 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.070252 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal" May 28 17:43:34.070622 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.070606 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:43:34.077565 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.077552 2563 manager.go:324] Recovery completed May 28 17:43:34.081740 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.081723 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:43:34.083821 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.083791 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" May 28 17:43:34.083881 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.083835 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:43:34.083881 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.083846 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" May 28 17:43:34.084326 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.084313 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 17:43:34.084326 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.084325 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 17:43:34.084412 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.084341 2563 state_mem.go:36] "Initialized new in-memory state store" May 28 17:43:34.087827 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.087802 2563 policy_none.go:49] "None policy: Start" May 28 17:43:34.087875 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.087832 2563 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 17:43:34.087875 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.087842 2563 state_mem.go:35] "Initializing new in-memory state store" May 28 17:43:34.130445 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.130431 2563 manager.go:341] "Starting Device Plugin manager" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.130469 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.130480 2563 server.go:85] "Starting device plugin registration server" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.130755 2563 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.130769 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.130916 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.131019 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.131031 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.131511 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 17:43:34.146890 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.131545 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.180052 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.180017 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 17:43:34.181250 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.181231 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 17:43:34.181354 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.181261 2563 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 17:43:34.181354 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.181284 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 17:43:34.181354 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.181291 2563 kubelet.go:2451] "Starting kubelet main sync loop" May 28 17:43:34.181354 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.181331 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 17:43:34.183995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.183976 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:43:34.231700 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.231616 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:43:34.232767 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.232750 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" May 28 17:43:34.232888 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.232785 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:43:34.232888 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.232799 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" May 28 17:43:34.232888 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.232845 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-117.ec2.internal" May 28 17:43:34.240477 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.240460 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-117.ec2.internal" May 28 17:43:34.240556 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.240486 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-117.ec2.internal\": node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.251395 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.251371 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.282155 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.282130 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal"] May 28 17:43:34.282210 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.282193 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:43:34.283043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.283026 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" May 28 17:43:34.283123 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.283061 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:43:34.283123 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.283075 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" May 28 17:43:34.284281 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284266 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:43:34.284463 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284448 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:34.284517 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284481 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:43:34.284977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284951 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" May 28 17:43:34.284977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284963 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" May 28 17:43:34.284977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284980 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:43:34.285163 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284984 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:43:34.285163 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284995 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" May 28 17:43:34.285163 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.284995 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" May 28 17:43:34.286005 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.285990 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" May 28 17:43:34.286094 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.286019 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 17:43:34.286633 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.286621 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientMemory" May 28 17:43:34.286710 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.286648 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasNoDiskPressure" May 28 17:43:34.286710 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.286662 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeHasSufficientPID" May 28 17:43:34.303359 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.303337 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal" May 28 17:43:34.307682 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.307667 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-117.ec2.internal\" not found" node="ip-10-0-132-117.ec2.internal" May 28 17:43:34.351857 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.351835 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.366221 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.366198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88096c42e27e152af359a9fb2e9360d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"88096c42e27e152af359a9fb2e9360d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:34.366311 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.366225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88096c42e27e152af359a9fb2e9360d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"88096c42e27e152af359a9fb2e9360d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:34.366311 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.366256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dac997f939d98530aee128dc024cf247-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"dac997f939d98530aee128dc024cf247\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" May 28 17:43:34.452611 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.452576 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.466911 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.466887 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88096c42e27e152af359a9fb2e9360d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"88096c42e27e152af359a9fb2e9360d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:34.466977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.466919 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88096c42e27e152af359a9fb2e9360d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"88096c42e27e152af359a9fb2e9360d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:34.466977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.466935 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dac997f939d98530aee128dc024cf247-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"dac997f939d98530aee128dc024cf247\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" May 28 17:43:34.466977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.466967 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88096c42e27e152af359a9fb2e9360d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"88096c42e27e152af359a9fb2e9360d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:34.467084 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.466976 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88096c42e27e152af359a9fb2e9360d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal\" (UID: \"88096c42e27e152af359a9fb2e9360d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:34.467084 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.467002 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dac997f939d98530aee128dc024cf247-config\") pod \"kube-apiserver-proxy-ip-10-0-132-117.ec2.internal\" (UID: \"dac997f939d98530aee128dc024cf247\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" May 28 17:43:34.553344 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.553279 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.605747 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.605717 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:34.610493 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.610475 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" May 28 17:43:34.653945 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.653915 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.754476 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.754448 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.854980 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.854912 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.955559 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:34.955529 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:34.961678 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.961660 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 17:43:34.961852 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.961833 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 17:43:34.961891 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:34.961840 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 17:43:35.053598 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.053551 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 17:38:34 +0000 UTC" deadline="2027-12-10 18:58:06.162605934 +0000 UTC" May 28 17:43:35.053598 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.053589 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13465h14m31.109020811s" May 28 17:43:35.055640 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:35.055619 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:35.065167 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.065144 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 17:43:35.076084 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.076062 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 17:43:35.096692 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.096671 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bgnts" May 28 17:43:35.104487 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.104468 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bgnts" May 28 17:43:35.149964 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.149944 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:43:35.154765 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:35.154733 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac997f939d98530aee128dc024cf247.slice/crio-bf32912800d9be3b90d7091af68b3dfb26d64ad3624fd9ccce1a84d6207d4f13 WatchSource:0}: Error finding container bf32912800d9be3b90d7091af68b3dfb26d64ad3624fd9ccce1a84d6207d4f13: Status 404 returned error can't find the container with id bf32912800d9be3b90d7091af68b3dfb26d64ad3624fd9ccce1a84d6207d4f13 May 28 17:43:35.155039 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:35.155012 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88096c42e27e152af359a9fb2e9360d6.slice/crio-aa5f1c1342b1c13e131c0e41ebc14f989e307d320544571cbce600d0d20a1858 WatchSource:0}: Error finding container aa5f1c1342b1c13e131c0e41ebc14f989e307d320544571cbce600d0d20a1858: Status 404 returned error can't find the container with id aa5f1c1342b1c13e131c0e41ebc14f989e307d320544571cbce600d0d20a1858 May 28 17:43:35.156111 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:35.156084 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-117.ec2.internal\" not found" May 28 17:43:35.159580 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.159557 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:43:35.184230 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.184178 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"88096c42e27e152af359a9fb2e9360d6","Type":"ContainerStarted","Data":"aa5f1c1342b1c13e131c0e41ebc14f989e307d320544571cbce600d0d20a1858"} May 28 17:43:35.185121 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.185092 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" event={"ID":"dac997f939d98530aee128dc024cf247","Type":"ContainerStarted","Data":"bf32912800d9be3b90d7091af68b3dfb26d64ad3624fd9ccce1a84d6207d4f13"} May 28 17:43:35.224034 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.224009 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:43:35.265944 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.265914 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" May 28 17:43:35.277640 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.277622 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 17:43:35.278684 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.278671 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" May 28 17:43:35.286410 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.286396 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 17:43:35.966123 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.966091 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:43:35.976792 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:35.976765 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 17:43:36.041842 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.041785 2563 apiserver.go:52] "Watching apiserver" May 28 17:43:36.049840 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.049789 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 17:43:36.052277 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.052244 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2d8s6","openshift-multus/network-metrics-daemon-x4wkc","openshift-network-diagnostics/network-check-target-2f8n9","openshift-network-operator/iptables-alerter-tt8hm","kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal","openshift-multus/multus-9sbkj","openshift-multus/multus-additional-cni-plugins-8tqcj","openshift-ovn-kubernetes/ovnkube-node-sjcbp","kube-system/konnectivity-agent-4hnkd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn","openshift-cluster-node-tuning-operator/tuned-xntj6","openshift-dns/node-resolver-4mfs6"] May 28 17:43:36.055100 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.055074 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9sbkj" May 28 17:43:36.057132 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.057107 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:36.057226 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.057179 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:36.057588 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.057542 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 17:43:36.057675 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.057556 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8lrq8\"" May 28 17:43:36.057822 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.057790 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 17:43:36.057908 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.057796 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 17:43:36.057967 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.057926 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 17:43:36.059253 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.059156 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:36.059253 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.059214 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:36.061234 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.061213 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.063318 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.063299 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.063647 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.063628 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rdxpg\"" May 28 17:43:36.063883 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.063859 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 17:43:36.063975 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.063962 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 17:43:36.064083 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.064065 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 17:43:36.065501 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.065475 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.065621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.065601 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 17:43:36.066464 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.066442 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 17:43:36.066619 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.066599 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 17:43:36.066706 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.066681 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sx9fv\"" May 28 17:43:36.069124 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.069102 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 17:43:36.069340 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.069321 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gkwhx\"" May 28 17:43:36.069407 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.069379 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 17:43:36.071345 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.071325 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.071439 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.071351 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:36.074138 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.074118 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 17:43:36.074246 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.074123 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 17:43:36.074367 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.074348 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.074934 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pcj2d\"" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075037 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dwtzx\"" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075058 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075136 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075148 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075227 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075249 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44kwb\" (UniqueName: \"kubernetes.io/projected/60ec4c0e-688d-4645-906a-68cf86d27f13-kube-api-access-44kwb\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075340 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a44b540d-81bb-4cf5-a32d-6861afd0f572-cni-binary-copy\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.075440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-socket-dir-parent\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-etc-kubernetes\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgqcd\" (UniqueName: \"kubernetes.io/projected/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-kube-api-access-pgqcd\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-cni-binary-copy\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075597 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-os-release\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-cni-multus\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075653 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df8be263-b8a6-46ee-b37b-eb31a553634a-host-slash\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfq4c\" (UniqueName: \"kubernetes.io/projected/df8be263-b8a6-46ee-b37b-eb31a553634a-kube-api-access-qfq4c\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-os-release\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075744 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-cni-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-conf-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-k8s-cni-cncf-io\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076036 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-kubelet\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-multus-certs\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.075980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdp9t\" (UniqueName: \"kubernetes.io/projected/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-kube-api-access-xdp9t\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df8be263-b8a6-46ee-b37b-eb31a553634a-iptables-alerter-script\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-system-cni-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-cnibin\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-hostroot\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22prg\" (UniqueName: \"kubernetes.io/projected/a44b540d-81bb-4cf5-a32d-6861afd0f572-kube-api-access-22prg\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-system-cni-dir\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-netns\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-cni-bin\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076194 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-daemon-config\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-host\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076279 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-serviceca\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-cnibin\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.076748 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076613 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 17:43:36.077445 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076848 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 17:43:36.077445 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.076894 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.077445 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.077244 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vm4kr\"" May 28 17:43:36.077445 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.077303 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 17:43:36.079084 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.078885 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 17:43:36.079328 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.079263 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b64f4\"" May 28 17:43:36.079428 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.079374 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 17:43:36.079718 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.079700 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.082064 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.082045 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 17:43:36.082168 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.082152 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wf9zl\"" May 28 17:43:36.082298 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.082281 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 17:43:36.105339 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.105282 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:38:35 +0000 UTC" deadline="2028-01-31 00:48:06.158317158 +0000 UTC" May 28 17:43:36.105484 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.105470 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14695h4m30.052853303s" May 28 17:43:36.166025 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.165996 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 17:43:36.176963 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.176938 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-cnibin\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.177103 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.176971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-kubelet\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.177103 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.176991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-cni-netd\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.177103 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1-konnectivity-ca\") pod \"konnectivity-agent-4hnkd\" (UID: \"0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1\") " pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:36.177103 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177025 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44kwb\" (UniqueName: \"kubernetes.io/projected/60ec4c0e-688d-4645-906a-68cf86d27f13-kube-api-access-44kwb\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.177103 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-cnibin\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.177103 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177067 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a44b540d-81bb-4cf5-a32d-6861afd0f572-cni-binary-copy\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177416 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-run\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.177416 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb6zr\" (UniqueName: \"kubernetes.io/projected/2bedc7de-dbb5-40d9-ab84-deb742c89186-kube-api-access-xb6zr\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.177416 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177260 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgqcd\" (UniqueName: \"kubernetes.io/projected/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-kube-api-access-pgqcd\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.177416 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177289 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-cni-binary-copy\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.177577 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177418 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-os-release\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177577 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177495 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-os-release\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177577 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177490 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:36.177577 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177543 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df8be263-b8a6-46ee-b37b-eb31a553634a-host-slash\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.177711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177586 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfq4c\" (UniqueName: \"kubernetes.io/projected/df8be263-b8a6-46ee-b37b-eb31a553634a-kube-api-access-qfq4c\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.177711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df8be263-b8a6-46ee-b37b-eb31a553634a-host-slash\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.177711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-lib-modules\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.177711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-log-socket\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.177711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177656 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.177711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177681 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.177711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177699 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-cni-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-modprobe-d\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177730 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a44b540d-81bb-4cf5-a32d-6861afd0f572-cni-binary-copy\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-tuned\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177785 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-cni-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-etc-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177801 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177844 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-ovn\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177868 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-device-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177893 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-k8s-cni-cncf-io\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177918 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-kubelet\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177930 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-cni-binary-copy\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-k8s-cni-cncf-io\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.177995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.177984 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-kubelet\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178020 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-system-cni-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-host\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovnkube-config\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178082 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-system-cni-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovn-node-metrics-cert\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178132 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-system-cni-dir\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-var-lib-kubelet\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94wnz\" (UniqueName: \"kubernetes.io/projected/2ca25f65-c155-45c6-b206-6714cb9a734a-kube-api-access-94wnz\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178199 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-registration-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178209 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-system-cni-dir\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178228 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-host\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178298 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-host\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-sys\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9vwx\" (UniqueName: \"kubernetes.io/projected/23841ef9-37f7-44b2-adf3-6d5075b49e32-kube-api-access-q9vwx\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4gsr\" (UniqueName: \"kubernetes.io/projected/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-kube-api-access-f4gsr\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.178646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178407 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-systemd\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca25f65-c155-45c6-b206-6714cb9a734a-tmp\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-slash\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-run-netns\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178638 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178665 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-socket-dir-parent\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178717 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-socket-dir-parent\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178732 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-etc-kubernetes\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178768 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-etc-kubernetes\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178760 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-kubernetes\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178843 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-systemd-units\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-node-log\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-cni-bin\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.178887 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovnkube-script-lib\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.179348 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/60ec4c0e-688d-4645-906a-68cf86d27f13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178938 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-cni-multus\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-systemd\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-cni-multus\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.178994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.179034 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:36.679001152 +0000 UTC m=+3.111999963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179075 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-os-release\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179101 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-conf-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysctl-conf\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179147 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-multus-certs\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179172 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdp9t\" (UniqueName: \"kubernetes.io/projected/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-kube-api-access-xdp9t\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179181 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-conf-dir\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179198 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df8be263-b8a6-46ee-b37b-eb31a553634a-iptables-alerter-script\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60ec4c0e-688d-4645-906a-68cf86d27f13-os-release\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23841ef9-37f7-44b2-adf3-6d5075b49e32-tmp-dir\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179252 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-multus-certs\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180043 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179263 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-cnibin\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179306 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-hostroot\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179332 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22prg\" (UniqueName: \"kubernetes.io/projected/a44b540d-81bb-4cf5-a32d-6861afd0f572-kube-api-access-22prg\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-var-lib-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1-agent-certs\") pod \"konnectivity-agent-4hnkd\" (UID: \"0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1\") " pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179412 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-netns\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179427 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-cni-bin\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179484 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-run-netns\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179517 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-hostroot\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-cnibin\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179524 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-daemon-config\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179561 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a44b540d-81bb-4cf5-a32d-6861afd0f572-host-var-lib-cni-bin\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23841ef9-37f7-44b2-adf3-6d5075b49e32-hosts-file\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-env-overrides\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-socket-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179676 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-serviceca\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysconfig\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179702 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df8be263-b8a6-46ee-b37b-eb31a553634a-iptables-alerter-script\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.180624 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysctl-d\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.181356 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.181356 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-sys-fs\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.181356 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.179999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a44b540d-81bb-4cf5-a32d-6861afd0f572-multus-daemon-config\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.181356 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.180137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-serviceca\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.186680 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.186660 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:43:36.186802 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.186686 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:43:36.186802 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.186702 2563 projected.go:194] Error preparing data for projected volume kube-api-access-c2qcw for pod openshift-network-diagnostics/network-check-target-2f8n9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:36.186802 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.186779 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw podName:1e26ee36-e72a-4fd9-a8aa-1b06c1240433 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:36.686761331 +0000 UTC m=+3.119760145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c2qcw" (UniqueName: "kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw") pod "network-check-target-2f8n9" (UID: "1e26ee36-e72a-4fd9-a8aa-1b06c1240433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:36.186972 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.186847 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 17:43:36.190528 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.190456 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgqcd\" (UniqueName: \"kubernetes.io/projected/7abdcaed-ff92-4f4b-88ec-bc8f69df88ca-kube-api-access-pgqcd\") pod \"node-ca-2d8s6\" (UID: \"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca\") " pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.190528 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.190474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44kwb\" (UniqueName: \"kubernetes.io/projected/60ec4c0e-688d-4645-906a-68cf86d27f13-kube-api-access-44kwb\") pod \"multus-additional-cni-plugins-8tqcj\" (UID: \"60ec4c0e-688d-4645-906a-68cf86d27f13\") " pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.190528 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.190478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdp9t\" (UniqueName: \"kubernetes.io/projected/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-kube-api-access-xdp9t\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:36.190528 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.190472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfq4c\" (UniqueName: \"kubernetes.io/projected/df8be263-b8a6-46ee-b37b-eb31a553634a-kube-api-access-qfq4c\") pod \"iptables-alerter-tt8hm\" (UID: \"df8be263-b8a6-46ee-b37b-eb31a553634a\") " pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.190528 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.190478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22prg\" (UniqueName: \"kubernetes.io/projected/a44b540d-81bb-4cf5-a32d-6861afd0f572-kube-api-access-22prg\") pod \"multus-9sbkj\" (UID: \"a44b540d-81bb-4cf5-a32d-6861afd0f572\") " pod="openshift-multus/multus-9sbkj" May 28 17:43:36.280731 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280643 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-var-lib-kubelet\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.280731 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280677 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94wnz\" (UniqueName: \"kubernetes.io/projected/2ca25f65-c155-45c6-b206-6714cb9a734a-kube-api-access-94wnz\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.280731 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280694 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-registration-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.280731 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280719 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-sys\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280744 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9vwx\" (UniqueName: \"kubernetes.io/projected/23841ef9-37f7-44b2-adf3-6d5075b49e32-kube-api-access-q9vwx\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280769 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4gsr\" (UniqueName: \"kubernetes.io/projected/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-kube-api-access-f4gsr\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-var-lib-kubelet\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280794 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-systemd\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280833 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca25f65-c155-45c6-b206-6714cb9a734a-tmp\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-sys\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280897 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-systemd\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280903 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-slash\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280857 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-slash\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-registration-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.280964 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-run-netns\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281012 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-run-netns\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281057 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281105 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-kubernetes\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281152 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-systemd-units\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281178 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-node-log\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281149 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281204 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-cni-bin\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-systemd-units\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-node-log\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281229 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovnkube-script-lib\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-cni-bin\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-kubernetes\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281287 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-systemd\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281316 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-systemd\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281335 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281366 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysctl-conf\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281389 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23841ef9-37f7-44b2-adf3-6d5075b49e32-tmp-dir\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281412 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.281621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281417 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-var-lib-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-var-lib-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281463 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1-agent-certs\") pod \"konnectivity-agent-4hnkd\" (UID: \"0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1\") " pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281498 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23841ef9-37f7-44b2-adf3-6d5075b49e32-hosts-file\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysctl-conf\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281535 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-env-overrides\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281559 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-socket-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281584 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysconfig\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281607 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysctl-d\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281632 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281658 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-sys-fs\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281673 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23841ef9-37f7-44b2-adf3-6d5075b49e32-tmp-dir\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281683 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-kubelet\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281714 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-cni-netd\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281738 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1-konnectivity-ca\") pod \"konnectivity-agent-4hnkd\" (UID: \"0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1\") " pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281761 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-run\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281753 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysconfig\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.282332 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281788 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xb6zr\" (UniqueName: \"kubernetes.io/projected/2bedc7de-dbb5-40d9-ab84-deb742c89186-kube-api-access-xb6zr\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23841ef9-37f7-44b2-adf3-6d5075b49e32-hosts-file\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281853 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-lib-modules\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281883 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-log-socket\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-sysctl-d\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281894 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovnkube-script-lib\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281921 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-modprobe-d\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281950 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-tuned\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281957 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-sys-fs\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281953 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-cni-netd\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281989 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-etc-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.282014 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-ovn\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.282035 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-device-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.282897 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.282946 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.282983 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-host\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.283045 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.283017 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovnkube-config\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.283718 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.283071 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovn-node-metrics-cert\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.283718 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.283540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-modprobe-d\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.283822 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.283741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca25f65-c155-45c6-b206-6714cb9a734a-tmp\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.283902 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.283859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.283902 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.282709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1-konnectivity-ca\") pod \"konnectivity-agent-4hnkd\" (UID: \"0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1\") " pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:36.283902 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.283887 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-socket-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.284037 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.282777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-run\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.284037 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.283951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-kubelet\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.284037 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-log-socket\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.284037 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-etc-openvswitch\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.284249 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.281760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.284249 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284067 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-run-ovn\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.284249 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.283967 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.284249 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1-agent-certs\") pod \"konnectivity-agent-4hnkd\" (UID: \"0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1\") " pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:36.284249 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284173 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-lib-modules\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.284249 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284178 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ca25f65-c155-45c6-b206-6714cb9a734a-host\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.284514 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284332 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bedc7de-dbb5-40d9-ab84-deb742c89186-device-dir\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.284556 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-env-overrides\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.284729 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.284698 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovnkube-config\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.286437 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.285463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-ovn-node-metrics-cert\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.287699 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.287674 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ca25f65-c155-45c6-b206-6714cb9a734a-etc-tuned\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.289592 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.289539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9vwx\" (UniqueName: \"kubernetes.io/projected/23841ef9-37f7-44b2-adf3-6d5075b49e32-kube-api-access-q9vwx\") pod \"node-resolver-4mfs6\" (UID: \"23841ef9-37f7-44b2-adf3-6d5075b49e32\") " pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.290029 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.289996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94wnz\" (UniqueName: \"kubernetes.io/projected/2ca25f65-c155-45c6-b206-6714cb9a734a-kube-api-access-94wnz\") pod \"tuned-xntj6\" (UID: \"2ca25f65-c155-45c6-b206-6714cb9a734a\") " pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.290285 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.290264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4gsr\" (UniqueName: \"kubernetes.io/projected/3a83df30-b02c-400e-b1d5-e9a4b9aad7ab-kube-api-access-f4gsr\") pod \"ovnkube-node-sjcbp\" (UID: \"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.290531 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.290507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb6zr\" (UniqueName: \"kubernetes.io/projected/2bedc7de-dbb5-40d9-ab84-deb742c89186-kube-api-access-xb6zr\") pod \"aws-ebs-csi-driver-node-zdfxn\" (UID: \"2bedc7de-dbb5-40d9-ab84-deb742c89186\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.369525 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.369484 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9sbkj" May 28 17:43:36.379213 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.379184 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tt8hm" May 28 17:43:36.388843 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.388817 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2d8s6" May 28 17:43:36.394382 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.394361 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" May 28 17:43:36.402029 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.402010 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:43:36.408671 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.408647 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:36.416297 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.416278 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" May 28 17:43:36.425902 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.425881 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xntj6" May 28 17:43:36.429422 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.429404 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4mfs6" May 28 17:43:36.685279 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.685250 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:36.685410 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.685350 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:36.685410 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.685407 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:37.685390196 +0000 UTC m=+4.118389001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:36.786389 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:36.786354 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:36.786556 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.786502 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:43:36.786556 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.786522 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:43:36.786556 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.786534 2563 projected.go:194] Error preparing data for projected volume kube-api-access-c2qcw for pod openshift-network-diagnostics/network-check-target-2f8n9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:36.786704 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:36.786591 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw podName:1e26ee36-e72a-4fd9-a8aa-1b06c1240433 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:37.786572645 +0000 UTC m=+4.219571462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2qcw" (UniqueName: "kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw") pod "network-check-target-2f8n9" (UID: "1e26ee36-e72a-4fd9-a8aa-1b06c1240433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:36.800637 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.800613 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e638c0d_3915_4cdf_a5e4_bf2e60e2daa1.slice/crio-598c07ac60cedcd7e29125ee5e005f71ecd292f912effa5471ebe89636a67a5e WatchSource:0}: Error finding container 598c07ac60cedcd7e29125ee5e005f71ecd292f912effa5471ebe89636a67a5e: Status 404 returned error can't find the container with id 598c07ac60cedcd7e29125ee5e005f71ecd292f912effa5471ebe89636a67a5e May 28 17:43:36.801769 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.801706 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23841ef9_37f7_44b2_adf3_6d5075b49e32.slice/crio-d50d199e32ae032c918c4c521a2c1f813c6d92d4af1c78755fb32a87304dbf1d WatchSource:0}: Error finding container d50d199e32ae032c918c4c521a2c1f813c6d92d4af1c78755fb32a87304dbf1d: Status 404 returned error can't find the container with id d50d199e32ae032c918c4c521a2c1f813c6d92d4af1c78755fb32a87304dbf1d May 28 17:43:36.802484 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.802458 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abdcaed_ff92_4f4b_88ec_bc8f69df88ca.slice/crio-b7d50f285a72ebdb5f7d6ff06a5d748122eb0c652f7ced459d62b354851a007a WatchSource:0}: Error finding container b7d50f285a72ebdb5f7d6ff06a5d748122eb0c652f7ced459d62b354851a007a: Status 404 returned error can't find the container with id b7d50f285a72ebdb5f7d6ff06a5d748122eb0c652f7ced459d62b354851a007a May 28 17:43:36.806450 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.806268 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a83df30_b02c_400e_b1d5_e9a4b9aad7ab.slice/crio-7418436c3914d064bcc19902fc4db28059b5fd575ebb3d69395646c31bb47d27 WatchSource:0}: Error finding container 7418436c3914d064bcc19902fc4db28059b5fd575ebb3d69395646c31bb47d27: Status 404 returned error can't find the container with id 7418436c3914d064bcc19902fc4db28059b5fd575ebb3d69395646c31bb47d27 May 28 17:43:36.829549 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.829528 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8be263_b8a6_46ee_b37b_eb31a553634a.slice/crio-b8fd855868ab25281fdf936de493b112d6ee9aa753ac8bc32fdcae0ccc85350d WatchSource:0}: Error finding container b8fd855868ab25281fdf936de493b112d6ee9aa753ac8bc32fdcae0ccc85350d: Status 404 returned error can't find the container with id b8fd855868ab25281fdf936de493b112d6ee9aa753ac8bc32fdcae0ccc85350d May 28 17:43:36.831069 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.831049 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bedc7de_dbb5_40d9_ab84_deb742c89186.slice/crio-4ad83901b5250167d81b7b5767760cf04350df8857d0138060e7e85b5d820a3a WatchSource:0}: Error finding container 4ad83901b5250167d81b7b5767760cf04350df8857d0138060e7e85b5d820a3a: Status 404 returned error can't find the container with id 4ad83901b5250167d81b7b5767760cf04350df8857d0138060e7e85b5d820a3a May 28 17:43:36.831852 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.831798 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca25f65_c155_45c6_b206_6714cb9a734a.slice/crio-51e20a358e152b58d90f6eb11846bcb00323fb4bc15a06ea40992697978c43bf WatchSource:0}: Error finding container 51e20a358e152b58d90f6eb11846bcb00323fb4bc15a06ea40992697978c43bf: Status 404 returned error can't find the container with id 51e20a358e152b58d90f6eb11846bcb00323fb4bc15a06ea40992697978c43bf May 28 17:43:36.832838 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.832686 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ec4c0e_688d_4645_906a_68cf86d27f13.slice/crio-f7d5fde6e25a4e77d1d07686f83faa79e5ccca2104b3c1aa33933944606ffdc7 WatchSource:0}: Error finding container f7d5fde6e25a4e77d1d07686f83faa79e5ccca2104b3c1aa33933944606ffdc7: Status 404 returned error can't find the container with id f7d5fde6e25a4e77d1d07686f83faa79e5ccca2104b3c1aa33933944606ffdc7 May 28 17:43:36.833595 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:43:36.833578 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44b540d_81bb_4cf5_a32d_6861afd0f572.slice/crio-dbe3b95a4d90c4463b22bbbc7baac2c796be28933b9597260a646b50ee137ce8 WatchSource:0}: Error finding container dbe3b95a4d90c4463b22bbbc7baac2c796be28933b9597260a646b50ee137ce8: Status 404 returned error can't find the container with id dbe3b95a4d90c4463b22bbbc7baac2c796be28933b9597260a646b50ee137ce8 May 28 17:43:37.105701 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.105675 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:38:35 +0000 UTC" deadline="2028-01-26 14:37:59.376705247 +0000 UTC" May 28 17:43:37.105701 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.105701 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14588h54m22.271006416s" May 28 17:43:37.190143 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.188485 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2d8s6" event={"ID":"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca","Type":"ContainerStarted","Data":"b7d50f285a72ebdb5f7d6ff06a5d748122eb0c652f7ced459d62b354851a007a"} May 28 17:43:37.190780 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.190727 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4mfs6" event={"ID":"23841ef9-37f7-44b2-adf3-6d5075b49e32","Type":"ContainerStarted","Data":"d50d199e32ae032c918c4c521a2c1f813c6d92d4af1c78755fb32a87304dbf1d"} May 28 17:43:37.192235 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.192212 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hnkd" event={"ID":"0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1","Type":"ContainerStarted","Data":"598c07ac60cedcd7e29125ee5e005f71ecd292f912effa5471ebe89636a67a5e"} May 28 17:43:37.195359 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.195336 2563 generic.go:358] "Generic (PLEG): container finished" podID="88096c42e27e152af359a9fb2e9360d6" containerID="3ec59785b203dafa9a9a17ed7d84d5c838ef2b984230b01fa44d46f065b3c605" exitCode=0 May 28 17:43:37.195873 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.195849 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"88096c42e27e152af359a9fb2e9360d6","Type":"ContainerDied","Data":"3ec59785b203dafa9a9a17ed7d84d5c838ef2b984230b01fa44d46f065b3c605"} May 28 17:43:37.199691 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.199659 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9sbkj" event={"ID":"a44b540d-81bb-4cf5-a32d-6861afd0f572","Type":"ContainerStarted","Data":"dbe3b95a4d90c4463b22bbbc7baac2c796be28933b9597260a646b50ee137ce8"} May 28 17:43:37.201955 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.201922 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" event={"ID":"60ec4c0e-688d-4645-906a-68cf86d27f13","Type":"ContainerStarted","Data":"f7d5fde6e25a4e77d1d07686f83faa79e5ccca2104b3c1aa33933944606ffdc7"} May 28 17:43:37.203096 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.203059 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tt8hm" event={"ID":"df8be263-b8a6-46ee-b37b-eb31a553634a","Type":"ContainerStarted","Data":"b8fd855868ab25281fdf936de493b112d6ee9aa753ac8bc32fdcae0ccc85350d"} May 28 17:43:37.205081 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.204578 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" event={"ID":"dac997f939d98530aee128dc024cf247","Type":"ContainerStarted","Data":"e48b2e36be75700d65f921a13f0ace286a8f8a45a88026baf1881ad83f34f18e"} May 28 17:43:37.208087 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.208054 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xntj6" event={"ID":"2ca25f65-c155-45c6-b206-6714cb9a734a","Type":"ContainerStarted","Data":"51e20a358e152b58d90f6eb11846bcb00323fb4bc15a06ea40992697978c43bf"} May 28 17:43:37.209919 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.209852 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" event={"ID":"2bedc7de-dbb5-40d9-ab84-deb742c89186","Type":"ContainerStarted","Data":"4ad83901b5250167d81b7b5767760cf04350df8857d0138060e7e85b5d820a3a"} May 28 17:43:37.212176 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.212151 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"7418436c3914d064bcc19902fc4db28059b5fd575ebb3d69395646c31bb47d27"} May 28 17:43:37.227873 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.227154 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-117.ec2.internal" podStartSLOduration=2.227139743 podStartE2EDuration="2.227139743s" podCreationTimestamp="2026-05-28 17:43:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:43:37.226738498 +0000 UTC m=+3.659737313" watchObservedRunningTime="2026-05-28 17:43:37.227139743 +0000 UTC m=+3.660138566" May 28 17:43:37.693903 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.693859 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:37.694077 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:37.694014 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:37.694132 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:37.694078 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:39.694058067 +0000 UTC m=+6.127056876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:37.795053 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:37.795013 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:37.795245 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:37.795211 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:43:37.795245 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:37.795231 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:43:37.795245 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:37.795243 2563 projected.go:194] Error preparing data for projected volume kube-api-access-c2qcw for pod openshift-network-diagnostics/network-check-target-2f8n9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:37.795410 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:37.795303 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw podName:1e26ee36-e72a-4fd9-a8aa-1b06c1240433 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:39.795284697 +0000 UTC m=+6.228283506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2qcw" (UniqueName: "kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw") pod "network-check-target-2f8n9" (UID: "1e26ee36-e72a-4fd9-a8aa-1b06c1240433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:38.184355 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:38.183700 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:38.184355 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:38.183730 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:38.184355 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:38.183901 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:38.184355 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:38.184003 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:38.240775 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:38.240709 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" event={"ID":"88096c42e27e152af359a9fb2e9360d6","Type":"ContainerStarted","Data":"2f01ea0b8acd638a4adf039343cc686f154f433519178506499e8606806c83ff"} May 28 17:43:38.252412 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:38.252354 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-117.ec2.internal" podStartSLOduration=3.252335269 podStartE2EDuration="3.252335269s" podCreationTimestamp="2026-05-28 17:43:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:43:38.251747036 +0000 UTC m=+4.684745860" watchObservedRunningTime="2026-05-28 17:43:38.252335269 +0000 UTC m=+4.685334095" May 28 17:43:39.713713 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:39.713153 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:39.713713 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:39.713317 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:39.713713 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:39.713379 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:43.713361051 +0000 UTC m=+10.146359859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:39.814878 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:39.814219 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:39.814878 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:39.814418 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:43:39.814878 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:39.814436 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:43:39.814878 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:39.814449 2563 projected.go:194] Error preparing data for projected volume kube-api-access-c2qcw for pod openshift-network-diagnostics/network-check-target-2f8n9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:39.814878 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:39.814507 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw podName:1e26ee36-e72a-4fd9-a8aa-1b06c1240433 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:43.814487898 +0000 UTC m=+10.247486707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2qcw" (UniqueName: "kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw") pod "network-check-target-2f8n9" (UID: "1e26ee36-e72a-4fd9-a8aa-1b06c1240433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:40.182306 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:40.182268 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:40.182497 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:40.182416 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:40.182967 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:40.182828 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:40.182967 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:40.182922 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:42.182506 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:42.182468 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:42.182956 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:42.182608 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:42.183015 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:42.182975 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:42.183108 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:42.183080 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:43.745887 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:43.745846 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:43.746358 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:43.746000 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:43.746358 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:43.746070 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:51.746050893 +0000 UTC m=+18.179049711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:43.846554 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:43.846502 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:43.846724 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:43.846678 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:43:43.846724 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:43.846703 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:43:43.846724 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:43.846716 2563 projected.go:194] Error preparing data for projected volume kube-api-access-c2qcw for pod openshift-network-diagnostics/network-check-target-2f8n9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:43.846915 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:43.846782 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw podName:1e26ee36-e72a-4fd9-a8aa-1b06c1240433 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:51.84676229 +0000 UTC m=+18.279761106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2qcw" (UniqueName: "kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw") pod "network-check-target-2f8n9" (UID: "1e26ee36-e72a-4fd9-a8aa-1b06c1240433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:44.181613 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:44.181581 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:44.181770 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:44.181722 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:44.182186 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:44.182167 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:44.182295 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:44.182269 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:46.181858 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:46.181824 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:46.182292 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:46.181873 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:46.182292 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:46.181952 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:46.182292 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:46.182031 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:48.181921 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:48.181887 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:48.181921 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:48.181901 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:48.182439 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:48.182006 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:48.182439 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:48.182119 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:50.181955 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:50.181917 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:50.182390 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:50.181933 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:50.182390 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:50.182056 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:50.182390 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:50.182145 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:51.802062 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:51.802015 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:51.802517 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:51.802139 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:51.802517 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:51.802211 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:07.802194315 +0000 UTC m=+34.235193120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:43:51.903356 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:51.903323 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:51.903519 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:51.903466 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:43:51.903519 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:51.903489 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:43:51.903519 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:51.903503 2563 projected.go:194] Error preparing data for projected volume kube-api-access-c2qcw for pod openshift-network-diagnostics/network-check-target-2f8n9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:51.903665 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:51.903564 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw podName:1e26ee36-e72a-4fd9-a8aa-1b06c1240433 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:07.903549177 +0000 UTC m=+34.336547986 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2qcw" (UniqueName: "kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw") pod "network-check-target-2f8n9" (UID: "1e26ee36-e72a-4fd9-a8aa-1b06c1240433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:43:52.182124 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:52.182088 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:52.182318 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:52.182126 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:52.182318 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:52.182247 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:52.182457 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:52.182362 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:53.443358 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.443324 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fwn49"] May 28 17:43:53.618579 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.618535 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:53.618733 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:53.618632 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwn49" podUID="1b2f0d38-33c1-49f3-9408-73201c526810" May 28 17:43:53.717708 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.717633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b2f0d38-33c1-49f3-9408-73201c526810-kubelet-config\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:53.717708 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.717679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b2f0d38-33c1-49f3-9408-73201c526810-dbus\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:53.717938 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.717732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:53.819054 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.818991 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b2f0d38-33c1-49f3-9408-73201c526810-kubelet-config\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:53.819054 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.819043 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b2f0d38-33c1-49f3-9408-73201c526810-dbus\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:53.819291 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.819093 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:53.819291 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.819129 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b2f0d38-33c1-49f3-9408-73201c526810-kubelet-config\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:53.819291 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:53.819213 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:43:53.819291 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:53.819277 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret podName:1b2f0d38-33c1-49f3-9408-73201c526810 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:54.319259119 +0000 UTC m=+20.752257940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret") pod "global-pull-secret-syncer-fwn49" (UID: "1b2f0d38-33c1-49f3-9408-73201c526810") : object "kube-system"/"original-pull-secret" not registered May 28 17:43:53.819471 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:53.819292 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b2f0d38-33c1-49f3-9408-73201c526810-dbus\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:54.184462 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:54.184431 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:54.184597 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:54.184532 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:54.184634 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:54.184431 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:54.184704 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:54.184684 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:54.321855 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:54.321797 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:54.322018 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:54.321943 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:43:54.322018 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:54.322008 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret podName:1b2f0d38-33c1-49f3-9408-73201c526810 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:55.321992528 +0000 UTC m=+21.754991330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret") pod "global-pull-secret-syncer-fwn49" (UID: "1b2f0d38-33c1-49f3-9408-73201c526810") : object "kube-system"/"original-pull-secret" not registered May 28 17:43:55.181751 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.181461 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:55.182295 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:55.181854 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwn49" podUID="1b2f0d38-33c1-49f3-9408-73201c526810" May 28 17:43:55.275977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.275858 2563 generic.go:358] "Generic (PLEG): container finished" podID="60ec4c0e-688d-4645-906a-68cf86d27f13" containerID="f9e96a5a2aa38fcecddfc47e47cfa92f118b0b5a40ac396c854e46e89efc06de" exitCode=0 May 28 17:43:55.275977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.275901 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" event={"ID":"60ec4c0e-688d-4645-906a-68cf86d27f13","Type":"ContainerDied","Data":"f9e96a5a2aa38fcecddfc47e47cfa92f118b0b5a40ac396c854e46e89efc06de"} May 28 17:43:55.280056 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.280003 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xntj6" event={"ID":"2ca25f65-c155-45c6-b206-6714cb9a734a","Type":"ContainerStarted","Data":"a830f7c864ebba6f3618d88cf411f80a101bc30aece6775a1f7175bf4a5e8b82"} May 28 17:43:55.287260 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.287230 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" event={"ID":"2bedc7de-dbb5-40d9-ab84-deb742c89186","Type":"ContainerStarted","Data":"11ae03c47997447d4cfd8d2a140f1bef59379af69bf7c1964854c1c64e42e620"} May 28 17:43:55.290578 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.290545 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"76010bd28c711276a2daf5dc0cfeec32b2049472be20c9df8a42db3f9cdb07ea"} May 28 17:43:55.290683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.290584 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"05157674ef40629dc38aabb13c60e50529c89f57a18a7dd71a597df010b1e33c"} May 28 17:43:55.290683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.290599 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"f60bca9f27f8f2782b91d5dc2b94e4593ec871c91627138e809bff87b4e9552c"} May 28 17:43:55.290683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.290613 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"f5006171d6fd6a256356e6a91310813dc5aa645ef568ba1e46e82e2cfc890436"} May 28 17:43:55.290683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.290624 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"25c5628d4b5a6d81b8302a437fe49920740e786d35326de097c44667691d1fb5"} May 28 17:43:55.290683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.290632 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"19e1be9c5287e8a55d9bddcdf945ee66fe6c0d5cc1941617cc0a8e57c6d95f18"} May 28 17:43:55.292092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.292065 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2d8s6" event={"ID":"7abdcaed-ff92-4f4b-88ec-bc8f69df88ca","Type":"ContainerStarted","Data":"c676b0940ca4118efb6decc7a5e1346c8e94e5c6c69aab16f7cac50ea1a064c4"} May 28 17:43:55.293427 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.293382 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4mfs6" event={"ID":"23841ef9-37f7-44b2-adf3-6d5075b49e32","Type":"ContainerStarted","Data":"9817fc61f50485587165d5af7521adafb08a6928f4335d4be9bbf468baa9e069"} May 28 17:43:55.294859 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.294825 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hnkd" event={"ID":"0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1","Type":"ContainerStarted","Data":"17828a3f93dace396ce9ced652a2974db7a25778f251b2c54975048af7603ebe"} May 28 17:43:55.296570 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.296283 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9sbkj" event={"ID":"a44b540d-81bb-4cf5-a32d-6861afd0f572","Type":"ContainerStarted","Data":"539376430b64161aa35d4f9e3a20c88acd17c620f57bda9ecda21cf999ac554d"} May 28 17:43:55.314144 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.314090 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xntj6" podStartSLOduration=3.472515111 podStartE2EDuration="21.314073315s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.836838851 +0000 UTC m=+3.269837656" lastFinishedPulling="2026-05-28 17:43:54.678397054 +0000 UTC m=+21.111395860" observedRunningTime="2026-05-28 17:43:55.313882365 +0000 UTC m=+21.746881189" watchObservedRunningTime="2026-05-28 17:43:55.314073315 +0000 UTC m=+21.747072140" May 28 17:43:55.330601 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.330573 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:55.331236 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:55.330886 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:43:55.331236 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:55.330952 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret podName:1b2f0d38-33c1-49f3-9408-73201c526810 nodeName:}" failed. No retries permitted until 2026-05-28 17:43:57.330934568 +0000 UTC m=+23.763933371 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret") pod "global-pull-secret-syncer-fwn49" (UID: "1b2f0d38-33c1-49f3-9408-73201c526810") : object "kube-system"/"original-pull-secret" not registered May 28 17:43:55.339931 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.339887 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-4mfs6" podStartSLOduration=3.495156024 podStartE2EDuration="21.339873818s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.804702832 +0000 UTC m=+3.237701635" lastFinishedPulling="2026-05-28 17:43:54.649420613 +0000 UTC m=+21.082419429" observedRunningTime="2026-05-28 17:43:55.327266805 +0000 UTC m=+21.760265640" watchObservedRunningTime="2026-05-28 17:43:55.339873818 +0000 UTC m=+21.772872642" May 28 17:43:55.340040 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.339982 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2d8s6" podStartSLOduration=11.506822989 podStartE2EDuration="21.339974159s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.805192666 +0000 UTC m=+3.238191467" lastFinishedPulling="2026-05-28 17:43:46.638343834 +0000 UTC m=+13.071342637" observedRunningTime="2026-05-28 17:43:55.339493009 +0000 UTC m=+21.772491857" watchObservedRunningTime="2026-05-28 17:43:55.339974159 +0000 UTC m=+21.772972985" May 28 17:43:55.351885 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.351848 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4hnkd" podStartSLOduration=3.478802219 podStartE2EDuration="21.351832859s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.803458282 +0000 UTC m=+3.236457099" lastFinishedPulling="2026-05-28 17:43:54.676488937 +0000 UTC m=+21.109487739" observedRunningTime="2026-05-28 17:43:55.351510311 +0000 UTC m=+21.784509136" watchObservedRunningTime="2026-05-28 17:43:55.351832859 +0000 UTC m=+21.784831683" May 28 17:43:55.801547 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:55.801524 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 17:43:56.142280 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.142086 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T17:43:55.801541237Z","UUID":"1e4bf764-652f-4fda-aff2-04048263ce39","Handler":null,"Name":"","Endpoint":""} May 28 17:43:56.143936 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.143917 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 17:43:56.144067 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.143945 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 17:43:56.181949 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.181916 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:56.182303 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.181916 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:56.182303 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:56.182026 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:56.182303 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:56.182083 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:56.299321 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.299234 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tt8hm" event={"ID":"df8be263-b8a6-46ee-b37b-eb31a553634a","Type":"ContainerStarted","Data":"1a2ee206574f587a4d8d3ef1434050c1ba04430522b17b1b93c616236e309729"} May 28 17:43:56.301044 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.301011 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" event={"ID":"2bedc7de-dbb5-40d9-ab84-deb742c89186","Type":"ContainerStarted","Data":"9be7fe33191fbabfedc8450d3c192d4297aea7a02819e6509bde016aae0a8d24"} May 28 17:43:56.317420 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.317364 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tt8hm" podStartSLOduration=4.471904999 podStartE2EDuration="22.317349581s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.831167088 +0000 UTC m=+3.264165890" lastFinishedPulling="2026-05-28 17:43:54.676611655 +0000 UTC m=+21.109610472" observedRunningTime="2026-05-28 17:43:56.316921609 +0000 UTC m=+22.749920435" watchObservedRunningTime="2026-05-28 17:43:56.317349581 +0000 UTC m=+22.750348406" May 28 17:43:56.317562 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:56.317493 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-9sbkj" podStartSLOduration=4.466703101 podStartE2EDuration="22.317488649s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.836975583 +0000 UTC m=+3.269974385" lastFinishedPulling="2026-05-28 17:43:54.687761128 +0000 UTC m=+21.120759933" observedRunningTime="2026-05-28 17:43:55.366865946 +0000 UTC m=+21.799864770" watchObservedRunningTime="2026-05-28 17:43:56.317488649 +0000 UTC m=+22.750487452" May 28 17:43:57.181758 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:57.181585 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:57.181929 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:57.181852 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwn49" podUID="1b2f0d38-33c1-49f3-9408-73201c526810" May 28 17:43:57.305136 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:57.305090 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" event={"ID":"2bedc7de-dbb5-40d9-ab84-deb742c89186","Type":"ContainerStarted","Data":"c3ef92a6e7ca8123ba05cacce8b5ee29b9b08781807d604a358b3278b1f474fc"} May 28 17:43:57.322388 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:57.322330 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdfxn" podStartSLOduration=3.515245833 podStartE2EDuration="23.322316555s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.83325854 +0000 UTC m=+3.266257341" lastFinishedPulling="2026-05-28 17:43:56.64032925 +0000 UTC m=+23.073328063" observedRunningTime="2026-05-28 17:43:57.321577529 +0000 UTC m=+23.754576352" watchObservedRunningTime="2026-05-28 17:43:57.322316555 +0000 UTC m=+23.755315393" May 28 17:43:57.344781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:57.344743 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:57.344958 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:57.344936 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:43:57.345024 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:57.345013 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret podName:1b2f0d38-33c1-49f3-9408-73201c526810 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:01.344990014 +0000 UTC m=+27.777988819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret") pod "global-pull-secret-syncer-fwn49" (UID: "1b2f0d38-33c1-49f3-9408-73201c526810") : object "kube-system"/"original-pull-secret" not registered May 28 17:43:58.182027 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:58.181993 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:43:58.182235 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:58.181998 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:43:58.182235 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:58.182125 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:43:58.182235 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:58.182155 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:43:58.310427 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:58.310383 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"dd0c48b0e21e54fb1e55b439ca6a20413f6bef0e563461648a8c36068ac63f08"} May 28 17:43:58.359116 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:58.359082 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:58.359710 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:58.359683 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:59.181599 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:59.181566 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:43:59.181792 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:43:59.181679 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwn49" podUID="1b2f0d38-33c1-49f3-9408-73201c526810" May 28 17:43:59.311848 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:59.311816 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4hnkd" May 28 17:43:59.312397 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:43:59.312286 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4hnkd" May 28 17:44:00.181732 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:00.181699 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:00.181933 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:00.181699 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:44:00.181933 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:00.181840 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:44:00.182060 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:00.181931 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:44:01.181994 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.181819 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:01.182552 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:01.182061 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwn49" podUID="1b2f0d38-33c1-49f3-9408-73201c526810" May 28 17:44:01.316527 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.316489 2563 generic.go:358] "Generic (PLEG): container finished" podID="60ec4c0e-688d-4645-906a-68cf86d27f13" containerID="405338c10294b877e1604658eb83b6a23d8557f1713b57b821eff18a73bef7c2" exitCode=0 May 28 17:44:01.316676 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.316582 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" event={"ID":"60ec4c0e-688d-4645-906a-68cf86d27f13","Type":"ContainerDied","Data":"405338c10294b877e1604658eb83b6a23d8557f1713b57b821eff18a73bef7c2"} May 28 17:44:01.319867 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.319838 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" event={"ID":"3a83df30-b02c-400e-b1d5-e9a4b9aad7ab","Type":"ContainerStarted","Data":"a7f1ef9e69988920f4610f15b56103135c6345b3d20184da2b60ec9198cbbe72"} May 28 17:44:01.320117 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.320099 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:44:01.320198 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.320128 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:44:01.320198 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.320153 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:44:01.335821 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.335779 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:44:01.335934 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.335903 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:44:01.359431 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.359392 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" podStartSLOduration=9.461591376 podStartE2EDuration="27.359379813s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.828585621 +0000 UTC m=+3.261584433" lastFinishedPulling="2026-05-28 17:43:54.726374065 +0000 UTC m=+21.159372870" observedRunningTime="2026-05-28 17:44:01.358784139 +0000 UTC m=+27.791782964" watchObservedRunningTime="2026-05-28 17:44:01.359379813 +0000 UTC m=+27.792378636" May 28 17:44:01.373986 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:01.373606 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:01.373986 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:01.373847 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 17:44:01.373986 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:01.373919 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret podName:1b2f0d38-33c1-49f3-9408-73201c526810 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:09.373898821 +0000 UTC m=+35.806897636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret") pod "global-pull-secret-syncer-fwn49" (UID: "1b2f0d38-33c1-49f3-9408-73201c526810") : object "kube-system"/"original-pull-secret" not registered May 28 17:44:02.181495 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:02.181451 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:44:02.181668 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:02.181565 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:44:02.181668 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:02.181612 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:02.181779 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:02.181696 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:44:02.604012 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:02.603775 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4wkc"] May 28 17:44:02.604446 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:02.604038 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:44:02.604446 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:02.604145 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:44:02.607037 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:02.607011 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2f8n9"] May 28 17:44:02.607139 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:02.607096 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:02.607196 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:02.607179 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:44:02.622138 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:02.620538 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fwn49"] May 28 17:44:02.622138 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:02.620657 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:02.622138 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:02.620781 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwn49" podUID="1b2f0d38-33c1-49f3-9408-73201c526810" May 28 17:44:03.324463 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:03.324429 2563 generic.go:358] "Generic (PLEG): container finished" podID="60ec4c0e-688d-4645-906a-68cf86d27f13" containerID="2daf59e63d86f1cac33874442d849ebea848784fc356b1c05551f155c048462b" exitCode=0 May 28 17:44:03.324616 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:03.324520 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" event={"ID":"60ec4c0e-688d-4645-906a-68cf86d27f13","Type":"ContainerDied","Data":"2daf59e63d86f1cac33874442d849ebea848784fc356b1c05551f155c048462b"} May 28 17:44:04.183314 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:04.183284 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:04.183664 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:04.183389 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:44:04.183785 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:04.183766 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:44:04.183919 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:04.183895 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:44:04.184010 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:04.183950 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:04.184079 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:04.184060 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwn49" podUID="1b2f0d38-33c1-49f3-9408-73201c526810" May 28 17:44:04.328477 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:04.328444 2563 generic.go:358] "Generic (PLEG): container finished" podID="60ec4c0e-688d-4645-906a-68cf86d27f13" containerID="8d224524ab3a5b59b6c3d64bb79a8e2145ac5eb3b49cc297656d2ae9e889afb1" exitCode=0 May 28 17:44:04.328627 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:04.328501 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" event={"ID":"60ec4c0e-688d-4645-906a-68cf86d27f13","Type":"ContainerDied","Data":"8d224524ab3a5b59b6c3d64bb79a8e2145ac5eb3b49cc297656d2ae9e889afb1"} May 28 17:44:06.182331 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:06.182299 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:06.183024 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:06.182436 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:06.183024 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:06.182443 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f8n9" podUID="1e26ee36-e72a-4fd9-a8aa-1b06c1240433" May 28 17:44:06.183024 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:06.182540 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwn49" podUID="1b2f0d38-33c1-49f3-9408-73201c526810" May 28 17:44:06.183024 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:06.182584 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:44:06.183024 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:06.182639 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:44:07.368854 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.368822 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-117.ec2.internal" event="NodeReady" May 28 17:44:07.369388 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.368964 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 17:44:07.412880 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.412839 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z69bn"] May 28 17:44:07.438556 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.438526 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pjtf4"] May 28 17:44:07.438768 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.438701 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.441219 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.441195 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 17:44:07.441353 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.441246 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 17:44:07.441429 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.441359 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v9cdg\"" May 28 17:44:07.454888 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.454867 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z69bn"] May 28 17:44:07.455016 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.454894 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pjtf4"] May 28 17:44:07.455016 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.455000 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:07.457363 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.457342 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 17:44:07.457468 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.457362 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 17:44:07.457468 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.457342 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 17:44:07.457468 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.457416 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8dtch\"" May 28 17:44:07.519683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.519593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.519683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.519636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hzvw\" (UniqueName: \"kubernetes.io/projected/36f49167-c818-4f84-8dcb-d0f68511b082-kube-api-access-2hzvw\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.519683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.519666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36f49167-c818-4f84-8dcb-d0f68511b082-tmp-dir\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.519983 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.519784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36f49167-c818-4f84-8dcb-d0f68511b082-config-volume\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.519983 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.519843 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:07.519983 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.519869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scpnm\" (UniqueName: \"kubernetes.io/projected/8b49ae9f-d277-4747-a106-62a9b587b50f-kube-api-access-scpnm\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:07.621092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.621054 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.621275 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.621098 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hzvw\" (UniqueName: \"kubernetes.io/projected/36f49167-c818-4f84-8dcb-d0f68511b082-kube-api-access-2hzvw\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.621275 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.621129 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36f49167-c818-4f84-8dcb-d0f68511b082-tmp-dir\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.621275 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.621180 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36f49167-c818-4f84-8dcb-d0f68511b082-config-volume\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.621275 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.621208 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:44:07.621275 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.621225 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:07.621275 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.621250 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scpnm\" (UniqueName: \"kubernetes.io/projected/8b49ae9f-d277-4747-a106-62a9b587b50f-kube-api-access-scpnm\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:07.621275 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.621278 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls podName:36f49167-c818-4f84-8dcb-d0f68511b082 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:08.121259264 +0000 UTC m=+34.554258088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls") pod "dns-default-z69bn" (UID: "36f49167-c818-4f84-8dcb-d0f68511b082") : secret "dns-default-metrics-tls" not found May 28 17:44:07.621629 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.621608 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:44:07.621752 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.621677 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert podName:8b49ae9f-d277-4747-a106-62a9b587b50f nodeName:}" failed. No retries permitted until 2026-05-28 17:44:08.12166072 +0000 UTC m=+34.554659525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert") pod "ingress-canary-pjtf4" (UID: "8b49ae9f-d277-4747-a106-62a9b587b50f") : secret "canary-serving-cert" not found May 28 17:44:07.621834 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.621748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36f49167-c818-4f84-8dcb-d0f68511b082-tmp-dir\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.621961 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.621944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36f49167-c818-4f84-8dcb-d0f68511b082-config-volume\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.633915 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.633894 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hzvw\" (UniqueName: \"kubernetes.io/projected/36f49167-c818-4f84-8dcb-d0f68511b082-kube-api-access-2hzvw\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:07.634039 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.633997 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scpnm\" (UniqueName: \"kubernetes.io/projected/8b49ae9f-d277-4747-a106-62a9b587b50f-kube-api-access-scpnm\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:07.822867 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.822765 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:44:07.823052 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.822963 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:44:07.823052 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.823050 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:39.82302805 +0000 UTC m=+66.256026865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 17:44:07.923340 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:07.923295 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:07.923512 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.923429 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 17:44:07.923512 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.923442 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 17:44:07.923512 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.923451 2563 projected.go:194] Error preparing data for projected volume kube-api-access-c2qcw for pod openshift-network-diagnostics/network-check-target-2f8n9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:44:07.923512 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:07.923508 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw podName:1e26ee36-e72a-4fd9-a8aa-1b06c1240433 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:39.923494292 +0000 UTC m=+66.356493099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c2qcw" (UniqueName: "kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw") pod "network-check-target-2f8n9" (UID: "1e26ee36-e72a-4fd9-a8aa-1b06c1240433") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 17:44:08.125427 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.125318 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:08.125606 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.125437 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:08.125606 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:08.125461 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:44:08.125606 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:08.125546 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls podName:36f49167-c818-4f84-8dcb-d0f68511b082 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:09.125523961 +0000 UTC m=+35.558522806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls") pod "dns-default-z69bn" (UID: "36f49167-c818-4f84-8dcb-d0f68511b082") : secret "dns-default-metrics-tls" not found May 28 17:44:08.125606 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:08.125559 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:44:08.125790 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:08.125647 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert podName:8b49ae9f-d277-4747-a106-62a9b587b50f nodeName:}" failed. No retries permitted until 2026-05-28 17:44:09.12563145 +0000 UTC m=+35.558630255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert") pod "ingress-canary-pjtf4" (UID: "8b49ae9f-d277-4747-a106-62a9b587b50f") : secret "canary-serving-cert" not found May 28 17:44:08.181796 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.181760 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:08.181977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.181759 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:44:08.181977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.181759 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:08.184567 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.184540 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 17:44:08.184567 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.184557 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wt76\"" May 28 17:44:08.184567 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.184560 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 17:44:08.184883 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.184864 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 17:44:08.185002 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.184915 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7tvx\"" May 28 17:44:08.185002 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:08.184948 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 17:44:09.132896 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:09.132856 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:09.133434 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:09.132943 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:09.133434 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:09.133021 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:44:09.133434 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:09.133081 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert podName:8b49ae9f-d277-4747-a106-62a9b587b50f nodeName:}" failed. No retries permitted until 2026-05-28 17:44:11.133064497 +0000 UTC m=+37.566063299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert") pod "ingress-canary-pjtf4" (UID: "8b49ae9f-d277-4747-a106-62a9b587b50f") : secret "canary-serving-cert" not found May 28 17:44:09.133434 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:09.133081 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:44:09.133434 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:09.133147 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls podName:36f49167-c818-4f84-8dcb-d0f68511b082 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:11.133128938 +0000 UTC m=+37.566127763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls") pod "dns-default-z69bn" (UID: "36f49167-c818-4f84-8dcb-d0f68511b082") : secret "dns-default-metrics-tls" not found May 28 17:44:09.435091 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:09.435054 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:09.437759 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:09.437731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b2f0d38-33c1-49f3-9408-73201c526810-original-pull-secret\") pod \"global-pull-secret-syncer-fwn49\" (UID: \"1b2f0d38-33c1-49f3-9408-73201c526810\") " pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:09.706895 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:09.706789 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwn49" May 28 17:44:10.241923 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:10.241662 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fwn49"] May 28 17:44:10.309345 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:44:10.309308 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2f0d38_33c1_49f3_9408_73201c526810.slice/crio-5ce7fada102ae26d54c0e85656e707210c4e14d2ff6b62b72dbc2da28eb85a07 WatchSource:0}: Error finding container 5ce7fada102ae26d54c0e85656e707210c4e14d2ff6b62b72dbc2da28eb85a07: Status 404 returned error can't find the container with id 5ce7fada102ae26d54c0e85656e707210c4e14d2ff6b62b72dbc2da28eb85a07 May 28 17:44:10.341089 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:10.341055 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fwn49" event={"ID":"1b2f0d38-33c1-49f3-9408-73201c526810","Type":"ContainerStarted","Data":"5ce7fada102ae26d54c0e85656e707210c4e14d2ff6b62b72dbc2da28eb85a07"} May 28 17:44:11.148731 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:11.148682 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:11.148904 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:11.148743 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:11.148904 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:11.148854 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:44:11.148904 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:11.148882 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:44:11.149056 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:11.148918 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert podName:8b49ae9f-d277-4747-a106-62a9b587b50f nodeName:}" failed. No retries permitted until 2026-05-28 17:44:15.148899215 +0000 UTC m=+41.581898034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert") pod "ingress-canary-pjtf4" (UID: "8b49ae9f-d277-4747-a106-62a9b587b50f") : secret "canary-serving-cert" not found May 28 17:44:11.149056 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:11.148936 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls podName:36f49167-c818-4f84-8dcb-d0f68511b082 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:15.148928092 +0000 UTC m=+41.581926894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls") pod "dns-default-z69bn" (UID: "36f49167-c818-4f84-8dcb-d0f68511b082") : secret "dns-default-metrics-tls" not found May 28 17:44:11.346017 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:11.345973 2563 generic.go:358] "Generic (PLEG): container finished" podID="60ec4c0e-688d-4645-906a-68cf86d27f13" containerID="65fe1c0bcfcae21ab09529e0dc50040ae922abe1138627112abfcbdf49a832eb" exitCode=0 May 28 17:44:11.346431 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:11.346022 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" event={"ID":"60ec4c0e-688d-4645-906a-68cf86d27f13","Type":"ContainerDied","Data":"65fe1c0bcfcae21ab09529e0dc50040ae922abe1138627112abfcbdf49a832eb"} May 28 17:44:12.352562 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:12.352472 2563 generic.go:358] "Generic (PLEG): container finished" podID="60ec4c0e-688d-4645-906a-68cf86d27f13" containerID="90557904e4c92136e6449af162ffc0e58c91c89220bb981c10ef7f3426f32e58" exitCode=0 May 28 17:44:12.352562 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:12.352518 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" event={"ID":"60ec4c0e-688d-4645-906a-68cf86d27f13","Type":"ContainerDied","Data":"90557904e4c92136e6449af162ffc0e58c91c89220bb981c10ef7f3426f32e58"} May 28 17:44:13.358289 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:13.358064 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" event={"ID":"60ec4c0e-688d-4645-906a-68cf86d27f13","Type":"ContainerStarted","Data":"554256ba6525569a5761878e72e216b81010db560b2200f8b0c408f933dfe9f6"} May 28 17:44:13.380454 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:13.380413 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8tqcj" podStartSLOduration=5.873016793 podStartE2EDuration="39.380396118s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:43:36.836881564 +0000 UTC m=+3.269880373" lastFinishedPulling="2026-05-28 17:44:10.344260893 +0000 UTC m=+36.777259698" observedRunningTime="2026-05-28 17:44:13.378715999 +0000 UTC m=+39.811714824" watchObservedRunningTime="2026-05-28 17:44:13.380396118 +0000 UTC m=+39.813394945" May 28 17:44:14.361468 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:14.361438 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fwn49" event={"ID":"1b2f0d38-33c1-49f3-9408-73201c526810","Type":"ContainerStarted","Data":"c1627c8405b78107cda974f54b0066b26b8b445a546c9ddf623b7e472dea28e9"} May 28 17:44:15.178336 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:15.178300 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:15.178544 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:15.178363 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:15.178544 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:15.178465 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:44:15.178544 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:15.178525 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls podName:36f49167-c818-4f84-8dcb-d0f68511b082 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:23.178506977 +0000 UTC m=+49.611505783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls") pod "dns-default-z69bn" (UID: "36f49167-c818-4f84-8dcb-d0f68511b082") : secret "dns-default-metrics-tls" not found May 28 17:44:15.178716 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:15.178466 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:44:15.178716 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:15.178600 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert podName:8b49ae9f-d277-4747-a106-62a9b587b50f nodeName:}" failed. No retries permitted until 2026-05-28 17:44:23.178587222 +0000 UTC m=+49.611586023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert") pod "ingress-canary-pjtf4" (UID: "8b49ae9f-d277-4747-a106-62a9b587b50f") : secret "canary-serving-cert" not found May 28 17:44:15.377413 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:15.377361 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fwn49" podStartSLOduration=18.462697491 podStartE2EDuration="22.377347989s" podCreationTimestamp="2026-05-28 17:43:53 +0000 UTC" firstStartedPulling="2026-05-28 17:44:10.322324389 +0000 UTC m=+36.755323190" lastFinishedPulling="2026-05-28 17:44:14.236974886 +0000 UTC m=+40.669973688" observedRunningTime="2026-05-28 17:44:15.37710394 +0000 UTC m=+41.810102765" watchObservedRunningTime="2026-05-28 17:44:15.377347989 +0000 UTC m=+41.810346813" May 28 17:44:23.233866 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:23.233792 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:23.234350 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:23.233900 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:23.234350 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:23.233929 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:44:23.234350 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:23.233995 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls podName:36f49167-c818-4f84-8dcb-d0f68511b082 nodeName:}" failed. No retries permitted until 2026-05-28 17:44:39.233979626 +0000 UTC m=+65.666978428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls") pod "dns-default-z69bn" (UID: "36f49167-c818-4f84-8dcb-d0f68511b082") : secret "dns-default-metrics-tls" not found May 28 17:44:23.234350 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:23.233995 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:44:23.234350 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:23.234020 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert podName:8b49ae9f-d277-4747-a106-62a9b587b50f nodeName:}" failed. No retries permitted until 2026-05-28 17:44:39.234014714 +0000 UTC m=+65.667013515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert") pod "ingress-canary-pjtf4" (UID: "8b49ae9f-d277-4747-a106-62a9b587b50f") : secret "canary-serving-cert" not found May 28 17:44:33.340998 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:33.340963 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcbp" May 28 17:44:39.243603 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.243569 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:44:39.243995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.243647 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:44:39.243995 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:39.243744 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:44:39.243995 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:39.243801 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert podName:8b49ae9f-d277-4747-a106-62a9b587b50f nodeName:}" failed. No retries permitted until 2026-05-28 17:45:11.243786882 +0000 UTC m=+97.676785683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert") pod "ingress-canary-pjtf4" (UID: "8b49ae9f-d277-4747-a106-62a9b587b50f") : secret "canary-serving-cert" not found May 28 17:44:39.243995 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:39.243744 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:44:39.243995 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:39.243868 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls podName:36f49167-c818-4f84-8dcb-d0f68511b082 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:11.243855303 +0000 UTC m=+97.676854117 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls") pod "dns-default-z69bn" (UID: "36f49167-c818-4f84-8dcb-d0f68511b082") : secret "dns-default-metrics-tls" not found May 28 17:44:39.848978 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.848937 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:44:39.851611 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.851586 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 17:44:39.859985 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:39.859968 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 17:44:39.860079 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:44:39.860028 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:43.860008202 +0000 UTC m=+130.293007003 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : secret "metrics-daemon-secret" not found May 28 17:44:39.949977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.949935 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:39.952531 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.952508 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 17:44:39.962617 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.962595 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 17:44:39.975391 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.975362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2qcw\" (UniqueName: \"kubernetes.io/projected/1e26ee36-e72a-4fd9-a8aa-1b06c1240433-kube-api-access-c2qcw\") pod \"network-check-target-2f8n9\" (UID: \"1e26ee36-e72a-4fd9-a8aa-1b06c1240433\") " pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:39.996381 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:39.996355 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7tvx\"" May 28 17:44:40.004213 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:40.004186 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:40.119107 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:40.119038 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2f8n9"] May 28 17:44:40.410238 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:40.410145 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2f8n9" event={"ID":"1e26ee36-e72a-4fd9-a8aa-1b06c1240433","Type":"ContainerStarted","Data":"7a10dad39945be84700a22de3fb24b56eff9e60a48722fd01ff2c476d58bc1f8"} May 28 17:44:43.416789 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:43.416645 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2f8n9" event={"ID":"1e26ee36-e72a-4fd9-a8aa-1b06c1240433","Type":"ContainerStarted","Data":"bc82e875d992939bdfe9c26419d879d74c8be003a73ac2855f6897f5b04f558f"} May 28 17:44:43.416789 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:43.416767 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:44:43.431716 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:44:43.431671 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2f8n9" podStartSLOduration=66.557830159 podStartE2EDuration="1m9.431658063s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:44:40.124313526 +0000 UTC m=+66.557312327" lastFinishedPulling="2026-05-28 17:44:42.998141429 +0000 UTC m=+69.431140231" observedRunningTime="2026-05-28 17:44:43.43099032 +0000 UTC m=+69.863989146" watchObservedRunningTime="2026-05-28 17:44:43.431658063 +0000 UTC m=+69.864656884" May 28 17:45:11.274131 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:11.274073 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:45:11.274131 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:11.274130 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:45:11.274650 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:11.274214 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 17:45:11.274650 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:11.274229 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 17:45:11.274650 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:11.274302 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls podName:36f49167-c818-4f84-8dcb-d0f68511b082 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:15.274287717 +0000 UTC m=+161.707286524 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls") pod "dns-default-z69bn" (UID: "36f49167-c818-4f84-8dcb-d0f68511b082") : secret "dns-default-metrics-tls" not found May 28 17:45:11.274650 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:11.274315 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert podName:8b49ae9f-d277-4747-a106-62a9b587b50f nodeName:}" failed. No retries permitted until 2026-05-28 17:46:15.274309583 +0000 UTC m=+161.707308384 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert") pod "ingress-canary-pjtf4" (UID: "8b49ae9f-d277-4747-a106-62a9b587b50f") : secret "canary-serving-cert" not found May 28 17:45:14.421327 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:14.421290 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2f8n9" May 28 17:45:43.900549 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:43.900511 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:45:43.901027 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:43.900652 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 17:45:43.901027 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:43.900709 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs podName:9c4db03d-65d8-4ba9-92fa-e7d7b1381230 nodeName:}" failed. No retries permitted until 2026-05-28 17:47:45.900693911 +0000 UTC m=+252.333692714 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs") pod "network-metrics-daemon-x4wkc" (UID: "9c4db03d-65d8-4ba9-92fa-e7d7b1381230") : secret "metrics-daemon-secret" not found May 28 17:45:44.664102 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.664063 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7dfkj"] May 28 17:45:44.667012 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.666987 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.668345 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.668324 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6"] May 28 17:45:44.669419 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.669398 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 28 17:45:44.669513 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.669446 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 17:45:44.670406 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.670380 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 17:45:44.670406 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.670383 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tpsvc\"" May 28 17:45:44.670578 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.670393 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 28 17:45:44.671031 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.671012 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:44.673667 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.673642 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 28 17:45:44.673768 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.673673 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 28 17:45:44.673866 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.673849 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 28 17:45:44.674525 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.674173 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gvhmg\"" May 28 17:45:44.675231 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.675215 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 28 17:45:44.681936 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.681918 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7dfkj"] May 28 17:45:44.682784 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.682767 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6"] May 28 17:45:44.763862 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.763832 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g"] May 28 17:45:44.766651 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.766631 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:44.767097 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.767059 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-6rswz"] May 28 17:45:44.769203 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.769185 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 28 17:45:44.769731 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.769708 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:44.770178 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.770156 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 17:45:44.770295 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.770274 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-skz46\"" May 28 17:45:44.770342 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.770318 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 17:45:44.771328 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.771313 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 28 17:45:44.771650 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.771636 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 28 17:45:44.771650 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.771646 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 28 17:45:44.771782 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.771696 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4sd9j\"" May 28 17:45:44.772103 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.772081 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 28 17:45:44.772193 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.772115 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 28 17:45:44.774735 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.774671 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g"] May 28 17:45:44.777016 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.776996 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 28 17:45:44.778070 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.778050 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-6rswz"] May 28 17:45:44.805628 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.805603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzjr\" (UniqueName: \"kubernetes.io/projected/6b4195ee-f463-44b4-af7e-7f697a381e3c-kube-api-access-tvzjr\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:44.805728 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.805633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k78zt\" (UniqueName: \"kubernetes.io/projected/de241f6a-5709-4975-813e-cab401a8ceb2-kube-api-access-k78zt\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.805728 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.805681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:44.805728 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.805697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de241f6a-5709-4975-813e-cab401a8ceb2-tmp\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.805728 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.805716 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de241f6a-5709-4975-813e-cab401a8ceb2-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.805915 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.805732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de241f6a-5709-4975-813e-cab401a8ceb2-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.805915 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.805747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de241f6a-5709-4975-813e-cab401a8ceb2-serving-cert\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.805915 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.805779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de241f6a-5709-4975-813e-cab401a8ceb2-snapshots\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.862820 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.862767 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh"] May 28 17:45:44.865914 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.865897 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:44.868309 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.868286 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 28 17:45:44.868444 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.868329 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 28 17:45:44.868444 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.868353 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 28 17:45:44.868943 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.868919 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 28 17:45:44.869084 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.868982 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4gt47\"" May 28 17:45:44.869492 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.869475 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx"] May 28 17:45:44.875399 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.875365 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx" May 28 17:45:44.876316 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.876298 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh"] May 28 17:45:44.877391 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.877370 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xtc5k\"" May 28 17:45:44.879455 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.879436 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx"] May 28 17:45:44.906937 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.906909 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de241f6a-5709-4975-813e-cab401a8ceb2-serving-cert\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.906937 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.906940 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de241f6a-5709-4975-813e-cab401a8ceb2-snapshots\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.906974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7bd135b-f3ca-44c0-afa1-be54c56dab99-config\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.906991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4n2d\" (UniqueName: \"kubernetes.io/projected/0081fed8-eeb2-44f1-927d-b3d66fc16c87-kube-api-access-n4n2d\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907013 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzjr\" (UniqueName: \"kubernetes.io/projected/6b4195ee-f463-44b4-af7e-7f697a381e3c-kube-api-access-tvzjr\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907034 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k78zt\" (UniqueName: \"kubernetes.io/projected/de241f6a-5709-4975-813e-cab401a8ceb2-kube-api-access-k78zt\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0081fed8-eeb2-44f1-927d-b3d66fc16c87-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907088 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7bd135b-f3ca-44c0-afa1-be54c56dab99-trusted-ca\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907186 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907227 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de241f6a-5709-4975-813e-cab401a8ceb2-tmp\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:44.907306 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7bd135b-f3ca-44c0-afa1-be54c56dab99-serving-cert\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrm6\" (UniqueName: \"kubernetes.io/projected/e7bd135b-f3ca-44c0-afa1-be54c56dab99-kube-api-access-wtrm6\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:44.907386 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:44.907388 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls podName:6b4195ee-f463-44b4-af7e-7f697a381e3c nodeName:}" failed. No retries permitted until 2026-05-28 17:45:45.407367103 +0000 UTC m=+131.840365926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls") pod "cluster-samples-operator-697587599-rcmc6" (UID: "6b4195ee-f463-44b4-af7e-7f697a381e3c") : secret "samples-operator-tls" not found May 28 17:45:44.907876 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:44.907876 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907469 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de241f6a-5709-4975-813e-cab401a8ceb2-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.907876 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907496 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de241f6a-5709-4975-813e-cab401a8ceb2-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.907876 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de241f6a-5709-4975-813e-cab401a8ceb2-tmp\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.907876 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.907643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de241f6a-5709-4975-813e-cab401a8ceb2-snapshots\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.908110 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.908088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de241f6a-5709-4975-813e-cab401a8ceb2-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.908398 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.908383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de241f6a-5709-4975-813e-cab401a8ceb2-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.909275 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.909260 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de241f6a-5709-4975-813e-cab401a8ceb2-serving-cert\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.914950 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.914896 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k78zt\" (UniqueName: \"kubernetes.io/projected/de241f6a-5709-4975-813e-cab401a8ceb2-kube-api-access-k78zt\") pod \"insights-operator-78bdfb888c-7dfkj\" (UID: \"de241f6a-5709-4975-813e-cab401a8ceb2\") " pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:44.915047 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.915031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzjr\" (UniqueName: \"kubernetes.io/projected/6b4195ee-f463-44b4-af7e-7f697a381e3c-kube-api-access-tvzjr\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:44.977056 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:44.977019 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" May 28 17:45:45.008144 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008113 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7bd135b-f3ca-44c0-afa1-be54c56dab99-config\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.008269 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008151 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4n2d\" (UniqueName: \"kubernetes.io/projected/0081fed8-eeb2-44f1-927d-b3d66fc16c87-kube-api-access-n4n2d\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:45.008269 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwn6h\" (UniqueName: \"kubernetes.io/projected/0918d329-07f8-4c36-9378-6723bdbd9fae-kube-api-access-dwn6h\") pod \"network-check-source-7f44b6dd87-72mnx\" (UID: \"0918d329-07f8-4c36-9378-6723bdbd9fae\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx" May 28 17:45:45.008269 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk5w9\" (UniqueName: \"kubernetes.io/projected/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-kube-api-access-nk5w9\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.008269 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008238 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0081fed8-eeb2-44f1-927d-b3d66fc16c87-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:45.008269 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008259 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7bd135b-f3ca-44c0-afa1-be54c56dab99-trusted-ca\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.008470 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-serving-cert\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.008470 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-config\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.008531 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008467 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7bd135b-f3ca-44c0-afa1-be54c56dab99-serving-cert\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.008531 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008506 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrm6\" (UniqueName: \"kubernetes.io/projected/e7bd135b-f3ca-44c0-afa1-be54c56dab99-kube-api-access-wtrm6\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.008590 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008536 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:45.008680 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:45.008665 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 17:45:45.008749 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:45.008739 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls podName:0081fed8-eeb2-44f1-927d-b3d66fc16c87 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:45.508720565 +0000 UTC m=+131.941719367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kps2g" (UID: "0081fed8-eeb2-44f1-927d-b3d66fc16c87") : secret "cluster-monitoring-operator-tls" not found May 28 17:45:45.008987 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.008961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7bd135b-f3ca-44c0-afa1-be54c56dab99-config\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.009127 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.009077 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0081fed8-eeb2-44f1-927d-b3d66fc16c87-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:45.009225 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.009208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7bd135b-f3ca-44c0-afa1-be54c56dab99-trusted-ca\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.010706 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.010678 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7bd135b-f3ca-44c0-afa1-be54c56dab99-serving-cert\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.016382 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.016359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrm6\" (UniqueName: \"kubernetes.io/projected/e7bd135b-f3ca-44c0-afa1-be54c56dab99-kube-api-access-wtrm6\") pod \"console-operator-76dff48d59-6rswz\" (UID: \"e7bd135b-f3ca-44c0-afa1-be54c56dab99\") " pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.016457 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.016394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4n2d\" (UniqueName: \"kubernetes.io/projected/0081fed8-eeb2-44f1-927d-b3d66fc16c87-kube-api-access-n4n2d\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:45.083434 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.083402 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:45.089138 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.089113 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7dfkj"] May 28 17:45:45.107284 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:45:45.107259 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde241f6a_5709_4975_813e_cab401a8ceb2.slice/crio-c43cba31c57e035bfd1de391abcddda6950868b4a75a6fe9b2877ebfa624c18a WatchSource:0}: Error finding container c43cba31c57e035bfd1de391abcddda6950868b4a75a6fe9b2877ebfa624c18a: Status 404 returned error can't find the container with id c43cba31c57e035bfd1de391abcddda6950868b4a75a6fe9b2877ebfa624c18a May 28 17:45:45.108860 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.108841 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-serving-cert\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.108975 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.108870 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-config\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.109093 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.108981 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dwn6h\" (UniqueName: \"kubernetes.io/projected/0918d329-07f8-4c36-9378-6723bdbd9fae-kube-api-access-dwn6h\") pod \"network-check-source-7f44b6dd87-72mnx\" (UID: \"0918d329-07f8-4c36-9378-6723bdbd9fae\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx" May 28 17:45:45.109093 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.109012 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk5w9\" (UniqueName: \"kubernetes.io/projected/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-kube-api-access-nk5w9\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.109646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.109600 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-config\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.111687 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.111666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-serving-cert\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.116864 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.116843 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwn6h\" (UniqueName: \"kubernetes.io/projected/0918d329-07f8-4c36-9378-6723bdbd9fae-kube-api-access-dwn6h\") pod \"network-check-source-7f44b6dd87-72mnx\" (UID: \"0918d329-07f8-4c36-9378-6723bdbd9fae\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx" May 28 17:45:45.116944 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.116899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk5w9\" (UniqueName: \"kubernetes.io/projected/7f69b95e-e61c-4d42-bbe1-111800cf5b0c-kube-api-access-nk5w9\") pod \"service-ca-operator-57b5b68b8-nrpxh\" (UID: \"7f69b95e-e61c-4d42-bbe1-111800cf5b0c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.177265 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.177238 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" May 28 17:45:45.184937 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.184911 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx" May 28 17:45:45.202846 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.202820 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-6rswz"] May 28 17:45:45.206128 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:45:45.205873 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bd135b_f3ca_44c0_afa1_be54c56dab99.slice/crio-9f456d69f85a096cc7c788ef672d7c9032a48ccaf8103dc425d8224a23ab0727 WatchSource:0}: Error finding container 9f456d69f85a096cc7c788ef672d7c9032a48ccaf8103dc425d8224a23ab0727: Status 404 returned error can't find the container with id 9f456d69f85a096cc7c788ef672d7c9032a48ccaf8103dc425d8224a23ab0727 May 28 17:45:45.302161 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.302131 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh"] May 28 17:45:45.305196 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:45:45.305161 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f69b95e_e61c_4d42_bbe1_111800cf5b0c.slice/crio-1eeaa7b62c2fd4e60777e2f03579ba27675e7547ce97ca7e2fdc2e9f9905e083 WatchSource:0}: Error finding container 1eeaa7b62c2fd4e60777e2f03579ba27675e7547ce97ca7e2fdc2e9f9905e083: Status 404 returned error can't find the container with id 1eeaa7b62c2fd4e60777e2f03579ba27675e7547ce97ca7e2fdc2e9f9905e083 May 28 17:45:45.315435 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.315410 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx"] May 28 17:45:45.318291 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:45:45.318262 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0918d329_07f8_4c36_9378_6723bdbd9fae.slice/crio-1bbed0f7b8fd41491d1841f4ae4b2430cfdfcdaf4dadb825a2ab48c60c0157d3 WatchSource:0}: Error finding container 1bbed0f7b8fd41491d1841f4ae4b2430cfdfcdaf4dadb825a2ab48c60c0157d3: Status 404 returned error can't find the container with id 1bbed0f7b8fd41491d1841f4ae4b2430cfdfcdaf4dadb825a2ab48c60c0157d3 May 28 17:45:45.411350 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.411310 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:45.411482 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:45.411454 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 17:45:45.411527 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:45.411517 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls podName:6b4195ee-f463-44b4-af7e-7f697a381e3c nodeName:}" failed. No retries permitted until 2026-05-28 17:45:46.411501041 +0000 UTC m=+132.844499842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls") pod "cluster-samples-operator-697587599-rcmc6" (UID: "6b4195ee-f463-44b4-af7e-7f697a381e3c") : secret "samples-operator-tls" not found May 28 17:45:45.512665 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.512578 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:45.512801 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:45.512732 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 17:45:45.512859 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:45.512818 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls podName:0081fed8-eeb2-44f1-927d-b3d66fc16c87 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:46.512781666 +0000 UTC m=+132.945780468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kps2g" (UID: "0081fed8-eeb2-44f1-927d-b3d66fc16c87") : secret "cluster-monitoring-operator-tls" not found May 28 17:45:45.533431 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.533404 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx" event={"ID":"0918d329-07f8-4c36-9378-6723bdbd9fae","Type":"ContainerStarted","Data":"8495bd2e38cfbe5d63891068af42042ec9571b1a07e893c2d95c3ad52d283a3c"} May 28 17:45:45.533589 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.533440 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx" event={"ID":"0918d329-07f8-4c36-9378-6723bdbd9fae","Type":"ContainerStarted","Data":"1bbed0f7b8fd41491d1841f4ae4b2430cfdfcdaf4dadb825a2ab48c60c0157d3"} May 28 17:45:45.534491 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.534460 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" event={"ID":"7f69b95e-e61c-4d42-bbe1-111800cf5b0c","Type":"ContainerStarted","Data":"1eeaa7b62c2fd4e60777e2f03579ba27675e7547ce97ca7e2fdc2e9f9905e083"} May 28 17:45:45.535448 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.535425 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" event={"ID":"e7bd135b-f3ca-44c0-afa1-be54c56dab99","Type":"ContainerStarted","Data":"9f456d69f85a096cc7c788ef672d7c9032a48ccaf8103dc425d8224a23ab0727"} May 28 17:45:45.536322 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.536301 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" event={"ID":"de241f6a-5709-4975-813e-cab401a8ceb2","Type":"ContainerStarted","Data":"c43cba31c57e035bfd1de391abcddda6950868b4a75a6fe9b2877ebfa624c18a"} May 28 17:45:45.549008 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:45.548968 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-72mnx" podStartSLOduration=1.548954537 podStartE2EDuration="1.548954537s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:45:45.548761902 +0000 UTC m=+131.981760726" watchObservedRunningTime="2026-05-28 17:45:45.548954537 +0000 UTC m=+131.981953389" May 28 17:45:46.420870 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:46.420830 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:46.421411 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:46.420940 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 17:45:46.421411 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:46.421028 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls podName:6b4195ee-f463-44b4-af7e-7f697a381e3c nodeName:}" failed. No retries permitted until 2026-05-28 17:45:48.421006441 +0000 UTC m=+134.854005250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls") pod "cluster-samples-operator-697587599-rcmc6" (UID: "6b4195ee-f463-44b4-af7e-7f697a381e3c") : secret "samples-operator-tls" not found May 28 17:45:46.521711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:46.521589 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:46.521711 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:46.521712 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 17:45:46.521973 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:46.521775 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls podName:0081fed8-eeb2-44f1-927d-b3d66fc16c87 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:48.521757565 +0000 UTC m=+134.954756384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kps2g" (UID: "0081fed8-eeb2-44f1-927d-b3d66fc16c87") : secret "cluster-monitoring-operator-tls" not found May 28 17:45:48.232933 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.232906 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8"] May 28 17:45:48.237278 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.237258 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" May 28 17:45:48.240107 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.240088 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 28 17:45:48.240635 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.240614 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-clqfl\"" May 28 17:45:48.240715 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.240622 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 28 17:45:48.243430 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.243404 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8"] May 28 17:45:48.338653 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.338616 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qpsb\" (UniqueName: \"kubernetes.io/projected/d4cb1ade-0638-45b2-95cc-a9526dc2c3ed-kube-api-access-4qpsb\") pod \"migrator-b985f5d89-jqdd8\" (UID: \"d4cb1ade-0638-45b2-95cc-a9526dc2c3ed\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" May 28 17:45:48.439644 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.439606 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:48.439788 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.439667 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qpsb\" (UniqueName: \"kubernetes.io/projected/d4cb1ade-0638-45b2-95cc-a9526dc2c3ed-kube-api-access-4qpsb\") pod \"migrator-b985f5d89-jqdd8\" (UID: \"d4cb1ade-0638-45b2-95cc-a9526dc2c3ed\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" May 28 17:45:48.439853 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:48.439771 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 17:45:48.439891 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:48.439878 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls podName:6b4195ee-f463-44b4-af7e-7f697a381e3c nodeName:}" failed. No retries permitted until 2026-05-28 17:45:52.439855428 +0000 UTC m=+138.872854236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls") pod "cluster-samples-operator-697587599-rcmc6" (UID: "6b4195ee-f463-44b4-af7e-7f697a381e3c") : secret "samples-operator-tls" not found May 28 17:45:48.447304 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.447247 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qpsb\" (UniqueName: \"kubernetes.io/projected/d4cb1ade-0638-45b2-95cc-a9526dc2c3ed-kube-api-access-4qpsb\") pod \"migrator-b985f5d89-jqdd8\" (UID: \"d4cb1ade-0638-45b2-95cc-a9526dc2c3ed\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" May 28 17:45:48.540836 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.540782 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:48.541010 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:48.540956 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 17:45:48.541069 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:48.541040 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls podName:0081fed8-eeb2-44f1-927d-b3d66fc16c87 nodeName:}" failed. No retries permitted until 2026-05-28 17:45:52.541018649 +0000 UTC m=+138.974017467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kps2g" (UID: "0081fed8-eeb2-44f1-927d-b3d66fc16c87") : secret "cluster-monitoring-operator-tls" not found May 28 17:45:48.544521 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.544493 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" event={"ID":"7f69b95e-e61c-4d42-bbe1-111800cf5b0c","Type":"ContainerStarted","Data":"1ba8ab90db6ff859a9144ebdc902b645154cb3d8d787e4fc0f36795bf473f684"} May 28 17:45:48.545953 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.545936 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/0.log" May 28 17:45:48.546044 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.545966 2563 generic.go:358] "Generic (PLEG): container finished" podID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" containerID="b25a152d4f7b029282c5c7df9177929e6446eea469a83538039aaef60484ee87" exitCode=255 May 28 17:45:48.546044 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.546020 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" event={"ID":"e7bd135b-f3ca-44c0-afa1-be54c56dab99","Type":"ContainerDied","Data":"b25a152d4f7b029282c5c7df9177929e6446eea469a83538039aaef60484ee87"} May 28 17:45:48.546369 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.546240 2563 scope.go:117] "RemoveContainer" containerID="b25a152d4f7b029282c5c7df9177929e6446eea469a83538039aaef60484ee87" May 28 17:45:48.547507 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.547485 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" event={"ID":"de241f6a-5709-4975-813e-cab401a8ceb2","Type":"ContainerStarted","Data":"85703a468f56719df35bc1133377f9a52f1ef98e9c1be15e1ae4616e6d4ab1a3"} May 28 17:45:48.559564 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.559520 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" podStartSLOduration=1.644788183 podStartE2EDuration="4.559504904s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="2026-05-28 17:45:45.307111503 +0000 UTC m=+131.740110308" lastFinishedPulling="2026-05-28 17:45:48.221828227 +0000 UTC m=+134.654827029" observedRunningTime="2026-05-28 17:45:48.557798051 +0000 UTC m=+134.990796871" watchObservedRunningTime="2026-05-28 17:45:48.559504904 +0000 UTC m=+134.992503730" May 28 17:45:48.573154 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.573113 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" podStartSLOduration=1.466557466 podStartE2EDuration="4.573100004s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="2026-05-28 17:45:45.109395783 +0000 UTC m=+131.542394589" lastFinishedPulling="2026-05-28 17:45:48.215938322 +0000 UTC m=+134.648937127" observedRunningTime="2026-05-28 17:45:48.572219349 +0000 UTC m=+135.005218175" watchObservedRunningTime="2026-05-28 17:45:48.573100004 +0000 UTC m=+135.006098828" May 28 17:45:48.615264 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.615241 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" May 28 17:45:48.749258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:48.749227 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8"] May 28 17:45:48.753856 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:45:48.753802 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cb1ade_0638_45b2_95cc_a9526dc2c3ed.slice/crio-72363e46571b6b487ba5e28e4770696685248012eadd94be36231fff15e02c46 WatchSource:0}: Error finding container 72363e46571b6b487ba5e28e4770696685248012eadd94be36231fff15e02c46: Status 404 returned error can't find the container with id 72363e46571b6b487ba5e28e4770696685248012eadd94be36231fff15e02c46 May 28 17:45:49.552228 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:49.552202 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/1.log" May 28 17:45:49.552777 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:49.552598 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/0.log" May 28 17:45:49.552777 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:49.552636 2563 generic.go:358] "Generic (PLEG): container finished" podID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" containerID="fa21171720c86d1ddf75e5fff7abcd2143a141aad462ad5458b72402e3ad2bd1" exitCode=255 May 28 17:45:49.552777 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:49.552705 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" event={"ID":"e7bd135b-f3ca-44c0-afa1-be54c56dab99","Type":"ContainerDied","Data":"fa21171720c86d1ddf75e5fff7abcd2143a141aad462ad5458b72402e3ad2bd1"} May 28 17:45:49.552777 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:49.552742 2563 scope.go:117] "RemoveContainer" containerID="b25a152d4f7b029282c5c7df9177929e6446eea469a83538039aaef60484ee87" May 28 17:45:49.553171 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:49.553144 2563 scope.go:117] "RemoveContainer" containerID="fa21171720c86d1ddf75e5fff7abcd2143a141aad462ad5458b72402e3ad2bd1" May 28 17:45:49.553373 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:49.553346 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-6rswz_openshift-console-operator(e7bd135b-f3ca-44c0-afa1-be54c56dab99)\"" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" podUID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" May 28 17:45:49.554333 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:49.554310 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" event={"ID":"d4cb1ade-0638-45b2-95cc-a9526dc2c3ed","Type":"ContainerStarted","Data":"72363e46571b6b487ba5e28e4770696685248012eadd94be36231fff15e02c46"} May 28 17:45:50.558509 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:50.558481 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/1.log" May 28 17:45:50.558988 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:50.558916 2563 scope.go:117] "RemoveContainer" containerID="fa21171720c86d1ddf75e5fff7abcd2143a141aad462ad5458b72402e3ad2bd1" May 28 17:45:50.559157 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:50.559123 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-6rswz_openshift-console-operator(e7bd135b-f3ca-44c0-afa1-be54c56dab99)\"" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" podUID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" May 28 17:45:50.564072 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:50.564033 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" event={"ID":"d4cb1ade-0638-45b2-95cc-a9526dc2c3ed","Type":"ContainerStarted","Data":"877d6c9972db8b9843e2bb5ee724f4ed96bbdf42956cdae5207537946abaee0a"} May 28 17:45:50.564072 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:50.564071 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" event={"ID":"d4cb1ade-0638-45b2-95cc-a9526dc2c3ed","Type":"ContainerStarted","Data":"b0dfe7701596ff4f01508fb4dd0bc8704c3590f2455c596f90e174638bdef6e6"} May 28 17:45:50.591230 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:50.591180 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jqdd8" podStartSLOduration=1.374520864 podStartE2EDuration="2.591165489s" podCreationTimestamp="2026-05-28 17:45:48 +0000 UTC" firstStartedPulling="2026-05-28 17:45:48.755761944 +0000 UTC m=+135.188760757" lastFinishedPulling="2026-05-28 17:45:49.97240658 +0000 UTC m=+136.405405382" observedRunningTime="2026-05-28 17:45:50.590715535 +0000 UTC m=+137.023714360" watchObservedRunningTime="2026-05-28 17:45:50.591165489 +0000 UTC m=+137.024164312" May 28 17:45:51.763290 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:51.763259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4mfs6_23841ef9-37f7-44b2-adf3-6d5075b49e32/dns-node-resolver/0.log" May 28 17:45:52.475583 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:52.475541 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:45:52.475761 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:52.475683 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 17:45:52.475761 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:52.475757 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls podName:6b4195ee-f463-44b4-af7e-7f697a381e3c nodeName:}" failed. No retries permitted until 2026-05-28 17:46:00.475740967 +0000 UTC m=+146.908739775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls") pod "cluster-samples-operator-697587599-rcmc6" (UID: "6b4195ee-f463-44b4-af7e-7f697a381e3c") : secret "samples-operator-tls" not found May 28 17:45:52.576149 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:52.576117 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:45:52.576339 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:52.576279 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 17:45:52.576408 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:52.576355 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls podName:0081fed8-eeb2-44f1-927d-b3d66fc16c87 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:00.576333633 +0000 UTC m=+147.009332454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kps2g" (UID: "0081fed8-eeb2-44f1-927d-b3d66fc16c87") : secret "cluster-monitoring-operator-tls" not found May 28 17:45:52.763871 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:52.763782 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2d8s6_7abdcaed-ff92-4f4b-88ec-bc8f69df88ca/node-ca/0.log" May 28 17:45:53.122991 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.122914 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tv5ts"] May 28 17:45:53.126271 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.126254 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.128682 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.128662 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 28 17:45:53.129695 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.129676 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 28 17:45:53.129695 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.129695 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tgnrh\"" May 28 17:45:53.129695 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.129680 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 28 17:45:53.129942 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.129681 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 28 17:45:53.132335 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.132314 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tv5ts"] May 28 17:45:53.282434 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.282401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-signing-key\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.282434 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.282435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclbw\" (UniqueName: \"kubernetes.io/projected/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-kube-api-access-dclbw\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.282626 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.282472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-signing-cabundle\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.383119 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.383034 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-signing-cabundle\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.383290 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.383120 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-signing-key\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.383290 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.383137 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dclbw\" (UniqueName: \"kubernetes.io/projected/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-kube-api-access-dclbw\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.383730 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.383709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-signing-cabundle\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.385461 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.385443 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-signing-key\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.390736 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.390711 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclbw\" (UniqueName: \"kubernetes.io/projected/ebcc352d-def9-4e93-b0ca-f6caa6fd415a-kube-api-access-dclbw\") pod \"service-ca-67d667c7d-tv5ts\" (UID: \"ebcc352d-def9-4e93-b0ca-f6caa6fd415a\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.435763 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.435714 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" May 28 17:45:53.557916 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.557883 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tv5ts"] May 28 17:45:53.561377 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:45:53.561353 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcc352d_def9_4e93_b0ca_f6caa6fd415a.slice/crio-c00b5cfd7703f5bb7951f81841c90616e83cb35509c5dcabbfddbc5e929c8ead WatchSource:0}: Error finding container c00b5cfd7703f5bb7951f81841c90616e83cb35509c5dcabbfddbc5e929c8ead: Status 404 returned error can't find the container with id c00b5cfd7703f5bb7951f81841c90616e83cb35509c5dcabbfddbc5e929c8ead May 28 17:45:53.572669 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:53.572645 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" event={"ID":"ebcc352d-def9-4e93-b0ca-f6caa6fd415a","Type":"ContainerStarted","Data":"c00b5cfd7703f5bb7951f81841c90616e83cb35509c5dcabbfddbc5e929c8ead"} May 28 17:45:54.164461 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:54.164436 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-jqdd8_d4cb1ade-0638-45b2-95cc-a9526dc2c3ed/migrator/0.log" May 28 17:45:54.363686 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:54.363648 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-jqdd8_d4cb1ade-0638-45b2-95cc-a9526dc2c3ed/graceful-termination/0.log" May 28 17:45:54.576301 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:54.576268 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" event={"ID":"ebcc352d-def9-4e93-b0ca-f6caa6fd415a","Type":"ContainerStarted","Data":"3e9b1ae172d506b5cccc4b4bc9036e2681617260f1ec9648127741ae73943804"} May 28 17:45:54.590588 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:54.590541 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-tv5ts" podStartSLOduration=1.590527585 podStartE2EDuration="1.590527585s" podCreationTimestamp="2026-05-28 17:45:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:45:54.590344636 +0000 UTC m=+141.023343461" watchObservedRunningTime="2026-05-28 17:45:54.590527585 +0000 UTC m=+141.023526408" May 28 17:45:55.084022 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:55.083979 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:55.084022 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:55.084025 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:45:55.084425 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:45:55.084412 2563 scope.go:117] "RemoveContainer" containerID="fa21171720c86d1ddf75e5fff7abcd2143a141aad462ad5458b72402e3ad2bd1" May 28 17:45:55.084703 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:45:55.084683 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-6rswz_openshift-console-operator(e7bd135b-f3ca-44c0-afa1-be54c56dab99)\"" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" podUID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" May 28 17:46:00.544561 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:00.544528 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:46:00.546929 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:00.546895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b4195ee-f463-44b4-af7e-7f697a381e3c-samples-operator-tls\") pod \"cluster-samples-operator-697587599-rcmc6\" (UID: \"6b4195ee-f463-44b4-af7e-7f697a381e3c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:46:00.582501 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:00.582474 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" May 28 17:46:00.645495 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:00.645455 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:46:00.645693 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:00.645674 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 17:46:00.645771 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:00.645750 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls podName:0081fed8-eeb2-44f1-927d-b3d66fc16c87 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:16.645728685 +0000 UTC m=+163.078727491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-kps2g" (UID: "0081fed8-eeb2-44f1-927d-b3d66fc16c87") : secret "cluster-monitoring-operator-tls" not found May 28 17:46:00.705121 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:00.705087 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6"] May 28 17:46:01.597175 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:01.597135 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" event={"ID":"6b4195ee-f463-44b4-af7e-7f697a381e3c","Type":"ContainerStarted","Data":"f40d08ce81e21365feb563c631f7243ffcde4b857f3859e1b44cd1b89b02fa3d"} May 28 17:46:03.603522 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:03.603483 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" event={"ID":"6b4195ee-f463-44b4-af7e-7f697a381e3c","Type":"ContainerStarted","Data":"44440b6765b30abf083efa4a2c0764d9526a64f8e0cd4839e30a0fef82e84456"} May 28 17:46:03.603522 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:03.603528 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" event={"ID":"6b4195ee-f463-44b4-af7e-7f697a381e3c","Type":"ContainerStarted","Data":"1efb89a7fb7d99173bb759c1cb3d5c118d720e263f0ec93cac31129638efd2f6"} May 28 17:46:03.618260 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:03.618205 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-rcmc6" podStartSLOduration=17.83136564 podStartE2EDuration="19.618186667s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="2026-05-28 17:46:00.77660818 +0000 UTC m=+147.209606983" lastFinishedPulling="2026-05-28 17:46:02.563429209 +0000 UTC m=+148.996428010" observedRunningTime="2026-05-28 17:46:03.617446632 +0000 UTC m=+150.050445457" watchObservedRunningTime="2026-05-28 17:46:03.618186667 +0000 UTC m=+150.051185492" May 28 17:46:08.182674 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:08.182642 2563 scope.go:117] "RemoveContainer" containerID="fa21171720c86d1ddf75e5fff7abcd2143a141aad462ad5458b72402e3ad2bd1" May 28 17:46:08.620191 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:08.620120 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:46:08.620476 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:08.620459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/1.log" May 28 17:46:08.620528 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:08.620493 2563 generic.go:358] "Generic (PLEG): container finished" podID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" containerID="9a27192b3b714b2ba501abdf86d9bf454554d6b50de6a36ecea26728d84ceb0e" exitCode=255 May 28 17:46:08.620562 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:08.620543 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" event={"ID":"e7bd135b-f3ca-44c0-afa1-be54c56dab99","Type":"ContainerDied","Data":"9a27192b3b714b2ba501abdf86d9bf454554d6b50de6a36ecea26728d84ceb0e"} May 28 17:46:08.620595 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:08.620575 2563 scope.go:117] "RemoveContainer" containerID="fa21171720c86d1ddf75e5fff7abcd2143a141aad462ad5458b72402e3ad2bd1" May 28 17:46:08.620940 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:08.620925 2563 scope.go:117] "RemoveContainer" containerID="9a27192b3b714b2ba501abdf86d9bf454554d6b50de6a36ecea26728d84ceb0e" May 28 17:46:08.621132 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:08.621113 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-6rswz_openshift-console-operator(e7bd135b-f3ca-44c0-afa1-be54c56dab99)\"" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" podUID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" May 28 17:46:09.625254 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:09.625226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:46:10.449679 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:10.449638 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z69bn" podUID="36f49167-c818-4f84-8dcb-d0f68511b082" May 28 17:46:10.464821 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:10.464770 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-pjtf4" podUID="8b49ae9f-d277-4747-a106-62a9b587b50f" May 28 17:46:10.627663 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:10.627634 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z69bn" May 28 17:46:11.201146 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:11.201104 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-x4wkc" podUID="9c4db03d-65d8-4ba9-92fa-e7d7b1381230" May 28 17:46:15.084091 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.084005 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:46:15.084091 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.084048 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:46:15.084504 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.084361 2563 scope.go:117] "RemoveContainer" containerID="9a27192b3b714b2ba501abdf86d9bf454554d6b50de6a36ecea26728d84ceb0e" May 28 17:46:15.084539 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:15.084528 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-6rswz_openshift-console-operator(e7bd135b-f3ca-44c0-afa1-be54c56dab99)\"" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" podUID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" May 28 17:46:15.362642 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.362540 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:46:15.362642 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.362631 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:46:15.364817 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.364780 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36f49167-c818-4f84-8dcb-d0f68511b082-metrics-tls\") pod \"dns-default-z69bn\" (UID: \"36f49167-c818-4f84-8dcb-d0f68511b082\") " pod="openshift-dns/dns-default-z69bn" May 28 17:46:15.364960 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.364941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b49ae9f-d277-4747-a106-62a9b587b50f-cert\") pod \"ingress-canary-pjtf4\" (UID: \"8b49ae9f-d277-4747-a106-62a9b587b50f\") " pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:46:15.431195 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.431161 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v9cdg\"" May 28 17:46:15.439266 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.439248 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z69bn" May 28 17:46:15.574736 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.574705 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z69bn"] May 28 17:46:15.577636 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:46:15.577609 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f49167_c818_4f84_8dcb_d0f68511b082.slice/crio-8f39028f4fd39731b07eea81659484b637ecc6c332a21975126d27221017a730 WatchSource:0}: Error finding container 8f39028f4fd39731b07eea81659484b637ecc6c332a21975126d27221017a730: Status 404 returned error can't find the container with id 8f39028f4fd39731b07eea81659484b637ecc6c332a21975126d27221017a730 May 28 17:46:15.644629 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:15.644553 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z69bn" event={"ID":"36f49167-c818-4f84-8dcb-d0f68511b082","Type":"ContainerStarted","Data":"8f39028f4fd39731b07eea81659484b637ecc6c332a21975126d27221017a730"} May 28 17:46:16.266680 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.266641 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vgg6n"] May 28 17:46:16.269735 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.269712 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.273114 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.273087 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 17:46:16.273271 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.273252 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 17:46:16.273345 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.273253 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hm5hn\"" May 28 17:46:16.283699 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.283673 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vgg6n"] May 28 17:46:16.369672 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.369636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/617866bc-60c3-4363-865f-2e8e7df6cb6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.369672 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.369674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/617866bc-60c3-4363-865f-2e8e7df6cb6c-crio-socket\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.369945 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.369715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/617866bc-60c3-4363-865f-2e8e7df6cb6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.369945 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.369819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqcbk\" (UniqueName: \"kubernetes.io/projected/617866bc-60c3-4363-865f-2e8e7df6cb6c-kube-api-access-qqcbk\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.369945 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.369904 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/617866bc-60c3-4363-865f-2e8e7df6cb6c-data-volume\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.374234 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.374200 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7ddb858746-5dfps"] May 28 17:46:16.377057 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.377036 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.379604 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.379573 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvn4l\"" May 28 17:46:16.379756 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.379607 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 17:46:16.379756 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.379674 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 17:46:16.379988 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.379973 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 17:46:16.384836 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.384574 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 17:46:16.392505 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.392482 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ddb858746-5dfps"] May 28 17:46:16.470298 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470258 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/617866bc-60c3-4363-865f-2e8e7df6cb6c-crio-socket\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.470464 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-bound-sa-token\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.470464 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470361 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/617866bc-60c3-4363-865f-2e8e7df6cb6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.470464 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/617866bc-60c3-4363-865f-2e8e7df6cb6c-crio-socket\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.470464 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-registry-tls\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.470464 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef5d2869-13bd-4ad1-9235-364e4c187700-installation-pull-secrets\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.470697 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470487 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqcbk\" (UniqueName: \"kubernetes.io/projected/617866bc-60c3-4363-865f-2e8e7df6cb6c-kube-api-access-qqcbk\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.470697 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef5d2869-13bd-4ad1-9235-364e4c187700-ca-trust-extracted\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.470697 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef5d2869-13bd-4ad1-9235-364e4c187700-trusted-ca\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.470697 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470685 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/617866bc-60c3-4363-865f-2e8e7df6cb6c-data-volume\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.470913 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470723 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef5d2869-13bd-4ad1-9235-364e4c187700-registry-certificates\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.470913 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wjrh\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-kube-api-access-9wjrh\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.470913 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef5d2869-13bd-4ad1-9235-364e4c187700-image-registry-private-configuration\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.470913 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.470881 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/617866bc-60c3-4363-865f-2e8e7df6cb6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.471079 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.471046 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/617866bc-60c3-4363-865f-2e8e7df6cb6c-data-volume\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.471434 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.471413 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/617866bc-60c3-4363-865f-2e8e7df6cb6c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.472779 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.472754 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/617866bc-60c3-4363-865f-2e8e7df6cb6c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.479928 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.479905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqcbk\" (UniqueName: \"kubernetes.io/projected/617866bc-60c3-4363-865f-2e8e7df6cb6c-kube-api-access-qqcbk\") pod \"insights-runtime-extractor-vgg6n\" (UID: \"617866bc-60c3-4363-865f-2e8e7df6cb6c\") " pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.571714 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.571622 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef5d2869-13bd-4ad1-9235-364e4c187700-ca-trust-extracted\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.571714 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.571659 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef5d2869-13bd-4ad1-9235-364e4c187700-trusted-ca\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.571945 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.571884 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef5d2869-13bd-4ad1-9235-364e4c187700-registry-certificates\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.571945 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.571927 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wjrh\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-kube-api-access-9wjrh\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.572033 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.571954 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef5d2869-13bd-4ad1-9235-364e4c187700-image-registry-private-configuration\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.572033 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.572012 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-bound-sa-token\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.572129 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.572095 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-registry-tls\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.572129 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.572105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef5d2869-13bd-4ad1-9235-364e4c187700-ca-trust-extracted\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.572129 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.572123 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef5d2869-13bd-4ad1-9235-364e4c187700-installation-pull-secrets\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.572773 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.572724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef5d2869-13bd-4ad1-9235-364e4c187700-trusted-ca\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.572901 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.572781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef5d2869-13bd-4ad1-9235-364e4c187700-registry-certificates\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.574770 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.574745 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef5d2869-13bd-4ad1-9235-364e4c187700-image-registry-private-configuration\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.574926 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.574902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef5d2869-13bd-4ad1-9235-364e4c187700-installation-pull-secrets\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.575061 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.575039 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-registry-tls\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.581395 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.581371 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vgg6n" May 28 17:46:16.584965 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.584942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-bound-sa-token\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.585093 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.584931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wjrh\" (UniqueName: \"kubernetes.io/projected/ef5d2869-13bd-4ad1-9235-364e4c187700-kube-api-access-9wjrh\") pod \"image-registry-7ddb858746-5dfps\" (UID: \"ef5d2869-13bd-4ad1-9235-364e4c187700\") " pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.673588 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.673525 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:46:16.676241 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.676214 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0081fed8-eeb2-44f1-927d-b3d66fc16c87-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-kps2g\" (UID: \"0081fed8-eeb2-44f1-927d-b3d66fc16c87\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:46:16.691026 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.690999 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:16.877304 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.877261 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" May 28 17:46:16.950442 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.950197 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7ddb858746-5dfps"] May 28 17:46:16.954673 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:46:16.954636 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5d2869_13bd_4ad1_9235_364e4c187700.slice/crio-bb0d4179c49f088be27deaab82ee1980bd1b115b97028f0261c725be4d89bb2b WatchSource:0}: Error finding container bb0d4179c49f088be27deaab82ee1980bd1b115b97028f0261c725be4d89bb2b: Status 404 returned error can't find the container with id bb0d4179c49f088be27deaab82ee1980bd1b115b97028f0261c725be4d89bb2b May 28 17:46:16.968000 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:16.967963 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vgg6n"] May 28 17:46:16.971695 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:46:16.971666 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617866bc_60c3_4363_865f_2e8e7df6cb6c.slice/crio-cb568a10551ed17e7f3f4f56af1ee09319a7dbedb7903ce19727020f10922ce4 WatchSource:0}: Error finding container cb568a10551ed17e7f3f4f56af1ee09319a7dbedb7903ce19727020f10922ce4: Status 404 returned error can't find the container with id cb568a10551ed17e7f3f4f56af1ee09319a7dbedb7903ce19727020f10922ce4 May 28 17:46:17.043465 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.043301 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g"] May 28 17:46:17.652007 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.651969 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgg6n" event={"ID":"617866bc-60c3-4363-865f-2e8e7df6cb6c","Type":"ContainerStarted","Data":"99eb7da29865ade382c165371be3eac63f81395734e30616b4c8cdb7852fb809"} May 28 17:46:17.652007 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.652014 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgg6n" event={"ID":"617866bc-60c3-4363-865f-2e8e7df6cb6c","Type":"ContainerStarted","Data":"cb568a10551ed17e7f3f4f56af1ee09319a7dbedb7903ce19727020f10922ce4"} May 28 17:46:17.653521 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.653495 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z69bn" event={"ID":"36f49167-c818-4f84-8dcb-d0f68511b082","Type":"ContainerStarted","Data":"6c26df59da327d010e3692309a575c98bd428aff5cf7de60c495455453b3a8a6"} May 28 17:46:17.653521 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.653530 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z69bn" event={"ID":"36f49167-c818-4f84-8dcb-d0f68511b082","Type":"ContainerStarted","Data":"f84dadb4a6ba9e9129eb038a13ca98dea33eeda9dd246e719ea12812435abb3c"} May 28 17:46:17.653732 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.653634 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z69bn" May 28 17:46:17.654530 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.654505 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" event={"ID":"0081fed8-eeb2-44f1-927d-b3d66fc16c87","Type":"ContainerStarted","Data":"175ddca9cd823078ad72ca4de8cc777f3c694486c43808c0f8dd2440396c1fcb"} May 28 17:46:17.655974 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.655945 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddb858746-5dfps" event={"ID":"ef5d2869-13bd-4ad1-9235-364e4c187700","Type":"ContainerStarted","Data":"bb4f517f36c799cd7c4126b1360156e315dd52c81f577fa73194c11d1d3542aa"} May 28 17:46:17.656135 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.655983 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7ddb858746-5dfps" event={"ID":"ef5d2869-13bd-4ad1-9235-364e4c187700","Type":"ContainerStarted","Data":"bb0d4179c49f088be27deaab82ee1980bd1b115b97028f0261c725be4d89bb2b"} May 28 17:46:17.656534 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.656514 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:17.670243 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.670197 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-z69bn" podStartSLOduration=129.394820037 podStartE2EDuration="2m10.670183949s" podCreationTimestamp="2026-05-28 17:44:07 +0000 UTC" firstStartedPulling="2026-05-28 17:46:15.579497362 +0000 UTC m=+162.012496164" lastFinishedPulling="2026-05-28 17:46:16.854861272 +0000 UTC m=+163.287860076" observedRunningTime="2026-05-28 17:46:17.669110998 +0000 UTC m=+164.102109823" watchObservedRunningTime="2026-05-28 17:46:17.670183949 +0000 UTC m=+164.103182773" May 28 17:46:17.687949 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:17.687905 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7ddb858746-5dfps" podStartSLOduration=1.687888854 podStartE2EDuration="1.687888854s" podCreationTimestamp="2026-05-28 17:46:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:46:17.68700306 +0000 UTC m=+164.120001883" watchObservedRunningTime="2026-05-28 17:46:17.687888854 +0000 UTC m=+164.120887678" May 28 17:46:18.661206 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:18.661171 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgg6n" event={"ID":"617866bc-60c3-4363-865f-2e8e7df6cb6c","Type":"ContainerStarted","Data":"42f51c1c21d057eb9825edba14fe3cd37f4b7e357d54d7d7154373e9336cc383"} May 28 17:46:19.671286 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:19.671241 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vgg6n" event={"ID":"617866bc-60c3-4363-865f-2e8e7df6cb6c","Type":"ContainerStarted","Data":"b31abc9c324a63be869c05674948cce016b03303e08842d12c77ff70aecf52ee"} May 28 17:46:19.672569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:19.672540 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" event={"ID":"0081fed8-eeb2-44f1-927d-b3d66fc16c87","Type":"ContainerStarted","Data":"04bb8f4b2041b2e367dd8b0233700e3831440cc611457b4bc5b2709919a9ed6b"} May 28 17:46:19.692417 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:19.692347 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vgg6n" podStartSLOduration=1.471542379 podStartE2EDuration="3.692329296s" podCreationTimestamp="2026-05-28 17:46:16 +0000 UTC" firstStartedPulling="2026-05-28 17:46:17.051075538 +0000 UTC m=+163.484074354" lastFinishedPulling="2026-05-28 17:46:19.27186247 +0000 UTC m=+165.704861271" observedRunningTime="2026-05-28 17:46:19.692288726 +0000 UTC m=+166.125287583" watchObservedRunningTime="2026-05-28 17:46:19.692329296 +0000 UTC m=+166.125328127" May 28 17:46:19.711086 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:19.711037 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-kps2g" podStartSLOduration=33.48957828 podStartE2EDuration="35.711022346s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="2026-05-28 17:46:17.048590501 +0000 UTC m=+163.481589306" lastFinishedPulling="2026-05-28 17:46:19.270034556 +0000 UTC m=+165.703033372" observedRunningTime="2026-05-28 17:46:19.710096528 +0000 UTC m=+166.143095351" watchObservedRunningTime="2026-05-28 17:46:19.711022346 +0000 UTC m=+166.144021170" May 28 17:46:23.181621 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:23.181583 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:46:23.184505 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:23.184487 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8dtch\"" May 28 17:46:23.192284 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:23.192268 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pjtf4" May 28 17:46:23.308026 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:23.307995 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pjtf4"] May 28 17:46:23.310853 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:46:23.310827 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b49ae9f_d277_4747_a106_62a9b587b50f.slice/crio-c552f0711f0fc609df2cf58881640e6e7be43615f1fa78b39fdaab917c3c72f2 WatchSource:0}: Error finding container c552f0711f0fc609df2cf58881640e6e7be43615f1fa78b39fdaab917c3c72f2: Status 404 returned error can't find the container with id c552f0711f0fc609df2cf58881640e6e7be43615f1fa78b39fdaab917c3c72f2 May 28 17:46:23.683661 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:23.683628 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pjtf4" event={"ID":"8b49ae9f-d277-4747-a106-62a9b587b50f","Type":"ContainerStarted","Data":"c552f0711f0fc609df2cf58881640e6e7be43615f1fa78b39fdaab917c3c72f2"} May 28 17:46:24.183917 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:24.183882 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:46:25.689472 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:25.689433 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pjtf4" event={"ID":"8b49ae9f-d277-4747-a106-62a9b587b50f","Type":"ContainerStarted","Data":"c8e87ab9976d05cb8fdbbe383db3e8b90a2969704033be32e7d21766d3a7608d"} May 28 17:46:25.703995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:25.703947 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pjtf4" podStartSLOduration=137.216673674 podStartE2EDuration="2m18.703932657s" podCreationTimestamp="2026-05-28 17:44:07 +0000 UTC" firstStartedPulling="2026-05-28 17:46:23.312496218 +0000 UTC m=+169.745495031" lastFinishedPulling="2026-05-28 17:46:24.799755212 +0000 UTC m=+171.232754014" observedRunningTime="2026-05-28 17:46:25.702680519 +0000 UTC m=+172.135679344" watchObservedRunningTime="2026-05-28 17:46:25.703932657 +0000 UTC m=+172.136931481" May 28 17:46:26.182000 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:26.181971 2563 scope.go:117] "RemoveContainer" containerID="9a27192b3b714b2ba501abdf86d9bf454554d6b50de6a36ecea26728d84ceb0e" May 28 17:46:26.182164 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:26.182140 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-6rswz_openshift-console-operator(e7bd135b-f3ca-44c0-afa1-be54c56dab99)\"" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" podUID="e7bd135b-f3ca-44c0-afa1-be54c56dab99" May 28 17:46:27.165940 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.165901 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8l828"] May 28 17:46:27.171610 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.168710 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.171893 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.171871 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 17:46:27.172187 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.172160 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 17:46:27.172287 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.171926 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sn8gc\"" May 28 17:46:27.172920 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.172881 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 17:46:27.173048 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.173008 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 17:46:27.257989 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.257938 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.258190 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.257994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-wtmp\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.258190 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.258069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-textfile\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.258190 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.258117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-root\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.258345 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.258192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.258345 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.258220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-sys\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.258345 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.258243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-tls\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.258345 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.258324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fzjz\" (UniqueName: \"kubernetes.io/projected/5b813626-f239-46a9-9757-04dfec64cca8-kube-api-access-9fzjz\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.258469 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.258374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b813626-f239-46a9-9757-04dfec64cca8-metrics-client-ca\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.358977 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.358931 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b813626-f239-46a9-9757-04dfec64cca8-metrics-client-ca\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359008 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359041 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-wtmp\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359067 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-textfile\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359106 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-root\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359152 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359411 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359180 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-sys\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359411 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-sys\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359411 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-wtmp\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359411 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5b813626-f239-46a9-9757-04dfec64cca8-root\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359411 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359302 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-tls\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359411 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359359 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fzjz\" (UniqueName: \"kubernetes.io/projected/5b813626-f239-46a9-9757-04dfec64cca8-kube-api-access-9fzjz\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359688 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:27.359444 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 28 17:46:27.359688 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:46:27.359518 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-tls podName:5b813626-f239-46a9-9757-04dfec64cca8 nodeName:}" failed. No retries permitted until 2026-05-28 17:46:27.859497086 +0000 UTC m=+174.292495902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-tls") pod "node-exporter-8l828" (UID: "5b813626-f239-46a9-9757-04dfec64cca8") : secret "node-exporter-tls" not found May 28 17:46:27.359688 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b813626-f239-46a9-9757-04dfec64cca8-metrics-client-ca\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359883 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359663 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.359987 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.359959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-textfile\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.361902 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.361882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.370918 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.370895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fzjz\" (UniqueName: \"kubernetes.io/projected/5b813626-f239-46a9-9757-04dfec64cca8-kube-api-access-9fzjz\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.663404 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.663375 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z69bn" May 28 17:46:27.862092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.862057 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-tls\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:27.864323 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:27.864298 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5b813626-f239-46a9-9757-04dfec64cca8-node-exporter-tls\") pod \"node-exporter-8l828\" (UID: \"5b813626-f239-46a9-9757-04dfec64cca8\") " pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:28.080398 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:28.080365 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8l828" May 28 17:46:28.088560 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:46:28.088531 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b813626_f239_46a9_9757_04dfec64cca8.slice/crio-9ccfc99d35afaa4a8656c287fd973153ad22e82f2b58fb5319bb33ffe0a1f2d3 WatchSource:0}: Error finding container 9ccfc99d35afaa4a8656c287fd973153ad22e82f2b58fb5319bb33ffe0a1f2d3: Status 404 returned error can't find the container with id 9ccfc99d35afaa4a8656c287fd973153ad22e82f2b58fb5319bb33ffe0a1f2d3 May 28 17:46:28.698292 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:28.698257 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8l828" event={"ID":"5b813626-f239-46a9-9757-04dfec64cca8","Type":"ContainerStarted","Data":"9ccfc99d35afaa4a8656c287fd973153ad22e82f2b58fb5319bb33ffe0a1f2d3"} May 28 17:46:29.702384 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:29.702349 2563 generic.go:358] "Generic (PLEG): container finished" podID="5b813626-f239-46a9-9757-04dfec64cca8" containerID="5743933f75efe1daf7aa130d4ebd41a2fde994e7eede5447be4eb10271b0e515" exitCode=0 May 28 17:46:29.702866 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:29.702407 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8l828" event={"ID":"5b813626-f239-46a9-9757-04dfec64cca8","Type":"ContainerDied","Data":"5743933f75efe1daf7aa130d4ebd41a2fde994e7eede5447be4eb10271b0e515"} May 28 17:46:30.706791 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:30.706756 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8l828" event={"ID":"5b813626-f239-46a9-9757-04dfec64cca8","Type":"ContainerStarted","Data":"2284b0377494cc8eca0973e79b296072e81141399d2d12a28b6230939825cbce"} May 28 17:46:30.706791 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:30.706793 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8l828" event={"ID":"5b813626-f239-46a9-9757-04dfec64cca8","Type":"ContainerStarted","Data":"0c7bf41ffa7af175ef56ab1891f35621aac37aed6d151384519ea9393697f2a1"} May 28 17:46:30.725929 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:30.725882 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8l828" podStartSLOduration=2.702170193 podStartE2EDuration="3.725867842s" podCreationTimestamp="2026-05-28 17:46:27 +0000 UTC" firstStartedPulling="2026-05-28 17:46:28.090052089 +0000 UTC m=+174.523050891" lastFinishedPulling="2026-05-28 17:46:29.113749734 +0000 UTC m=+175.546748540" observedRunningTime="2026-05-28 17:46:30.725564745 +0000 UTC m=+177.158563568" watchObservedRunningTime="2026-05-28 17:46:30.725867842 +0000 UTC m=+177.158866700" May 28 17:46:31.563002 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.562966 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-865cbb6f69-z4jhj"] May 28 17:46:31.564779 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.564762 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.567117 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.567095 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 28 17:46:31.567279 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.567235 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 17:46:31.568286 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.568268 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 28 17:46:31.568362 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.568335 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-js4tc\"" May 28 17:46:31.568414 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.568380 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3jr0hi14m8ekr\"" May 28 17:46:31.568414 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.568399 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 28 17:46:31.579023 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.578998 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-865cbb6f69-z4jhj"] May 28 17:46:31.594550 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.594526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-secret-metrics-server-client-certs\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.594661 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.594568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a9ad6419-7529-4a62-9fea-99d104ec5705-audit-log\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.594661 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.594633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7shx\" (UniqueName: \"kubernetes.io/projected/a9ad6419-7529-4a62-9fea-99d104ec5705-kube-api-access-k7shx\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.594734 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.594659 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ad6419-7529-4a62-9fea-99d104ec5705-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.594734 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.594684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-client-ca-bundle\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.594734 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.594702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a9ad6419-7529-4a62-9fea-99d104ec5705-metrics-server-audit-profiles\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.594734 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.594726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-secret-metrics-server-tls\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696061 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696028 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7shx\" (UniqueName: \"kubernetes.io/projected/a9ad6419-7529-4a62-9fea-99d104ec5705-kube-api-access-k7shx\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696252 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696067 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ad6419-7529-4a62-9fea-99d104ec5705-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696252 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696088 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-client-ca-bundle\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696252 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696130 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a9ad6419-7529-4a62-9fea-99d104ec5705-metrics-server-audit-profiles\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696252 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696154 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-secret-metrics-server-tls\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696252 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696186 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-secret-metrics-server-client-certs\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696252 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696237 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a9ad6419-7529-4a62-9fea-99d104ec5705-audit-log\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696647 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696627 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a9ad6419-7529-4a62-9fea-99d104ec5705-audit-log\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.696907 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.696878 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ad6419-7529-4a62-9fea-99d104ec5705-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.697107 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.697089 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a9ad6419-7529-4a62-9fea-99d104ec5705-metrics-server-audit-profiles\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.698780 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.698761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-secret-metrics-server-client-certs\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.699077 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.699056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-secret-metrics-server-tls\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.699223 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.699202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a9ad6419-7529-4a62-9fea-99d104ec5705-client-ca-bundle\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.703737 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.703716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7shx\" (UniqueName: \"kubernetes.io/projected/a9ad6419-7529-4a62-9fea-99d104ec5705-kube-api-access-k7shx\") pod \"metrics-server-865cbb6f69-z4jhj\" (UID: \"a9ad6419-7529-4a62-9fea-99d104ec5705\") " pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:31.873786 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:31.873699 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:32.014455 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:32.014419 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-865cbb6f69-z4jhj"] May 28 17:46:32.018212 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:46:32.018184 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ad6419_7529_4a62_9fea_99d104ec5705.slice/crio-be6b2bee12208befadc863faa4f45745796849a76eeaf7c285736c6a0726ce8b WatchSource:0}: Error finding container be6b2bee12208befadc863faa4f45745796849a76eeaf7c285736c6a0726ce8b: Status 404 returned error can't find the container with id be6b2bee12208befadc863faa4f45745796849a76eeaf7c285736c6a0726ce8b May 28 17:46:32.712845 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:32.712782 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" event={"ID":"a9ad6419-7529-4a62-9fea-99d104ec5705","Type":"ContainerStarted","Data":"be6b2bee12208befadc863faa4f45745796849a76eeaf7c285736c6a0726ce8b"} May 28 17:46:33.384307 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.384264 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:46:33.388087 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.388051 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.390738 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.390707 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 17:46:33.390910 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.390797 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 17:46:33.391008 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.390908 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 17:46:33.391112 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.391038 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-snx5q\"" May 28 17:46:33.391181 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.391120 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 17:46:33.391792 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.391765 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 17:46:33.391908 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.391768 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 17:46:33.391908 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.391835 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 17:46:33.391908 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.391779 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 17:46:33.391908 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.391793 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a7ngq0hptso8l\"" May 28 17:46:33.392137 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.392119 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 17:46:33.392257 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.392238 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 17:46:33.395183 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.395117 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 17:46:33.398292 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.398273 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 17:46:33.405271 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.405248 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:46:33.510704 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.510832 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510716 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-web-config\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.510832 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.510832 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.510959 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.510959 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-config\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.510959 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.510959 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.510959 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511129 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.510985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrn7f\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-kube-api-access-jrn7f\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511129 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.511008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511129 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.511037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-config-out\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511129 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.511106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511245 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.511136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511245 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.511155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511245 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.511174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511245 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.511210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.511363 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.511280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612096 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612059 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrn7f\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-kube-api-access-jrn7f\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612096 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612100 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612122 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-config-out\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612144 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612167 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612193 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612211 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612234 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612275 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612294 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612316 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-web-config\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612759 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612343 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612759 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612364 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612759 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612386 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612759 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612405 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-config\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612984 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612953 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.612984 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.612971 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.613093 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.613026 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.613093 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.613060 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.614108 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.613717 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.614108 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.613753 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.614108 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.613993 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.615492 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.615466 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.616451 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.616426 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-config-out\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.616559 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.616477 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-config\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.617027 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.617004 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.617158 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.617114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.617673 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.617644 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.618933 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.618741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.619308 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.619033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.619308 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.619044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.619308 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.619094 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.619308 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.619206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-web-config\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.619548 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.619442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.620454 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.620434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.621001 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.620981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrn7f\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-kube-api-access-jrn7f\") pod \"prometheus-k8s-0\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.701647 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.701613 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:33.717551 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.717501 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" event={"ID":"a9ad6419-7529-4a62-9fea-99d104ec5705","Type":"ContainerStarted","Data":"6f6077ec9c0c4e6d50f6ce8389a3520ac815479ee5c1fc2398cd74d83d69294a"} May 28 17:46:33.734244 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.734195 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" podStartSLOduration=1.280165623 podStartE2EDuration="2.734181347s" podCreationTimestamp="2026-05-28 17:46:31 +0000 UTC" firstStartedPulling="2026-05-28 17:46:32.020313212 +0000 UTC m=+178.453312018" lastFinishedPulling="2026-05-28 17:46:33.474328935 +0000 UTC m=+179.907327742" observedRunningTime="2026-05-28 17:46:33.733143021 +0000 UTC m=+180.166141846" watchObservedRunningTime="2026-05-28 17:46:33.734181347 +0000 UTC m=+180.167180171" May 28 17:46:33.832441 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:33.832417 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:46:33.834363 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:46:33.834335 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf617ff8b_15e1_49b1_9ebd_bc1575841610.slice/crio-08c88405197c38fe8efcb9024afdb8cba1274c3f91bf957852a2f40590a80b7b WatchSource:0}: Error finding container 08c88405197c38fe8efcb9024afdb8cba1274c3f91bf957852a2f40590a80b7b: Status 404 returned error can't find the container with id 08c88405197c38fe8efcb9024afdb8cba1274c3f91bf957852a2f40590a80b7b May 28 17:46:34.720917 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:34.720874 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerStarted","Data":"08c88405197c38fe8efcb9024afdb8cba1274c3f91bf957852a2f40590a80b7b"} May 28 17:46:35.724362 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:35.724330 2563 generic.go:358] "Generic (PLEG): container finished" podID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" exitCode=0 May 28 17:46:35.724722 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:35.724429 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerDied","Data":"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee"} May 28 17:46:38.734681 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:38.734651 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerStarted","Data":"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832"} May 28 17:46:39.678007 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:39.677979 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7ddb858746-5dfps" May 28 17:46:39.740640 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:39.740596 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerStarted","Data":"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762"} May 28 17:46:40.746023 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:40.745993 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerStarted","Data":"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449"} May 28 17:46:40.746023 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:40.746027 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerStarted","Data":"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c"} May 28 17:46:40.746427 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:40.746036 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerStarted","Data":"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0"} May 28 17:46:40.746427 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:40.746045 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerStarted","Data":"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a"} May 28 17:46:40.771890 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:40.771843 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.2783142220000001 podStartE2EDuration="7.771828208s" podCreationTimestamp="2026-05-28 17:46:33 +0000 UTC" firstStartedPulling="2026-05-28 17:46:33.836261275 +0000 UTC m=+180.269260077" lastFinishedPulling="2026-05-28 17:46:40.329775256 +0000 UTC m=+186.762774063" observedRunningTime="2026-05-28 17:46:40.770334422 +0000 UTC m=+187.203333243" watchObservedRunningTime="2026-05-28 17:46:40.771828208 +0000 UTC m=+187.204827026" May 28 17:46:41.182057 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:41.182027 2563 scope.go:117] "RemoveContainer" containerID="9a27192b3b714b2ba501abdf86d9bf454554d6b50de6a36ecea26728d84ceb0e" May 28 17:46:41.751074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:41.751045 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:46:41.751425 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:41.751165 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" event={"ID":"e7bd135b-f3ca-44c0-afa1-be54c56dab99","Type":"ContainerStarted","Data":"18a9455053c57d59855f3cfc2421b2332cd5c80a93fed494c89736166ee309d4"} May 28 17:46:41.774648 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:41.774600 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" podStartSLOduration=54.764480779 podStartE2EDuration="57.774585343s" podCreationTimestamp="2026-05-28 17:45:44 +0000 UTC" firstStartedPulling="2026-05-28 17:45:45.208410659 +0000 UTC m=+131.641409465" lastFinishedPulling="2026-05-28 17:45:48.218515227 +0000 UTC m=+134.651514029" observedRunningTime="2026-05-28 17:46:41.773587189 +0000 UTC m=+188.206586013" watchObservedRunningTime="2026-05-28 17:46:41.774585343 +0000 UTC m=+188.207584219" May 28 17:46:43.702142 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:43.702101 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:46:51.751712 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:51.751674 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:46:51.755452 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:51.755428 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-6rswz" May 28 17:46:51.874598 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:51.874563 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:46:51.874598 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:46:51.874608 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:47:04.818552 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:04.818518 2563 generic.go:358] "Generic (PLEG): container finished" podID="de241f6a-5709-4975-813e-cab401a8ceb2" containerID="85703a468f56719df35bc1133377f9a52f1ef98e9c1be15e1ae4616e6d4ab1a3" exitCode=0 May 28 17:47:04.818944 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:04.818595 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" event={"ID":"de241f6a-5709-4975-813e-cab401a8ceb2","Type":"ContainerDied","Data":"85703a468f56719df35bc1133377f9a52f1ef98e9c1be15e1ae4616e6d4ab1a3"} May 28 17:47:04.818989 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:04.818964 2563 scope.go:117] "RemoveContainer" containerID="85703a468f56719df35bc1133377f9a52f1ef98e9c1be15e1ae4616e6d4ab1a3" May 28 17:47:05.822651 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:05.822616 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7dfkj" event={"ID":"de241f6a-5709-4975-813e-cab401a8ceb2","Type":"ContainerStarted","Data":"872e28e0443e0da0b757f39dc04ab86b08455a6d15f6a18b379eeb1815e60b25"} May 28 17:47:11.879323 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:11.879291 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:47:11.883068 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:11.883046 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-865cbb6f69-z4jhj" May 28 17:47:14.850070 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:14.849983 2563 generic.go:358] "Generic (PLEG): container finished" podID="7f69b95e-e61c-4d42-bbe1-111800cf5b0c" containerID="1ba8ab90db6ff859a9144ebdc902b645154cb3d8d787e4fc0f36795bf473f684" exitCode=0 May 28 17:47:14.850070 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:14.850048 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" event={"ID":"7f69b95e-e61c-4d42-bbe1-111800cf5b0c","Type":"ContainerDied","Data":"1ba8ab90db6ff859a9144ebdc902b645154cb3d8d787e4fc0f36795bf473f684"} May 28 17:47:14.850453 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:14.850390 2563 scope.go:117] "RemoveContainer" containerID="1ba8ab90db6ff859a9144ebdc902b645154cb3d8d787e4fc0f36795bf473f684" May 28 17:47:15.854604 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:15.854571 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nrpxh" event={"ID":"7f69b95e-e61c-4d42-bbe1-111800cf5b0c","Type":"ContainerStarted","Data":"b889709b03eb5bec2160afe25e146bb5b5d45d42a2e3cf28377bc2117bf113dc"} May 28 17:47:33.702216 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:33.702172 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:33.722544 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:33.722513 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:33.927865 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:33.927834 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:45.941922 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:45.941800 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:47:45.944009 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:45.943979 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c4db03d-65d8-4ba9-92fa-e7d7b1381230-metrics-certs\") pod \"network-metrics-daemon-x4wkc\" (UID: \"9c4db03d-65d8-4ba9-92fa-e7d7b1381230\") " pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:47:46.087550 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:46.087517 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wt76\"" May 28 17:47:46.095241 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:46.095222 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4wkc" May 28 17:47:46.220683 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:46.220600 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4wkc"] May 28 17:47:46.224773 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:47:46.224738 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4db03d_65d8_4ba9_92fa_e7d7b1381230.slice/crio-cf95f3c58d42e75efea0c63afb71978db699a21d3b16b6fa3ef1e75291065b1d WatchSource:0}: Error finding container cf95f3c58d42e75efea0c63afb71978db699a21d3b16b6fa3ef1e75291065b1d: Status 404 returned error can't find the container with id cf95f3c58d42e75efea0c63afb71978db699a21d3b16b6fa3ef1e75291065b1d May 28 17:47:46.951478 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:46.951428 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4wkc" event={"ID":"9c4db03d-65d8-4ba9-92fa-e7d7b1381230","Type":"ContainerStarted","Data":"cf95f3c58d42e75efea0c63afb71978db699a21d3b16b6fa3ef1e75291065b1d"} May 28 17:47:47.955612 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:47.955576 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4wkc" event={"ID":"9c4db03d-65d8-4ba9-92fa-e7d7b1381230","Type":"ContainerStarted","Data":"d67342583973c89b88ce03c115d72d8d963a2902d321a228dfa3a567a680824e"} May 28 17:47:47.955612 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:47.955612 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4wkc" event={"ID":"9c4db03d-65d8-4ba9-92fa-e7d7b1381230","Type":"ContainerStarted","Data":"dd41a09364efe440a169efc29e44a3d4d75ff08b229eea2ce230e01901383b85"} May 28 17:47:47.970578 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:47.970515 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x4wkc" podStartSLOduration=253.038713726 podStartE2EDuration="4m13.970498574s" podCreationTimestamp="2026-05-28 17:43:34 +0000 UTC" firstStartedPulling="2026-05-28 17:47:46.228603661 +0000 UTC m=+252.661602467" lastFinishedPulling="2026-05-28 17:47:47.160388509 +0000 UTC m=+253.593387315" observedRunningTime="2026-05-28 17:47:47.97006433 +0000 UTC m=+254.403063180" watchObservedRunningTime="2026-05-28 17:47:47.970498574 +0000 UTC m=+254.403497400" May 28 17:47:51.697556 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.697521 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:47:51.698357 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.698233 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="prometheus" containerID="cri-o://9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" gracePeriod=600 May 28 17:47:51.698357 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.698255 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy" containerID="cri-o://1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" gracePeriod=600 May 28 17:47:51.698357 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.698264 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="thanos-sidecar" containerID="cri-o://657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" gracePeriod=600 May 28 17:47:51.698357 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.698309 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="config-reloader" containerID="cri-o://9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" gracePeriod=600 May 28 17:47:51.698630 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.698268 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy-web" containerID="cri-o://e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" gracePeriod=600 May 28 17:47:51.698630 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.698311 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy-thanos" containerID="cri-o://110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" gracePeriod=600 May 28 17:47:51.926128 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.926103 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:51.969409 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969328 2563 generic.go:358] "Generic (PLEG): container finished" podID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" exitCode=0 May 28 17:47:51.969409 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969356 2563 generic.go:358] "Generic (PLEG): container finished" podID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" exitCode=0 May 28 17:47:51.969409 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969364 2563 generic.go:358] "Generic (PLEG): container finished" podID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" exitCode=0 May 28 17:47:51.969409 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969371 2563 generic.go:358] "Generic (PLEG): container finished" podID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" exitCode=0 May 28 17:47:51.969409 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969379 2563 generic.go:358] "Generic (PLEG): container finished" podID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" exitCode=0 May 28 17:47:51.969409 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969389 2563 generic.go:358] "Generic (PLEG): container finished" podID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" exitCode=0 May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969413 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerDied","Data":"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449"} May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969454 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerDied","Data":"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c"} May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969465 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerDied","Data":"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0"} May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969475 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerDied","Data":"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a"} May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969474 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969485 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerDied","Data":"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762"} May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969495 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerDied","Data":"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832"} May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969504 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f617ff8b-15e1-49b1-9ebd-bc1575841610","Type":"ContainerDied","Data":"08c88405197c38fe8efcb9024afdb8cba1274c3f91bf957852a2f40590a80b7b"} May 28 17:47:51.969844 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.969520 2563 scope.go:117] "RemoveContainer" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" May 28 17:47:51.979092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.979066 2563 scope.go:117] "RemoveContainer" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" May 28 17:47:51.986192 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.986171 2563 scope.go:117] "RemoveContainer" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" May 28 17:47:51.992711 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.992684 2563 scope.go:117] "RemoveContainer" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" May 28 17:47:51.998934 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:51.998918 2563 scope.go:117] "RemoveContainer" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" May 28 17:47:52.003076 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003055 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-web-config\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003085 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-metrics-client-ca\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003106 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-config\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003125 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003165 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003160 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrn7f\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-kube-api-access-jrn7f\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003360 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003189 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-kube-rbac-proxy\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003360 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003215 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-kubelet-serving-ca-bundle\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003360 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003257 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-metrics-client-certs\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003360 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003285 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-tls-assets\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003360 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003317 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-db\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.003598 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003481 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003692 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-trusted-ca-bundle\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003749 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003789 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-tls\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003835 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-serving-certs-ca-bundle\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003864 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-rulefiles-0\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003903 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-grpc-tls\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003936 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-thanos-prometheus-http-client-file\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.003998 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-config-out\") pod \"f617ff8b-15e1-49b1-9ebd-bc1575841610\" (UID: \"f617ff8b-15e1-49b1-9ebd-bc1575841610\") " May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.004147 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.004298 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.004569 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.004318 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-metrics-client-ca\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.005885 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.005404 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:47:52.005885 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.005508 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:47:52.005885 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.005517 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:47:52.006215 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.006190 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-config" (OuterVolumeSpecName: "config") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.006305 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.006245 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:47:52.006672 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.006642 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.007544 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.007059 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 17:47:52.007714 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.007634 2563 scope.go:117] "RemoveContainer" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" May 28 17:47:52.009749 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.008395 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-kube-api-access-jrn7f" (OuterVolumeSpecName: "kube-api-access-jrn7f") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "kube-api-access-jrn7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:47:52.009749 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.008916 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.009749 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.009172 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.009749 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.009336 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.009749 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.009631 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-config-out" (OuterVolumeSpecName: "config-out") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 17:47:52.010485 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.010455 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.010741 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.010708 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.010869 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.010782 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.015856 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.015822 2563 scope.go:117] "RemoveContainer" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" May 28 17:47:52.019303 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.019279 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-web-config" (OuterVolumeSpecName: "web-config") pod "f617ff8b-15e1-49b1-9ebd-bc1575841610" (UID: "f617ff8b-15e1-49b1-9ebd-bc1575841610"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 17:47:52.022052 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.022039 2563 scope.go:117] "RemoveContainer" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" May 28 17:47:52.022300 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:47:52.022275 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": container with ID starting with 110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449 not found: ID does not exist" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" May 28 17:47:52.022343 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.022298 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449"} err="failed to get container status \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": rpc error: code = NotFound desc = could not find container \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": container with ID starting with 110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449 not found: ID does not exist" May 28 17:47:52.022343 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.022333 2563 scope.go:117] "RemoveContainer" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" May 28 17:47:52.022547 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:47:52.022530 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": container with ID starting with 1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c not found: ID does not exist" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" May 28 17:47:52.022586 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.022551 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c"} err="failed to get container status \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": rpc error: code = NotFound desc = could not find container \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": container with ID starting with 1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c not found: ID does not exist" May 28 17:47:52.022586 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.022565 2563 scope.go:117] "RemoveContainer" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" May 28 17:47:52.022772 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:47:52.022756 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": container with ID starting with e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0 not found: ID does not exist" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" May 28 17:47:52.022821 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.022778 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0"} err="failed to get container status \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": rpc error: code = NotFound desc = could not find container \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": container with ID starting with e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0 not found: ID does not exist" May 28 17:47:52.022821 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.022790 2563 scope.go:117] "RemoveContainer" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" May 28 17:47:52.022996 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:47:52.022981 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": container with ID starting with 657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a not found: ID does not exist" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" May 28 17:47:52.023031 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023000 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a"} err="failed to get container status \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": rpc error: code = NotFound desc = could not find container \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": container with ID starting with 657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a not found: ID does not exist" May 28 17:47:52.023031 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023011 2563 scope.go:117] "RemoveContainer" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" May 28 17:47:52.023201 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:47:52.023187 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": container with ID starting with 9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762 not found: ID does not exist" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" May 28 17:47:52.023245 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023204 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762"} err="failed to get container status \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": rpc error: code = NotFound desc = could not find container \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": container with ID starting with 9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762 not found: ID does not exist" May 28 17:47:52.023245 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023215 2563 scope.go:117] "RemoveContainer" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" May 28 17:47:52.023405 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:47:52.023390 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": container with ID starting with 9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832 not found: ID does not exist" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" May 28 17:47:52.023450 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023409 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832"} err="failed to get container status \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": rpc error: code = NotFound desc = could not find container \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": container with ID starting with 9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832 not found: ID does not exist" May 28 17:47:52.023450 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023419 2563 scope.go:117] "RemoveContainer" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" May 28 17:47:52.023599 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:47:52.023582 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": container with ID starting with 3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee not found: ID does not exist" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" May 28 17:47:52.023638 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023605 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee"} err="failed to get container status \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": rpc error: code = NotFound desc = could not find container \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": container with ID starting with 3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee not found: ID does not exist" May 28 17:47:52.023638 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023622 2563 scope.go:117] "RemoveContainer" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" May 28 17:47:52.023781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023765 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449"} err="failed to get container status \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": rpc error: code = NotFound desc = could not find container \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": container with ID starting with 110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449 not found: ID does not exist" May 28 17:47:52.023853 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.023781 2563 scope.go:117] "RemoveContainer" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" May 28 17:47:52.024026 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024010 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c"} err="failed to get container status \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": rpc error: code = NotFound desc = could not find container \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": container with ID starting with 1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c not found: ID does not exist" May 28 17:47:52.024069 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024026 2563 scope.go:117] "RemoveContainer" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" May 28 17:47:52.024207 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024191 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0"} err="failed to get container status \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": rpc error: code = NotFound desc = could not find container \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": container with ID starting with e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0 not found: ID does not exist" May 28 17:47:52.024252 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024207 2563 scope.go:117] "RemoveContainer" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" May 28 17:47:52.024366 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024348 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a"} err="failed to get container status \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": rpc error: code = NotFound desc = could not find container \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": container with ID starting with 657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a not found: ID does not exist" May 28 17:47:52.024408 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024368 2563 scope.go:117] "RemoveContainer" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" May 28 17:47:52.024532 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024514 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762"} err="failed to get container status \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": rpc error: code = NotFound desc = could not find container \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": container with ID starting with 9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762 not found: ID does not exist" May 28 17:47:52.024573 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024533 2563 scope.go:117] "RemoveContainer" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" May 28 17:47:52.024740 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024724 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832"} err="failed to get container status \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": rpc error: code = NotFound desc = could not find container \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": container with ID starting with 9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832 not found: ID does not exist" May 28 17:47:52.024786 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024741 2563 scope.go:117] "RemoveContainer" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" May 28 17:47:52.025015 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.024999 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee"} err="failed to get container status \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": rpc error: code = NotFound desc = could not find container \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": container with ID starting with 3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee not found: ID does not exist" May 28 17:47:52.025074 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025016 2563 scope.go:117] "RemoveContainer" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" May 28 17:47:52.025224 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025206 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449"} err="failed to get container status \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": rpc error: code = NotFound desc = could not find container \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": container with ID starting with 110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449 not found: ID does not exist" May 28 17:47:52.025279 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025225 2563 scope.go:117] "RemoveContainer" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" May 28 17:47:52.025412 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025396 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c"} err="failed to get container status \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": rpc error: code = NotFound desc = could not find container \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": container with ID starting with 1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c not found: ID does not exist" May 28 17:47:52.025457 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025413 2563 scope.go:117] "RemoveContainer" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" May 28 17:47:52.025618 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025600 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0"} err="failed to get container status \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": rpc error: code = NotFound desc = could not find container \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": container with ID starting with e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0 not found: ID does not exist" May 28 17:47:52.025669 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025619 2563 scope.go:117] "RemoveContainer" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" May 28 17:47:52.025818 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025787 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a"} err="failed to get container status \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": rpc error: code = NotFound desc = could not find container \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": container with ID starting with 657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a not found: ID does not exist" May 28 17:47:52.025869 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025825 2563 scope.go:117] "RemoveContainer" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" May 28 17:47:52.026026 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.025999 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762"} err="failed to get container status \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": rpc error: code = NotFound desc = could not find container \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": container with ID starting with 9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762 not found: ID does not exist" May 28 17:47:52.026026 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026027 2563 scope.go:117] "RemoveContainer" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" May 28 17:47:52.026230 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026210 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832"} err="failed to get container status \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": rpc error: code = NotFound desc = could not find container \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": container with ID starting with 9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832 not found: ID does not exist" May 28 17:47:52.026298 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026232 2563 scope.go:117] "RemoveContainer" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" May 28 17:47:52.026473 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026456 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee"} err="failed to get container status \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": rpc error: code = NotFound desc = could not find container \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": container with ID starting with 3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee not found: ID does not exist" May 28 17:47:52.026510 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026474 2563 scope.go:117] "RemoveContainer" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" May 28 17:47:52.026668 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026651 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449"} err="failed to get container status \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": rpc error: code = NotFound desc = could not find container \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": container with ID starting with 110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449 not found: ID does not exist" May 28 17:47:52.026733 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026670 2563 scope.go:117] "RemoveContainer" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" May 28 17:47:52.026889 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026871 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c"} err="failed to get container status \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": rpc error: code = NotFound desc = could not find container \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": container with ID starting with 1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c not found: ID does not exist" May 28 17:47:52.026937 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.026889 2563 scope.go:117] "RemoveContainer" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" May 28 17:47:52.027111 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027093 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0"} err="failed to get container status \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": rpc error: code = NotFound desc = could not find container \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": container with ID starting with e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0 not found: ID does not exist" May 28 17:47:52.027157 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027112 2563 scope.go:117] "RemoveContainer" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" May 28 17:47:52.027312 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027294 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a"} err="failed to get container status \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": rpc error: code = NotFound desc = could not find container \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": container with ID starting with 657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a not found: ID does not exist" May 28 17:47:52.027358 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027313 2563 scope.go:117] "RemoveContainer" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" May 28 17:47:52.027503 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027482 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762"} err="failed to get container status \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": rpc error: code = NotFound desc = could not find container \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": container with ID starting with 9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762 not found: ID does not exist" May 28 17:47:52.027548 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027504 2563 scope.go:117] "RemoveContainer" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" May 28 17:47:52.027699 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027680 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832"} err="failed to get container status \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": rpc error: code = NotFound desc = could not find container \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": container with ID starting with 9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832 not found: ID does not exist" May 28 17:47:52.027769 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027700 2563 scope.go:117] "RemoveContainer" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" May 28 17:47:52.027935 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027919 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee"} err="failed to get container status \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": rpc error: code = NotFound desc = could not find container \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": container with ID starting with 3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee not found: ID does not exist" May 28 17:47:52.027979 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.027935 2563 scope.go:117] "RemoveContainer" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" May 28 17:47:52.028131 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028109 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449"} err="failed to get container status \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": rpc error: code = NotFound desc = could not find container \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": container with ID starting with 110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449 not found: ID does not exist" May 28 17:47:52.028190 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028132 2563 scope.go:117] "RemoveContainer" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" May 28 17:47:52.028330 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028313 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c"} err="failed to get container status \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": rpc error: code = NotFound desc = could not find container \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": container with ID starting with 1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c not found: ID does not exist" May 28 17:47:52.028394 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028331 2563 scope.go:117] "RemoveContainer" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" May 28 17:47:52.028504 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028488 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0"} err="failed to get container status \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": rpc error: code = NotFound desc = could not find container \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": container with ID starting with e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0 not found: ID does not exist" May 28 17:47:52.028561 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028505 2563 scope.go:117] "RemoveContainer" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" May 28 17:47:52.028714 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028694 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a"} err="failed to get container status \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": rpc error: code = NotFound desc = could not find container \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": container with ID starting with 657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a not found: ID does not exist" May 28 17:47:52.028758 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028715 2563 scope.go:117] "RemoveContainer" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" May 28 17:47:52.028936 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028917 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762"} err="failed to get container status \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": rpc error: code = NotFound desc = could not find container \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": container with ID starting with 9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762 not found: ID does not exist" May 28 17:47:52.028997 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.028937 2563 scope.go:117] "RemoveContainer" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" May 28 17:47:52.029134 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029116 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832"} err="failed to get container status \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": rpc error: code = NotFound desc = could not find container \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": container with ID starting with 9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832 not found: ID does not exist" May 28 17:47:52.029179 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029135 2563 scope.go:117] "RemoveContainer" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" May 28 17:47:52.029346 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029329 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee"} err="failed to get container status \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": rpc error: code = NotFound desc = could not find container \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": container with ID starting with 3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee not found: ID does not exist" May 28 17:47:52.029408 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029346 2563 scope.go:117] "RemoveContainer" containerID="110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449" May 28 17:47:52.029562 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029545 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449"} err="failed to get container status \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": rpc error: code = NotFound desc = could not find container \"110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449\": container with ID starting with 110e2a93a2a8aa01434d81bc343dc37d3f7ca6f622811da4e301212d8aabd449 not found: ID does not exist" May 28 17:47:52.029602 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029563 2563 scope.go:117] "RemoveContainer" containerID="1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c" May 28 17:47:52.029756 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029739 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c"} err="failed to get container status \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": rpc error: code = NotFound desc = could not find container \"1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c\": container with ID starting with 1c2fcfd128e98c6c90a4e2d02232ae2500110e223320e23862770b9cfa67e71c not found: ID does not exist" May 28 17:47:52.029835 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029757 2563 scope.go:117] "RemoveContainer" containerID="e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0" May 28 17:47:52.029969 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029953 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0"} err="failed to get container status \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": rpc error: code = NotFound desc = could not find container \"e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0\": container with ID starting with e8a5ecca4835c33a5375b92431e714e46d40d2ad4b54f739f177a89f41b306a0 not found: ID does not exist" May 28 17:47:52.030033 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.029971 2563 scope.go:117] "RemoveContainer" containerID="657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a" May 28 17:47:52.030171 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.030156 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a"} err="failed to get container status \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": rpc error: code = NotFound desc = could not find container \"657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a\": container with ID starting with 657a99e384984e639c3dd17453e4a0b597a1edcf1814e6ac6a559b31a208305a not found: ID does not exist" May 28 17:47:52.030215 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.030171 2563 scope.go:117] "RemoveContainer" containerID="9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762" May 28 17:47:52.030354 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.030339 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762"} err="failed to get container status \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": rpc error: code = NotFound desc = could not find container \"9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762\": container with ID starting with 9d6a0c380f437d3c57f89651ffe118e7bbf82b30d2d754fe077e32ceb58ca762 not found: ID does not exist" May 28 17:47:52.030409 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.030353 2563 scope.go:117] "RemoveContainer" containerID="9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832" May 28 17:47:52.030552 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.030537 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832"} err="failed to get container status \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": rpc error: code = NotFound desc = could not find container \"9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832\": container with ID starting with 9f08dc3c1c41694b90ff5d81bfc88a252769eb865feb814f75b09d809f840832 not found: ID does not exist" May 28 17:47:52.030600 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.030553 2563 scope.go:117] "RemoveContainer" containerID="3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee" May 28 17:47:52.030740 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.030722 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee"} err="failed to get container status \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": rpc error: code = NotFound desc = could not find container \"3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee\": container with ID starting with 3db9896931ca2863148a9f8d8b984fd987d2e8a775052d5e62aeac20b7863aee not found: ID does not exist" May 28 17:47:52.105398 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105349 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105398 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105396 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105398 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105412 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105426 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-grpc-tls\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105440 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105452 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-config-out\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105463 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-web-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105474 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-config\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105486 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105498 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrn7f\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-kube-api-access-jrn7f\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105512 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-kube-rbac-proxy\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105524 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f617ff8b-15e1-49b1-9ebd-bc1575841610-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105538 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-metrics-client-certs\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105551 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f617ff8b-15e1-49b1-9ebd-bc1575841610-tls-assets\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105566 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f617ff8b-15e1-49b1-9ebd-bc1575841610-prometheus-k8s-db\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.105657 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.105580 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f617ff8b-15e1-49b1-9ebd-bc1575841610-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:47:52.287425 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.287354 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:47:52.291795 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.291765 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:47:52.314188 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314157 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:47:52.314478 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314462 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy-thanos" May 28 17:47:52.314522 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314482 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy-thanos" May 28 17:47:52.314522 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314495 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="prometheus" May 28 17:47:52.314522 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314502 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="prometheus" May 28 17:47:52.314522 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314517 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="config-reloader" May 28 17:47:52.314522 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314523 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="config-reloader" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314530 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy-web" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314535 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy-web" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314541 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314548 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314562 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="init-config-reloader" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314570 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="init-config-reloader" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314576 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="thanos-sidecar" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314581 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="thanos-sidecar" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314625 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314635 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy-thanos" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314645 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="kube-rbac-proxy-web" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314651 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="prometheus" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314657 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="config-reloader" May 28 17:47:52.314685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.314664 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" containerName="thanos-sidecar" May 28 17:47:52.319917 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.319898 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.322472 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.322451 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 28 17:47:52.322580 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.322512 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-snx5q\"" May 28 17:47:52.322580 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.322550 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 28 17:47:52.322692 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.322579 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 28 17:47:52.322692 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.322551 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 28 17:47:52.322800 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.322785 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 28 17:47:52.322990 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.322958 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 28 17:47:52.323086 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.323038 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 28 17:47:52.323086 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.323038 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 28 17:47:52.323221 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.323197 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 28 17:47:52.323449 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.323433 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a7ngq0hptso8l\"" May 28 17:47:52.323537 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.323435 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 28 17:47:52.325758 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.325727 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 28 17:47:52.328872 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.328840 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 28 17:47:52.330461 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.330420 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:47:52.408633 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408601 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.408633 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.408878 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.408878 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.408878 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98hw5\" (UniqueName: \"kubernetes.io/projected/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-kube-api-access-98hw5\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.408878 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.408954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-config\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409092 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409339 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409339 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409339 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409339 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409339 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.409339 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.409286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509655 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509605 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509655 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509654 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509910 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509675 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-config\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509910 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509698 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509910 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509713 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509910 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509735 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509910 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509756 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509910 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509781 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.509910 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.509828 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.510781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510605 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.510781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510671 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.510781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510710 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.510781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510736 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.510781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510753 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.510781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510764 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.511186 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510800 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.511186 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510846 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.511186 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510871 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.511186 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510911 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98hw5\" (UniqueName: \"kubernetes.io/projected/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-kube-api-access-98hw5\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.511186 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.510941 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513194 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.512841 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513194 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.512852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513194 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.512972 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-config\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513194 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.513068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513500 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.513337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513500 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.513416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513606 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.513522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513827 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.513790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.513929 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.513911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.514066 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.514049 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.514172 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.514152 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.515421 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.515399 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.515494 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.515425 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.515542 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.515489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.515684 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.515668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.521378 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.521356 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98hw5\" (UniqueName: \"kubernetes.io/projected/6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b-kube-api-access-98hw5\") pod \"prometheus-k8s-0\" (UID: \"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b\") " pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.630434 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.630334 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:47:52.762407 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.762375 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 28 17:47:52.764753 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:47:52.764719 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6e93e1_1e1c_4b2d_ba17_b5f09618a76b.slice/crio-162d459a01b1fd49f675a73263b67cf332051728c3a43f06f8e41919c55252a4 WatchSource:0}: Error finding container 162d459a01b1fd49f675a73263b67cf332051728c3a43f06f8e41919c55252a4: Status 404 returned error can't find the container with id 162d459a01b1fd49f675a73263b67cf332051728c3a43f06f8e41919c55252a4 May 28 17:47:52.975405 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.975370 2563 generic.go:358] "Generic (PLEG): container finished" podID="6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b" containerID="fe88a608a58c41799da050173c86b9cb180513e1bd2dc55ee5ea8f2e63cd1ef7" exitCode=0 May 28 17:47:52.975562 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.975426 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b","Type":"ContainerDied","Data":"fe88a608a58c41799da050173c86b9cb180513e1bd2dc55ee5ea8f2e63cd1ef7"} May 28 17:47:52.975562 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:52.975447 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b","Type":"ContainerStarted","Data":"162d459a01b1fd49f675a73263b67cf332051728c3a43f06f8e41919c55252a4"} May 28 17:47:53.980940 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:53.980842 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b","Type":"ContainerStarted","Data":"fd691366356144035925a023547c96d9a9dde92c40a668b27d0cb585f6bd6221"} May 28 17:47:53.980940 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:53.980892 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b","Type":"ContainerStarted","Data":"e8359f0ff34cb481b9d3053ddf8fd9c2b20b4804175f97b43545ac90044d3163"} May 28 17:47:53.980940 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:53.980905 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b","Type":"ContainerStarted","Data":"46d4231bea49cad0693f2b69a909f650e7d3348be914a5e4357c56c37548c381"} May 28 17:47:53.980940 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:53.980916 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b","Type":"ContainerStarted","Data":"b9e5cb7057744d781d5ace98975af59ada39d903d925a3fc73069fa29b494e04"} May 28 17:47:53.980940 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:53.980927 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b","Type":"ContainerStarted","Data":"066bcc0d06cb2082b1ebfc4c84440fc16b556ee134cafc54dc135b33498ade2c"} May 28 17:47:53.980940 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:53.980938 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b","Type":"ContainerStarted","Data":"a007bd9145be8938d59103014576d82b850b60201e8607e65984daaad7b47b95"} May 28 17:47:54.008456 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:54.008405 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.008389059 podStartE2EDuration="2.008389059s" podCreationTimestamp="2026-05-28 17:47:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:47:54.005719097 +0000 UTC m=+260.438717920" watchObservedRunningTime="2026-05-28 17:47:54.008389059 +0000 UTC m=+260.441387883" May 28 17:47:54.187017 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:54.186983 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f617ff8b-15e1-49b1-9ebd-bc1575841610" path="/var/lib/kubelet/pods/f617ff8b-15e1-49b1-9ebd-bc1575841610/volumes" May 28 17:47:57.631394 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:47:57.631357 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:48:34.077854 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:48:34.077824 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:48:34.079954 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:48:34.079930 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:48:34.091628 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:48:34.091604 2563 kubelet.go:1628] "Image garbage collection succeeded" May 28 17:48:52.631468 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:48:52.631417 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:48:52.646695 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:48:52.646670 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:48:53.175020 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:48:53.174997 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 28 17:51:05.542567 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.542486 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426"] May 28 17:51:05.545722 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.545707 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.549362 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.549333 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 28 17:51:05.549628 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.549599 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 28 17:51:05.549735 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.549627 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 28 17:51:05.549735 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.549702 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gdvhp\"" May 28 17:51:05.549735 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.549708 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 28 17:51:05.549735 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.549647 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 28 17:51:05.557205 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.557184 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426"] May 28 17:51:05.624321 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.624292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zfdh\" (UniqueName: \"kubernetes.io/projected/95ff1520-b692-4dd8-8821-3c15b3038676-kube-api-access-5zfdh\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.624502 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.624328 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95ff1520-b692-4dd8-8821-3c15b3038676-manager-config\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.624502 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.624349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95ff1520-b692-4dd8-8821-3c15b3038676-metrics-cert\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.624502 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.624470 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95ff1520-b692-4dd8-8821-3c15b3038676-cert\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.725438 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.725399 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zfdh\" (UniqueName: \"kubernetes.io/projected/95ff1520-b692-4dd8-8821-3c15b3038676-kube-api-access-5zfdh\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.725438 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.725444 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95ff1520-b692-4dd8-8821-3c15b3038676-manager-config\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.725685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.725465 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95ff1520-b692-4dd8-8821-3c15b3038676-metrics-cert\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.725685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.725507 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95ff1520-b692-4dd8-8821-3c15b3038676-cert\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.726190 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.726161 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/95ff1520-b692-4dd8-8821-3c15b3038676-manager-config\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.727952 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.727932 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/95ff1520-b692-4dd8-8821-3c15b3038676-metrics-cert\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.728108 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.728085 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95ff1520-b692-4dd8-8821-3c15b3038676-cert\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.734101 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.734082 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zfdh\" (UniqueName: \"kubernetes.io/projected/95ff1520-b692-4dd8-8821-3c15b3038676-kube-api-access-5zfdh\") pod \"lws-controller-manager-655c6bbdd5-cd426\" (UID: \"95ff1520-b692-4dd8-8821-3c15b3038676\") " pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.855221 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.855134 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:05.975931 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.975907 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426"] May 28 17:51:05.978413 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:51:05.978382 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ff1520_b692_4dd8_8821_3c15b3038676.slice/crio-34ebd97d8bfedb04809c397e447f685ab270e6157889a2d33d45157646c11025 WatchSource:0}: Error finding container 34ebd97d8bfedb04809c397e447f685ab270e6157889a2d33d45157646c11025: Status 404 returned error can't find the container with id 34ebd97d8bfedb04809c397e447f685ab270e6157889a2d33d45157646c11025 May 28 17:51:05.980141 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:05.980125 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:51:06.531126 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:06.531083 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" event={"ID":"95ff1520-b692-4dd8-8821-3c15b3038676","Type":"ContainerStarted","Data":"34ebd97d8bfedb04809c397e447f685ab270e6157889a2d33d45157646c11025"} May 28 17:51:08.538276 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:08.538241 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" event={"ID":"95ff1520-b692-4dd8-8821-3c15b3038676","Type":"ContainerStarted","Data":"6856f6a5ea6afdd6b31f44d61ad9aa4e8be21d794c5a1656f3cf364cd56f1e4f"} May 28 17:51:08.538672 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:08.538389 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:08.554143 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:08.554095 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" podStartSLOduration=1.143988976 podStartE2EDuration="3.554080675s" podCreationTimestamp="2026-05-28 17:51:05 +0000 UTC" firstStartedPulling="2026-05-28 17:51:05.980266081 +0000 UTC m=+452.413264883" lastFinishedPulling="2026-05-28 17:51:08.390357763 +0000 UTC m=+454.823356582" observedRunningTime="2026-05-28 17:51:08.551833376 +0000 UTC m=+454.984832192" watchObservedRunningTime="2026-05-28 17:51:08.554080675 +0000 UTC m=+454.987079558" May 28 17:51:14.572038 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.572004 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd"] May 28 17:51:14.575073 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.575055 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.580781 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.580754 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 28 17:51:14.580916 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.580871 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 28 17:51:14.580989 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.580878 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 28 17:51:14.581150 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.581127 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bpqhj\"" May 28 17:51:14.581658 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.581375 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 28 17:51:14.593779 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.593753 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd"] May 28 17:51:14.714281 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.714208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.714493 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.714288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpk9x\" (UniqueName: \"kubernetes.io/projected/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-kube-api-access-wpk9x\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.714493 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.714329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.815577 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.815533 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.815772 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.815604 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpk9x\" (UniqueName: \"kubernetes.io/projected/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-kube-api-access-wpk9x\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.815772 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.815640 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.818106 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.818082 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.818226 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.818206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.823131 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.823078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpk9x\" (UniqueName: \"kubernetes.io/projected/d6f52d68-7f74-4839-88e1-66d0dd2d5d8a-kube-api-access-wpk9x\") pod \"opendatahub-operator-controller-manager-65fbbfd459-hmrzd\" (UID: \"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:14.886002 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:14.885965 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:15.014949 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:15.014917 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd"] May 28 17:51:15.018456 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:51:15.018432 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f52d68_7f74_4839_88e1_66d0dd2d5d8a.slice/crio-b1318b81719013a0ccd9618c443d779116869c3531c8710642c700130b143ebc WatchSource:0}: Error finding container b1318b81719013a0ccd9618c443d779116869c3531c8710642c700130b143ebc: Status 404 returned error can't find the container with id b1318b81719013a0ccd9618c443d779116869c3531c8710642c700130b143ebc May 28 17:51:15.561277 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:15.561238 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" event={"ID":"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a","Type":"ContainerStarted","Data":"b1318b81719013a0ccd9618c443d779116869c3531c8710642c700130b143ebc"} May 28 17:51:18.571632 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:18.571593 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" event={"ID":"d6f52d68-7f74-4839-88e1-66d0dd2d5d8a","Type":"ContainerStarted","Data":"9f5395330a0a586cd33b2b4d9e4d3660d4e6510a00f75b97eb658bb5d8e6a7ff"} May 28 17:51:18.572026 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:18.571660 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:18.635203 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:18.635141 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" podStartSLOduration=2.11074778 podStartE2EDuration="4.63512541s" podCreationTimestamp="2026-05-28 17:51:14 +0000 UTC" firstStartedPulling="2026-05-28 17:51:15.020662335 +0000 UTC m=+461.453661137" lastFinishedPulling="2026-05-28 17:51:17.545039962 +0000 UTC m=+463.978038767" observedRunningTime="2026-05-28 17:51:18.633631205 +0000 UTC m=+465.066630041" watchObservedRunningTime="2026-05-28 17:51:18.63512541 +0000 UTC m=+465.068124236" May 28 17:51:19.545267 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:19.545238 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-655c6bbdd5-cd426" May 28 17:51:29.576888 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:29.576857 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65fbbfd459-hmrzd" May 28 17:51:33.016383 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.016347 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw"] May 28 17:51:33.019881 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.019863 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.022856 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.022833 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 28 17:51:33.023040 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.023026 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x89mj\"" May 28 17:51:33.024055 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.024040 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 17:51:33.024151 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.024071 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 17:51:33.024151 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.024070 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 28 17:51:33.037040 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.037015 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw"] May 28 17:51:33.059141 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.059106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da4a0940-2abe-45f2-bd39-b480a5ba9da5-tls-certs\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.059266 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.059161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da4a0940-2abe-45f2-bd39-b480a5ba9da5-tmp\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.059266 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.059184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5zb7\" (UniqueName: \"kubernetes.io/projected/da4a0940-2abe-45f2-bd39-b480a5ba9da5-kube-api-access-l5zb7\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.160130 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.160092 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da4a0940-2abe-45f2-bd39-b480a5ba9da5-tls-certs\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.160130 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.160132 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da4a0940-2abe-45f2-bd39-b480a5ba9da5-tmp\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.160362 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.160151 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zb7\" (UniqueName: \"kubernetes.io/projected/da4a0940-2abe-45f2-bd39-b480a5ba9da5-kube-api-access-l5zb7\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.162541 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.162515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da4a0940-2abe-45f2-bd39-b480a5ba9da5-tmp\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.162746 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.162724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da4a0940-2abe-45f2-bd39-b480a5ba9da5-tls-certs\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.168006 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.167983 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5zb7\" (UniqueName: \"kubernetes.io/projected/da4a0940-2abe-45f2-bd39-b480a5ba9da5-kube-api-access-l5zb7\") pod \"kube-auth-proxy-69d5fd6c96-kw7fw\" (UID: \"da4a0940-2abe-45f2-bd39-b480a5ba9da5\") " pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.329297 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.329203 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" May 28 17:51:33.454951 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.454925 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw"] May 28 17:51:33.457514 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:51:33.457481 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4a0940_2abe_45f2_bd39_b480a5ba9da5.slice/crio-fd94e386fad7bb4f3aa5e467a104d243581cfaa33fc10ac12cb59fed4a927836 WatchSource:0}: Error finding container fd94e386fad7bb4f3aa5e467a104d243581cfaa33fc10ac12cb59fed4a927836: Status 404 returned error can't find the container with id fd94e386fad7bb4f3aa5e467a104d243581cfaa33fc10ac12cb59fed4a927836 May 28 17:51:33.620188 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:33.620107 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" event={"ID":"da4a0940-2abe-45f2-bd39-b480a5ba9da5","Type":"ContainerStarted","Data":"fd94e386fad7bb4f3aa5e467a104d243581cfaa33fc10ac12cb59fed4a927836"} May 28 17:51:36.591570 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:36.591547 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 28 17:51:37.633756 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:37.633713 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" event={"ID":"da4a0940-2abe-45f2-bd39-b480a5ba9da5","Type":"ContainerStarted","Data":"29cabe1a46a4d9f666aca4a78df71a5a6697048759b794c446a1d971fc83f281"} May 28 17:51:37.649902 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:51:37.649854 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69d5fd6c96-kw7fw" podStartSLOduration=2.519980164 podStartE2EDuration="5.649838311s" podCreationTimestamp="2026-05-28 17:51:32 +0000 UTC" firstStartedPulling="2026-05-28 17:51:33.459215951 +0000 UTC m=+479.892214753" lastFinishedPulling="2026-05-28 17:51:36.589074084 +0000 UTC m=+483.022072900" observedRunningTime="2026-05-28 17:51:37.648454318 +0000 UTC m=+484.081453144" watchObservedRunningTime="2026-05-28 17:51:37.649838311 +0000 UTC m=+484.082837135" May 28 17:53:23.206795 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.206765 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7"] May 28 17:53:23.209941 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.209925 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.213713 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.213693 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 28 17:53:23.213713 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.213699 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cfxjz\"" May 28 17:53:23.214429 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.214412 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 28 17:53:23.214429 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.214422 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 28 17:53:23.214519 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.214420 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 28 17:53:23.231007 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.230985 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7"] May 28 17:53:23.281385 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.281350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6ffe237-8fab-44d9-9946-4cb1a4898845-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.281545 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.281399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6ffe237-8fab-44d9-9946-4cb1a4898845-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.281589 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.281540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8qvl\" (UniqueName: \"kubernetes.io/projected/d6ffe237-8fab-44d9-9946-4cb1a4898845-kube-api-access-v8qvl\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.382148 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.382110 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8qvl\" (UniqueName: \"kubernetes.io/projected/d6ffe237-8fab-44d9-9946-4cb1a4898845-kube-api-access-v8qvl\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.382311 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.382171 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6ffe237-8fab-44d9-9946-4cb1a4898845-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.382311 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.382215 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6ffe237-8fab-44d9-9946-4cb1a4898845-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.382881 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.382857 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d6ffe237-8fab-44d9-9946-4cb1a4898845-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.384580 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.384552 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6ffe237-8fab-44d9-9946-4cb1a4898845-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.402681 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.402657 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8qvl\" (UniqueName: \"kubernetes.io/projected/d6ffe237-8fab-44d9-9946-4cb1a4898845-kube-api-access-v8qvl\") pod \"kuadrant-console-plugin-6cb54b5c86-4tfn7\" (UID: \"d6ffe237-8fab-44d9-9946-4cb1a4898845\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.533667 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.533561 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" May 28 17:53:23.673970 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.673848 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7"] May 28 17:53:23.676820 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:53:23.676779 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6ffe237_8fab_44d9_9946_4cb1a4898845.slice/crio-1058acc4bf74c06e32e1b005d88a3f98c700fa8172a46bc1630a7942cd6ba468 WatchSource:0}: Error finding container 1058acc4bf74c06e32e1b005d88a3f98c700fa8172a46bc1630a7942cd6ba468: Status 404 returned error can't find the container with id 1058acc4bf74c06e32e1b005d88a3f98c700fa8172a46bc1630a7942cd6ba468 May 28 17:53:23.964259 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:23.964220 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" event={"ID":"d6ffe237-8fab-44d9-9946-4cb1a4898845","Type":"ContainerStarted","Data":"1058acc4bf74c06e32e1b005d88a3f98c700fa8172a46bc1630a7942cd6ba468"} May 28 17:53:45.854086 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:45.854059 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:53:45.854568 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:45.854301 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:53:46.040530 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:46.040492 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" event={"ID":"d6ffe237-8fab-44d9-9946-4cb1a4898845","Type":"ContainerStarted","Data":"a7a7d962e6e9090c04b686ef41b73c8b490b2eb592910e431e6cbc8f3785e7cf"} May 28 17:53:46.060334 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:53:46.060280 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4tfn7" podStartSLOduration=0.822762265 podStartE2EDuration="23.060266968s" podCreationTimestamp="2026-05-28 17:53:23 +0000 UTC" firstStartedPulling="2026-05-28 17:53:23.678446503 +0000 UTC m=+590.111445305" lastFinishedPulling="2026-05-28 17:53:45.915951201 +0000 UTC m=+612.348950008" observedRunningTime="2026-05-28 17:53:46.058872052 +0000 UTC m=+612.491870886" watchObservedRunningTime="2026-05-28 17:53:46.060266968 +0000 UTC m=+612.493265791" May 28 17:54:12.094802 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.094766 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:54:12.098161 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.098144 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:12.100595 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.100575 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 28 17:54:12.106096 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.106075 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:54:12.120093 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.120056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25822540-a109-4895-9e28-198140245064-config-file\") pod \"limitador-limitador-78c99df468-mpzrg\" (UID: \"25822540-a109-4895-9e28-198140245064\") " pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:12.120243 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.120112 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dks72\" (UniqueName: \"kubernetes.io/projected/25822540-a109-4895-9e28-198140245064-kube-api-access-dks72\") pod \"limitador-limitador-78c99df468-mpzrg\" (UID: \"25822540-a109-4895-9e28-198140245064\") " pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:12.131732 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.131708 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:54:12.221125 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.221041 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25822540-a109-4895-9e28-198140245064-config-file\") pod \"limitador-limitador-78c99df468-mpzrg\" (UID: \"25822540-a109-4895-9e28-198140245064\") " pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:12.221125 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.221100 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dks72\" (UniqueName: \"kubernetes.io/projected/25822540-a109-4895-9e28-198140245064-kube-api-access-dks72\") pod \"limitador-limitador-78c99df468-mpzrg\" (UID: \"25822540-a109-4895-9e28-198140245064\") " pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:12.221638 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.221618 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/25822540-a109-4895-9e28-198140245064-config-file\") pod \"limitador-limitador-78c99df468-mpzrg\" (UID: \"25822540-a109-4895-9e28-198140245064\") " pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:12.229508 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.229483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dks72\" (UniqueName: \"kubernetes.io/projected/25822540-a109-4895-9e28-198140245064-kube-api-access-dks72\") pod \"limitador-limitador-78c99df468-mpzrg\" (UID: \"25822540-a109-4895-9e28-198140245064\") " pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:12.408492 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.408444 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:12.531685 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.531661 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:54:12.533964 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:54:12.533931 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25822540_a109_4895_9e28_198140245064.slice/crio-716f51378d4a75f99fc38a7de6a404f526dde10e0f3872b8d5ade7b68f450e98 WatchSource:0}: Error finding container 716f51378d4a75f99fc38a7de6a404f526dde10e0f3872b8d5ade7b68f450e98: Status 404 returned error can't find the container with id 716f51378d4a75f99fc38a7de6a404f526dde10e0f3872b8d5ade7b68f450e98 May 28 17:54:12.633943 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.632024 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sdl5v"] May 28 17:54:12.638646 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.638615 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" May 28 17:54:12.640111 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.640070 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sdl5v"] May 28 17:54:12.641056 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.641038 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lxz22\"" May 28 17:54:12.725633 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.725589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmq4\" (UniqueName: \"kubernetes.io/projected/f1ddf991-baa4-4aa3-925b-1fe4aa002748-kube-api-access-njmq4\") pod \"authorino-f99f4b5cd-sdl5v\" (UID: \"f1ddf991-baa4-4aa3-925b-1fe4aa002748\") " pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" May 28 17:54:12.826871 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.826766 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njmq4\" (UniqueName: \"kubernetes.io/projected/f1ddf991-baa4-4aa3-925b-1fe4aa002748-kube-api-access-njmq4\") pod \"authorino-f99f4b5cd-sdl5v\" (UID: \"f1ddf991-baa4-4aa3-925b-1fe4aa002748\") " pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" May 28 17:54:12.834796 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.834773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmq4\" (UniqueName: \"kubernetes.io/projected/f1ddf991-baa4-4aa3-925b-1fe4aa002748-kube-api-access-njmq4\") pod \"authorino-f99f4b5cd-sdl5v\" (UID: \"f1ddf991-baa4-4aa3-925b-1fe4aa002748\") " pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" May 28 17:54:12.951059 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:12.951024 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" May 28 17:54:13.120226 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:13.120122 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sdl5v"] May 28 17:54:13.125290 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:54:13.125258 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1ddf991_baa4_4aa3_925b_1fe4aa002748.slice/crio-b0e6ed215f14f7fa454492b9f09ac96adfd39fdc44cca47675faf9f3c6a97c63 WatchSource:0}: Error finding container b0e6ed215f14f7fa454492b9f09ac96adfd39fdc44cca47675faf9f3c6a97c63: Status 404 returned error can't find the container with id b0e6ed215f14f7fa454492b9f09ac96adfd39fdc44cca47675faf9f3c6a97c63 May 28 17:54:13.127401 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:13.127345 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" event={"ID":"25822540-a109-4895-9e28-198140245064","Type":"ContainerStarted","Data":"716f51378d4a75f99fc38a7de6a404f526dde10e0f3872b8d5ade7b68f450e98"} May 28 17:54:14.135672 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:14.135617 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" event={"ID":"f1ddf991-baa4-4aa3-925b-1fe4aa002748","Type":"ContainerStarted","Data":"b0e6ed215f14f7fa454492b9f09ac96adfd39fdc44cca47675faf9f3c6a97c63"} May 28 17:54:17.147363 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:17.147324 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" event={"ID":"f1ddf991-baa4-4aa3-925b-1fe4aa002748","Type":"ContainerStarted","Data":"8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d"} May 28 17:54:17.154366 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:17.154323 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" event={"ID":"25822540-a109-4895-9e28-198140245064","Type":"ContainerStarted","Data":"49addf0dbbd67f9bda305957321baff332962b220355719f4c1bf3f284554471"} May 28 17:54:17.154548 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:17.154492 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:54:17.166300 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:17.166247 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" podStartSLOduration=1.304535579 podStartE2EDuration="5.166231462s" podCreationTimestamp="2026-05-28 17:54:12 +0000 UTC" firstStartedPulling="2026-05-28 17:54:13.126543182 +0000 UTC m=+639.559541987" lastFinishedPulling="2026-05-28 17:54:16.988239063 +0000 UTC m=+643.421237870" observedRunningTime="2026-05-28 17:54:17.164790008 +0000 UTC m=+643.597788833" watchObservedRunningTime="2026-05-28 17:54:17.166231462 +0000 UTC m=+643.599230287" May 28 17:54:17.190553 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:17.190508 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" podStartSLOduration=0.782602375 podStartE2EDuration="5.190492276s" podCreationTimestamp="2026-05-28 17:54:12 +0000 UTC" firstStartedPulling="2026-05-28 17:54:12.535686431 +0000 UTC m=+638.968685246" lastFinishedPulling="2026-05-28 17:54:16.943576344 +0000 UTC m=+643.376575147" observedRunningTime="2026-05-28 17:54:17.189413924 +0000 UTC m=+643.622412751" watchObservedRunningTime="2026-05-28 17:54:17.190492276 +0000 UTC m=+643.623491100" May 28 17:54:17.606038 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:17.606000 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sdl5v"] May 28 17:54:19.161424 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:19.161366 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" podUID="f1ddf991-baa4-4aa3-925b-1fe4aa002748" containerName="authorino" containerID="cri-o://8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d" gracePeriod=30 May 28 17:54:19.406418 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:19.406396 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" May 28 17:54:19.486476 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:19.486439 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njmq4\" (UniqueName: \"kubernetes.io/projected/f1ddf991-baa4-4aa3-925b-1fe4aa002748-kube-api-access-njmq4\") pod \"f1ddf991-baa4-4aa3-925b-1fe4aa002748\" (UID: \"f1ddf991-baa4-4aa3-925b-1fe4aa002748\") " May 28 17:54:19.488673 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:19.488639 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ddf991-baa4-4aa3-925b-1fe4aa002748-kube-api-access-njmq4" (OuterVolumeSpecName: "kube-api-access-njmq4") pod "f1ddf991-baa4-4aa3-925b-1fe4aa002748" (UID: "f1ddf991-baa4-4aa3-925b-1fe4aa002748"). InnerVolumeSpecName "kube-api-access-njmq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 17:54:19.588002 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:19.587964 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njmq4\" (UniqueName: \"kubernetes.io/projected/f1ddf991-baa4-4aa3-925b-1fe4aa002748-kube-api-access-njmq4\") on node \"ip-10-0-132-117.ec2.internal\" DevicePath \"\"" May 28 17:54:20.165136 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.165100 2563 generic.go:358] "Generic (PLEG): container finished" podID="f1ddf991-baa4-4aa3-925b-1fe4aa002748" containerID="8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d" exitCode=0 May 28 17:54:20.165527 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.165151 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" May 28 17:54:20.165527 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.165180 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" event={"ID":"f1ddf991-baa4-4aa3-925b-1fe4aa002748","Type":"ContainerDied","Data":"8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d"} May 28 17:54:20.165527 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.165216 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-sdl5v" event={"ID":"f1ddf991-baa4-4aa3-925b-1fe4aa002748","Type":"ContainerDied","Data":"b0e6ed215f14f7fa454492b9f09ac96adfd39fdc44cca47675faf9f3c6a97c63"} May 28 17:54:20.165527 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.165231 2563 scope.go:117] "RemoveContainer" containerID="8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d" May 28 17:54:20.173742 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.173724 2563 scope.go:117] "RemoveContainer" containerID="8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d" May 28 17:54:20.174041 ip-10-0-132-117 kubenswrapper[2563]: E0528 17:54:20.174019 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d\": container with ID starting with 8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d not found: ID does not exist" containerID="8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d" May 28 17:54:20.174117 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.174049 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d"} err="failed to get container status \"8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d\": rpc error: code = NotFound desc = could not find container \"8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d\": container with ID starting with 8377fd2b7f34ded15229de2b11c97028c3979a32c212a068bb9b5770c84ef37d not found: ID does not exist" May 28 17:54:20.186967 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.186937 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sdl5v"] May 28 17:54:20.190056 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:20.190035 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-sdl5v"] May 28 17:54:22.186089 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:22.186048 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1ddf991-baa4-4aa3-925b-1fe4aa002748" path="/var/lib/kubelet/pods/f1ddf991-baa4-4aa3-925b-1fe4aa002748/volumes" May 28 17:54:28.158668 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:54:28.158634 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-mpzrg" May 28 17:55:26.056879 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:55:26.056782 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:55:53.043336 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:55:53.043301 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:55:57.594997 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:55:57.594959 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:56:00.796887 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:00.796852 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:56:13.888793 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.888758 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv"] May 28 17:56:13.889271 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.889082 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ddf991-baa4-4aa3-925b-1fe4aa002748" containerName="authorino" May 28 17:56:13.889271 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.889093 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ddf991-baa4-4aa3-925b-1fe4aa002748" containerName="authorino" May 28 17:56:13.889271 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.889151 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1ddf991-baa4-4aa3-925b-1fe4aa002748" containerName="authorino" May 28 17:56:13.892503 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.892484 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:13.896029 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.896003 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 28 17:56:13.896399 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.896252 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 28 17:56:13.896399 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.896272 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7wjbl\"" May 28 17:56:13.896399 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.896301 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 28 17:56:13.904996 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:13.904972 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv"] May 28 17:56:14.007765 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.007731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.007943 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.007774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.007943 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.007854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab100c58-ec4a-4cc7-8873-33283be2a7c9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.007943 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.007873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k46kd\" (UniqueName: \"kubernetes.io/projected/ab100c58-ec4a-4cc7-8873-33283be2a7c9-kube-api-access-k46kd\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.008047 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.007950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.008047 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.007976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.109394 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.109354 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.109394 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.109393 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.109628 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.109457 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.109628 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.109479 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.109628 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.109511 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab100c58-ec4a-4cc7-8873-33283be2a7c9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.109628 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.109536 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k46kd\" (UniqueName: \"kubernetes.io/projected/ab100c58-ec4a-4cc7-8873-33283be2a7c9-kube-api-access-k46kd\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.109887 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.109863 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.109987 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.109933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.110047 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.110010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.111681 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.111659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab100c58-ec4a-4cc7-8873-33283be2a7c9-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.111947 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.111931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab100c58-ec4a-4cc7-8873-33283be2a7c9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.116603 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.116579 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k46kd\" (UniqueName: \"kubernetes.io/projected/ab100c58-ec4a-4cc7-8873-33283be2a7c9-kube-api-access-k46kd\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv\" (UID: \"ab100c58-ec4a-4cc7-8873-33283be2a7c9\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.208846 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.208790 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:14.337209 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.337177 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv"] May 28 17:56:14.340526 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:56:14.340502 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab100c58_ec4a_4cc7_8873_33283be2a7c9.slice/crio-a8feccb158bd5922cd9618ffdfd6774514220506909f2ca425fb945ff8442569 WatchSource:0}: Error finding container a8feccb158bd5922cd9618ffdfd6774514220506909f2ca425fb945ff8442569: Status 404 returned error can't find the container with id a8feccb158bd5922cd9618ffdfd6774514220506909f2ca425fb945ff8442569 May 28 17:56:14.342289 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.342270 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 17:56:14.530069 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.529987 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" event={"ID":"ab100c58-ec4a-4cc7-8873-33283be2a7c9","Type":"ContainerStarted","Data":"a8feccb158bd5922cd9618ffdfd6774514220506909f2ca425fb945ff8442569"} May 28 17:56:14.892890 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:14.892796 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:56:19.549727 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:19.549645 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" event={"ID":"ab100c58-ec4a-4cc7-8873-33283be2a7c9","Type":"ContainerStarted","Data":"8e6b40080974de79f38d225842a0bbca7f86ed794a403386b4c422fc046aa64e"} May 28 17:56:20.101013 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:20.100970 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:56:25.570728 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:25.570693 2563 generic.go:358] "Generic (PLEG): container finished" podID="ab100c58-ec4a-4cc7-8873-33283be2a7c9" containerID="8e6b40080974de79f38d225842a0bbca7f86ed794a403386b4c422fc046aa64e" exitCode=0 May 28 17:56:25.571190 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:25.570751 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" event={"ID":"ab100c58-ec4a-4cc7-8873-33283be2a7c9","Type":"ContainerDied","Data":"8e6b40080974de79f38d225842a0bbca7f86ed794a403386b4c422fc046aa64e"} May 28 17:56:27.580221 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:27.580187 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" event={"ID":"ab100c58-ec4a-4cc7-8873-33283be2a7c9","Type":"ContainerStarted","Data":"a9faf38721a57b83eaf93aa11dbfaadd31da5e530e962af457655939dfe4916b"} May 28 17:56:27.580604 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:27.580394 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:27.599328 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:27.599277 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" podStartSLOduration=2.240605092 podStartE2EDuration="14.599263624s" podCreationTimestamp="2026-05-28 17:56:13 +0000 UTC" firstStartedPulling="2026-05-28 17:56:14.342470839 +0000 UTC m=+760.775469643" lastFinishedPulling="2026-05-28 17:56:26.701129359 +0000 UTC m=+773.134128175" observedRunningTime="2026-05-28 17:56:27.596833485 +0000 UTC m=+774.029832312" watchObservedRunningTime="2026-05-28 17:56:27.599263624 +0000 UTC m=+774.032262449" May 28 17:56:35.090336 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.090300 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-978d58cf6-n99jb"] May 28 17:56:35.101987 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.101957 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-978d58cf6-n99jb"] May 28 17:56:35.102153 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.102062 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-978d58cf6-n99jb" May 28 17:56:35.105507 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.105481 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lxz22\"" May 28 17:56:35.105622 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.105502 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 28 17:56:35.195085 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.195046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09c83e18-6aa0-4149-8ecd-2064740b6e49-tls-cert\") pod \"authorino-978d58cf6-n99jb\" (UID: \"09c83e18-6aa0-4149-8ecd-2064740b6e49\") " pod="kuadrant-system/authorino-978d58cf6-n99jb" May 28 17:56:35.195262 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.195177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2jb\" (UniqueName: \"kubernetes.io/projected/09c83e18-6aa0-4149-8ecd-2064740b6e49-kube-api-access-xz2jb\") pod \"authorino-978d58cf6-n99jb\" (UID: \"09c83e18-6aa0-4149-8ecd-2064740b6e49\") " pod="kuadrant-system/authorino-978d58cf6-n99jb" May 28 17:56:35.295862 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.295797 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09c83e18-6aa0-4149-8ecd-2064740b6e49-tls-cert\") pod \"authorino-978d58cf6-n99jb\" (UID: \"09c83e18-6aa0-4149-8ecd-2064740b6e49\") " pod="kuadrant-system/authorino-978d58cf6-n99jb" May 28 17:56:35.296034 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.295931 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2jb\" (UniqueName: \"kubernetes.io/projected/09c83e18-6aa0-4149-8ecd-2064740b6e49-kube-api-access-xz2jb\") pod \"authorino-978d58cf6-n99jb\" (UID: \"09c83e18-6aa0-4149-8ecd-2064740b6e49\") " pod="kuadrant-system/authorino-978d58cf6-n99jb" May 28 17:56:35.298213 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.298190 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/09c83e18-6aa0-4149-8ecd-2064740b6e49-tls-cert\") pod \"authorino-978d58cf6-n99jb\" (UID: \"09c83e18-6aa0-4149-8ecd-2064740b6e49\") " pod="kuadrant-system/authorino-978d58cf6-n99jb" May 28 17:56:35.303375 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.303357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2jb\" (UniqueName: \"kubernetes.io/projected/09c83e18-6aa0-4149-8ecd-2064740b6e49-kube-api-access-xz2jb\") pod \"authorino-978d58cf6-n99jb\" (UID: \"09c83e18-6aa0-4149-8ecd-2064740b6e49\") " pod="kuadrant-system/authorino-978d58cf6-n99jb" May 28 17:56:35.412072 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.411999 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-978d58cf6-n99jb" May 28 17:56:35.544931 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.544898 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-978d58cf6-n99jb"] May 28 17:56:35.547894 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:56:35.547862 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09c83e18_6aa0_4149_8ecd_2064740b6e49.slice/crio-091d8f7fc2286450c54833a3192b683d28d04c44301eb97238a7e6f1007cfdc5 WatchSource:0}: Error finding container 091d8f7fc2286450c54833a3192b683d28d04c44301eb97238a7e6f1007cfdc5: Status 404 returned error can't find the container with id 091d8f7fc2286450c54833a3192b683d28d04c44301eb97238a7e6f1007cfdc5 May 28 17:56:35.610129 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:35.610091 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-978d58cf6-n99jb" event={"ID":"09c83e18-6aa0-4149-8ecd-2064740b6e49","Type":"ContainerStarted","Data":"091d8f7fc2286450c54833a3192b683d28d04c44301eb97238a7e6f1007cfdc5"} May 28 17:56:36.615726 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:36.615680 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-978d58cf6-n99jb" event={"ID":"09c83e18-6aa0-4149-8ecd-2064740b6e49","Type":"ContainerStarted","Data":"27902398518cf250ad6f041d93bbe34ffa4fdfc22cd8a5e0d98e4c2168872d03"} May 28 17:56:36.636258 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:36.636190 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-978d58cf6-n99jb" podStartSLOduration=1.065047598 podStartE2EDuration="1.636172332s" podCreationTimestamp="2026-05-28 17:56:35 +0000 UTC" firstStartedPulling="2026-05-28 17:56:35.549247525 +0000 UTC m=+781.982246326" lastFinishedPulling="2026-05-28 17:56:36.120372245 +0000 UTC m=+782.553371060" observedRunningTime="2026-05-28 17:56:36.634560916 +0000 UTC m=+783.067559737" watchObservedRunningTime="2026-05-28 17:56:36.636172332 +0000 UTC m=+783.069171157" May 28 17:56:38.596821 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:38.596781 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv" May 28 17:56:40.801871 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:40.801828 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:56:53.297895 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:53.297802 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:56:58.827589 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:56:58.827547 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:57:05.709173 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:57:05.709133 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:57:15.099376 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:57:15.099339 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:57:25.090167 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:57:25.090131 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:57:34.000870 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:57:34.000833 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:57:43.101106 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:57:43.101070 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:57:53.490460 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:57:53.490427 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:58:02.167271 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.167237 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57554dbf74-vsgrh"] May 28 17:58:02.170581 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.170563 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57554dbf74-vsgrh" May 28 17:58:02.173546 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.173525 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dk44f\"" May 28 17:58:02.173640 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.173581 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 28 17:58:02.178679 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.178656 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57554dbf74-vsgrh"] May 28 17:58:02.276170 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.276130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgfpc\" (UniqueName: \"kubernetes.io/projected/47f38c57-d424-4163-9516-ff99eb1637b3-kube-api-access-mgfpc\") pod \"maas-controller-57554dbf74-vsgrh\" (UID: \"47f38c57-d424-4163-9516-ff99eb1637b3\") " pod="opendatahub/maas-controller-57554dbf74-vsgrh" May 28 17:58:02.377385 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.377349 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgfpc\" (UniqueName: \"kubernetes.io/projected/47f38c57-d424-4163-9516-ff99eb1637b3-kube-api-access-mgfpc\") pod \"maas-controller-57554dbf74-vsgrh\" (UID: \"47f38c57-d424-4163-9516-ff99eb1637b3\") " pod="opendatahub/maas-controller-57554dbf74-vsgrh" May 28 17:58:02.386261 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.386237 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgfpc\" (UniqueName: \"kubernetes.io/projected/47f38c57-d424-4163-9516-ff99eb1637b3-kube-api-access-mgfpc\") pod \"maas-controller-57554dbf74-vsgrh\" (UID: \"47f38c57-d424-4163-9516-ff99eb1637b3\") " pod="opendatahub/maas-controller-57554dbf74-vsgrh" May 28 17:58:02.481927 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.481894 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57554dbf74-vsgrh" May 28 17:58:02.611285 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.611257 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57554dbf74-vsgrh"] May 28 17:58:02.614119 ip-10-0-132-117 kubenswrapper[2563]: W0528 17:58:02.614091 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f38c57_d424_4163_9516_ff99eb1637b3.slice/crio-3b9e1a58e9cf18e0313c05aaffe8d2bdd1c2e14e10b729ba77aaba81798f98f3 WatchSource:0}: Error finding container 3b9e1a58e9cf18e0313c05aaffe8d2bdd1c2e14e10b729ba77aaba81798f98f3: Status 404 returned error can't find the container with id 3b9e1a58e9cf18e0313c05aaffe8d2bdd1c2e14e10b729ba77aaba81798f98f3 May 28 17:58:02.903908 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:02.903820 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57554dbf74-vsgrh" event={"ID":"47f38c57-d424-4163-9516-ff99eb1637b3","Type":"ContainerStarted","Data":"3b9e1a58e9cf18e0313c05aaffe8d2bdd1c2e14e10b729ba77aaba81798f98f3"} May 28 17:58:05.915440 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:05.915405 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57554dbf74-vsgrh" event={"ID":"47f38c57-d424-4163-9516-ff99eb1637b3","Type":"ContainerStarted","Data":"d30e858bc24562c8114267c54e974bdb517c53a16841164ffc53ada2bdc76763"} May 28 17:58:05.915795 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:05.915567 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57554dbf74-vsgrh" May 28 17:58:05.935766 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:05.935716 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-57554dbf74-vsgrh" podStartSLOduration=1.631853877 podStartE2EDuration="3.935702109s" podCreationTimestamp="2026-05-28 17:58:02 +0000 UTC" firstStartedPulling="2026-05-28 17:58:02.615429391 +0000 UTC m=+869.048428193" lastFinishedPulling="2026-05-28 17:58:04.919277611 +0000 UTC m=+871.352276425" observedRunningTime="2026-05-28 17:58:05.934100962 +0000 UTC m=+872.367099787" watchObservedRunningTime="2026-05-28 17:58:05.935702109 +0000 UTC m=+872.368700932" May 28 17:58:16.926335 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:16.926255 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57554dbf74-vsgrh" May 28 17:58:27.198642 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:27.198606 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:58:32.894995 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:32.894951 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:58:45.876952 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:45.876923 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:58:45.878145 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:58:45.878122 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 17:59:08.899026 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:59:08.898974 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 17:59:24.002430 ip-10-0-132-117 kubenswrapper[2563]: I0528 17:59:24.002393 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:00:03.595009 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:00:03.594930 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:00:20.293531 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:00:20.293491 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:00:33.900600 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:00:33.900557 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:00:50.607238 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:00:50.607188 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:01:41.497790 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:01:41.497749 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:01:50.604112 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:01:50.604078 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:02:07.612823 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:02:07.612782 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:02:15.908187 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:02:15.908146 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:02:33.004455 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:02:33.004423 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:02:41.406775 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:02:41.406736 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:03:13.700253 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:03:13.700174 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:03:22.496991 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:03:22.496951 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:03:26.309430 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:03:26.309388 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:03:30.607414 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:03:30.607375 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:03:39.845761 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:03:39.845726 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:03:45.899823 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:03:45.899770 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:03:45.901598 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:03:45.901577 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:03:47.491607 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:03:47.491572 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:04:04.804825 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:04:04.804773 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:04:16.299937 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:04:16.299857 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:05:03.000772 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:05:03.000731 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:05:07.697561 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:05:07.697528 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:05:14.399467 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:05:14.399428 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:05:23.509924 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:05:23.509895 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:05:31.797660 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:05:31.797624 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:05:40.598297 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:05:40.598252 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:05:50.198381 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:05:50.198300 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:05:58.504853 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:05:58.504815 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:06:07.000314 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:06:07.000266 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:06:16.208826 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:06:16.208767 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:06:25.695705 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:06:25.695670 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:06:33.692743 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:06:33.692701 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:06:43.102507 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:06:43.102463 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:06:50.196051 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:06:50.196021 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:07:00.105767 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:07:00.105723 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:07:08.007198 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:07:08.007161 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:07:17.497779 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:07:17.497684 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:07:25.505374 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:07:25.505339 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:08:45.921860 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:08:45.921759 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:08:45.925640 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:08:45.925607 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:09:43.897057 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:09:43.897022 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:09:49.193733 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:09:49.193687 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:10:14.793192 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:10:14.793113 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:10:21.797222 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:10:21.797182 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:10:29.992680 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:10:29.992641 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:10:40.793304 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:10:40.793268 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:10:50.091402 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:10:50.091367 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:11:00.893947 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:11:00.893900 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:11:08.799177 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:11:08.799141 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:11:19.805956 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:11:19.805920 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:11:28.106968 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:11:28.106930 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:11:38.492090 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:11:38.492048 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:11:47.997145 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:11:47.997064 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:12:20.495344 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:12:20.495308 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:13:04.197144 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:04.197109 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:13:12.693278 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:12.693239 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:13:20.697550 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:20.697512 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:13:29.297227 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:29.297189 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:13:38.307235 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:38.307199 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:13:45.946320 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:45.946288 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:13:45.951234 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:45.951209 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:13:51.296259 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:51.296227 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:13:59.604218 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:13:59.604180 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:14:07.897216 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:14:07.897177 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:14:16.098122 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:14:16.098083 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:14:24.399283 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:14:24.399249 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:14:32.601240 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:14:32.601198 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:14:43.290528 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:14:43.290450 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:15:00.497171 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:15:00.497122 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:15:09.197431 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:15:09.197384 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:15:18.702286 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:15:18.702239 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:15:26.795931 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:15:26.795890 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:15:43.994580 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:15:43.994539 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:15:52.201580 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:15:52.201544 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:16:01.395797 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:16:01.395761 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:16:09.605422 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:16:09.605386 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:16:17.494879 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:16:17.494778 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:16:26.800562 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:16:26.800522 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:16:35.492955 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:16:35.492914 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:16:46.793187 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:16:46.793151 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:16:56.295656 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:16:56.295621 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:17:08.896719 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:17:08.896681 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:17:18.012341 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:17:18.012292 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:17:24.494469 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:17:24.494430 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:17:30.800823 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:17:30.800767 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:17:35.500528 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:17:35.500492 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:17:41.894969 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:17:41.894936 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:17:59.199128 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:17:59.199041 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:18:07.898414 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:18:07.898375 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:18:15.698398 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:18:15.698353 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:18:24.998955 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:18:24.998918 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:18:45.967849 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:18:45.967819 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:18:45.973101 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:18:45.973080 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:18:48.996950 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:18:48.996915 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:19:00.899436 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:00.899397 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-mpzrg"] May 28 18:19:04.414447 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:04.414398 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-978d58cf6-n99jb_09c83e18-6aa0-4149-8ecd-2064740b6e49/authorino/0.log" May 28 18:19:09.392682 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:09.392636 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57554dbf74-vsgrh_47f38c57-d424-4163-9516-ff99eb1637b3/manager/0.log" May 28 18:19:09.861998 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:09.861970 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65fbbfd459-hmrzd_d6f52d68-7f74-4839-88e1-66d0dd2d5d8a/manager/0.log" May 28 18:19:11.213055 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:11.213016 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-978d58cf6-n99jb_09c83e18-6aa0-4149-8ecd-2064740b6e49/authorino/0.log" May 28 18:19:11.549011 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:11.548935 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-4tfn7_d6ffe237-8fab-44d9-9946-4cb1a4898845/kuadrant-console-plugin/0.log" May 28 18:19:11.894545 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:11.894477 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-mpzrg_25822540-a109-4895-9e28-198140245064/limitador/0.log" May 28 18:19:12.583705 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:12.583674 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69d5fd6c96-kw7fw_da4a0940-2abe-45f2-bd39-b480a5ba9da5/kube-auth-proxy/0.log" May 28 18:19:13.390563 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:13.390486 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv_ab100c58-ec4a-4cc7-8873-33283be2a7c9/storage-initializer/0.log" May 28 18:19:13.397291 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:13.397262 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-v7lgv_ab100c58-ec4a-4cc7-8873-33283be2a7c9/main/0.log" May 28 18:19:20.609371 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:20.609333 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fwn49_1b2f0d38-33c1-49f3-9408-73201c526810/global-pull-secret-syncer/0.log" May 28 18:19:20.735627 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:20.735594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4hnkd_0e638c0d-3915-4cdf-a5e4-bf2e60e2daa1/konnectivity-agent/0.log" May 28 18:19:20.822010 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:20.821977 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-117.ec2.internal_dac997f939d98530aee128dc024cf247/haproxy/0.log" May 28 18:19:25.257876 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:25.257771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-978d58cf6-n99jb_09c83e18-6aa0-4149-8ecd-2064740b6e49/authorino/0.log" May 28 18:19:25.331419 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:25.331390 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-4tfn7_d6ffe237-8fab-44d9-9946-4cb1a4898845/kuadrant-console-plugin/0.log" May 28 18:19:25.453226 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:25.453197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-mpzrg_25822540-a109-4895-9e28-198140245064/limitador/0.log" May 28 18:19:27.198675 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.198638 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-kps2g_0081fed8-eeb2-44f1-927d-b3d66fc16c87/cluster-monitoring-operator/0.log" May 28 18:19:27.321913 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.321832 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-865cbb6f69-z4jhj_a9ad6419-7529-4a62-9fea-99d104ec5705/metrics-server/0.log" May 28 18:19:27.389705 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.389681 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8l828_5b813626-f239-46a9-9757-04dfec64cca8/node-exporter/0.log" May 28 18:19:27.411073 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.411049 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8l828_5b813626-f239-46a9-9757-04dfec64cca8/kube-rbac-proxy/0.log" May 28 18:19:27.430909 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.430883 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8l828_5b813626-f239-46a9-9757-04dfec64cca8/init-textfile/0.log" May 28 18:19:27.676365 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.676335 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b/prometheus/0.log" May 28 18:19:27.695051 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.695022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b/config-reloader/0.log" May 28 18:19:27.718570 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.718547 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b/thanos-sidecar/0.log" May 28 18:19:27.737569 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.737548 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b/kube-rbac-proxy-web/0.log" May 28 18:19:27.756946 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.756915 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b/kube-rbac-proxy/0.log" May 28 18:19:27.778078 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.778051 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b/kube-rbac-proxy-thanos/0.log" May 28 18:19:27.798210 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:27.798190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a6e93e1-1e1c-4b2d-ba17-b5f09618a76b/init-config-reloader/0.log" May 28 18:19:29.200492 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.200456 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2"] May 28 18:19:29.202847 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.202825 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.205252 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.205229 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v62rz\"/\"openshift-service-ca.crt\"" May 28 18:19:29.206283 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.206257 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v62rz\"/\"kube-root-ca.crt\"" May 28 18:19:29.206354 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.206257 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v62rz\"/\"default-dockercfg-kgtl6\"" May 28 18:19:29.213333 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.213313 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2"] May 28 18:19:29.249199 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.249169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-sys\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.249341 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.249213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wp48\" (UniqueName: \"kubernetes.io/projected/ff017a17-4c39-4b83-94c8-1cac4b4e7736-kube-api-access-7wp48\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.249341 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.249235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-podres\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.249341 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.249306 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-lib-modules\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.249457 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.249347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-proc\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.349714 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349679 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-proc\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.349714 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349719 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-sys\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.349932 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349755 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wp48\" (UniqueName: \"kubernetes.io/projected/ff017a17-4c39-4b83-94c8-1cac4b4e7736-kube-api-access-7wp48\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.349932 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349780 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-podres\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.349932 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-proc\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.349932 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349839 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-sys\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.349932 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349858 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-lib-modules\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.350093 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349945 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-podres\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.350093 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.349972 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff017a17-4c39-4b83-94c8-1cac4b4e7736-lib-modules\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.358010 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.357984 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wp48\" (UniqueName: \"kubernetes.io/projected/ff017a17-4c39-4b83-94c8-1cac4b4e7736-kube-api-access-7wp48\") pod \"perf-node-gather-daemonset-srcm2\" (UID: \"ff017a17-4c39-4b83-94c8-1cac4b4e7736\") " pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.514098 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.514011 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:29.643721 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.643688 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2"] May 28 18:19:29.647285 ip-10-0-132-117 kubenswrapper[2563]: W0528 18:19:29.647256 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podff017a17_4c39_4b83_94c8_1cac4b4e7736.slice/crio-9fce23e9ed9f8d4ea46a8f1a9cb91554107612984596e5bb07ae6d57f6382a50 WatchSource:0}: Error finding container 9fce23e9ed9f8d4ea46a8f1a9cb91554107612984596e5bb07ae6d57f6382a50: Status 404 returned error can't find the container with id 9fce23e9ed9f8d4ea46a8f1a9cb91554107612984596e5bb07ae6d57f6382a50 May 28 18:19:29.649285 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.649264 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 18:19:29.651013 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.650988 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/2.log" May 28 18:19:29.659863 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:29.659842 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-6rswz_e7bd135b-f3ca-44c0-afa1-be54c56dab99/console-operator/3.log" May 28 18:19:30.167191 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:30.167155 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" event={"ID":"ff017a17-4c39-4b83-94c8-1cac4b4e7736","Type":"ContainerStarted","Data":"ae1c7e66a3cc4257732b78d73d07b7aee992f52a00ac4b03eec7b9fed35f6999"} May 28 18:19:30.167191 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:30.167194 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" event={"ID":"ff017a17-4c39-4b83-94c8-1cac4b4e7736","Type":"ContainerStarted","Data":"9fce23e9ed9f8d4ea46a8f1a9cb91554107612984596e5bb07ae6d57f6382a50"} May 28 18:19:30.167420 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:30.167314 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:30.182154 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:30.182102 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" podStartSLOduration=1.182084793 podStartE2EDuration="1.182084793s" podCreationTimestamp="2026-05-28 18:19:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:19:30.180665578 +0000 UTC m=+2156.613664402" watchObservedRunningTime="2026-05-28 18:19:30.182084793 +0000 UTC m=+2156.615083620" May 28 18:19:31.544194 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:31.544160 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z69bn_36f49167-c818-4f84-8dcb-d0f68511b082/dns/0.log" May 28 18:19:31.562516 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:31.562487 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z69bn_36f49167-c818-4f84-8dcb-d0f68511b082/kube-rbac-proxy/0.log" May 28 18:19:31.583576 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:31.583553 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4mfs6_23841ef9-37f7-44b2-adf3-6d5075b49e32/dns-node-resolver/0.log" May 28 18:19:32.083188 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:32.083158 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7ddb858746-5dfps_ef5d2869-13bd-4ad1-9235-364e4c187700/registry/0.log" May 28 18:19:32.104103 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:32.104063 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2d8s6_7abdcaed-ff92-4f4b-88ec-bc8f69df88ca/node-ca/0.log" May 28 18:19:33.043737 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:33.043706 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69d5fd6c96-kw7fw_da4a0940-2abe-45f2-bd39-b480a5ba9da5/kube-auth-proxy/0.log" May 28 18:19:33.720894 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:33.720862 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pjtf4_8b49ae9f-d277-4747-a106-62a9b587b50f/serve-healthcheck-canary/0.log" May 28 18:19:34.198823 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:34.198764 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7dfkj_de241f6a-5709-4975-813e-cab401a8ceb2/insights-operator/0.log" May 28 18:19:34.199354 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:34.199201 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7dfkj_de241f6a-5709-4975-813e-cab401a8ceb2/insights-operator/1.log" May 28 18:19:34.343536 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:34.343505 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgg6n_617866bc-60c3-4363-865f-2e8e7df6cb6c/kube-rbac-proxy/0.log" May 28 18:19:34.362018 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:34.361967 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgg6n_617866bc-60c3-4363-865f-2e8e7df6cb6c/exporter/0.log" May 28 18:19:34.381303 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:34.381275 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vgg6n_617866bc-60c3-4363-865f-2e8e7df6cb6c/extractor/0.log" May 28 18:19:36.180783 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:36.180755 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v62rz/perf-node-gather-daemonset-srcm2" May 28 18:19:36.414484 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:36.414450 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57554dbf74-vsgrh_47f38c57-d424-4163-9516-ff99eb1637b3/manager/0.log" May 28 18:19:36.533199 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:36.533117 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65fbbfd459-hmrzd_d6f52d68-7f74-4839-88e1-66d0dd2d5d8a/manager/0.log" May 28 18:19:37.632775 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:37.632744 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-655c6bbdd5-cd426_95ff1520-b692-4dd8-8821-3c15b3038676/manager/0.log" May 28 18:19:42.061189 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:42.061147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-jqdd8_d4cb1ade-0638-45b2-95cc-a9526dc2c3ed/migrator/0.log" May 28 18:19:42.079071 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:42.078993 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-jqdd8_d4cb1ade-0638-45b2-95cc-a9526dc2c3ed/graceful-termination/0.log" May 28 18:19:43.510252 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:43.510221 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9sbkj_a44b540d-81bb-4cf5-a32d-6861afd0f572/kube-multus/0.log" May 28 18:19:43.532975 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:43.532945 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tqcj_60ec4c0e-688d-4645-906a-68cf86d27f13/kube-multus-additional-cni-plugins/0.log" May 28 18:19:43.553374 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:43.553346 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tqcj_60ec4c0e-688d-4645-906a-68cf86d27f13/egress-router-binary-copy/0.log" May 28 18:19:43.573358 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:43.573332 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tqcj_60ec4c0e-688d-4645-906a-68cf86d27f13/cni-plugins/0.log" May 28 18:19:43.591037 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:43.591009 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tqcj_60ec4c0e-688d-4645-906a-68cf86d27f13/bond-cni-plugin/0.log" May 28 18:19:43.609333 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:43.609307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tqcj_60ec4c0e-688d-4645-906a-68cf86d27f13/routeoverride-cni/0.log" May 28 18:19:43.633110 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:43.633079 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tqcj_60ec4c0e-688d-4645-906a-68cf86d27f13/whereabouts-cni-bincopy/0.log" May 28 18:19:43.653583 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:43.653544 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8tqcj_60ec4c0e-688d-4645-906a-68cf86d27f13/whereabouts-cni/0.log" May 28 18:19:44.149424 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:44.149371 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x4wkc_9c4db03d-65d8-4ba9-92fa-e7d7b1381230/network-metrics-daemon/0.log" May 28 18:19:44.168597 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:44.168572 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x4wkc_9c4db03d-65d8-4ba9-92fa-e7d7b1381230/kube-rbac-proxy/0.log" May 28 18:19:45.294884 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:45.294856 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjcbp_3a83df30-b02c-400e-b1d5-e9a4b9aad7ab/ovn-controller/0.log" May 28 18:19:45.328959 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:45.328924 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjcbp_3a83df30-b02c-400e-b1d5-e9a4b9aad7ab/ovn-acl-logging/0.log" May 28 18:19:45.350150 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:45.350122 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjcbp_3a83df30-b02c-400e-b1d5-e9a4b9aad7ab/kube-rbac-proxy-node/0.log" May 28 18:19:45.370208 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:45.370179 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjcbp_3a83df30-b02c-400e-b1d5-e9a4b9aad7ab/kube-rbac-proxy-ovn-metrics/0.log" May 28 18:19:45.384775 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:45.384747 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjcbp_3a83df30-b02c-400e-b1d5-e9a4b9aad7ab/northd/0.log" May 28 18:19:45.402253 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:45.402213 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjcbp_3a83df30-b02c-400e-b1d5-e9a4b9aad7ab/nbdb/0.log" May 28 18:19:45.422587 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:45.422553 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjcbp_3a83df30-b02c-400e-b1d5-e9a4b9aad7ab/sbdb/0.log" May 28 18:19:45.584513 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:45.584433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sjcbp_3a83df30-b02c-400e-b1d5-e9a4b9aad7ab/ovnkube-controller/0.log" May 28 18:19:46.921946 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:46.921917 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-72mnx_0918d329-07f8-4c36-9378-6723bdbd9fae/check-endpoints/0.log" May 28 18:19:46.942298 ip-10-0-132-117 kubenswrapper[2563]: I0528 18:19:46.942266 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2f8n9_1e26ee36-e72a-4fd9-a8aa-1b06c1240433/network-check-target-container/0.log"