May 27 21:25:29.213283 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 27 21:25:29.213294 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 27 21:25:29.213302 ip-10-0-133-190 systemd[1]: kubelet.service: Failed with result 'resources'. May 27 21:25:29.213553 ip-10-0-133-190 systemd[1]: Failed to start Kubernetes Kubelet. May 27 21:25:39.295653 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 27 21:25:39.295674 ip-10-0-133-190 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 636d9f06b4e9410d991ef87ec40cc579 -- May 27 21:28:11.044644 ip-10-0-133-190 systemd[1]: Starting Kubernetes Kubelet... May 27 21:28:11.484381 ip-10-0-133-190 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:28:11.484381 ip-10-0-133-190 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 27 21:28:11.484381 ip-10-0-133-190 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:28:11.484381 ip-10-0-133-190 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 27 21:28:11.484381 ip-10-0-133-190 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 27 21:28:11.486040 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.485954 2549 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 27 21:28:11.489029 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489013 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:28:11.489029 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489029 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489033 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489036 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489039 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489042 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489045 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489048 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489051 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489054 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489057 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489069 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489072 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489074 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489077 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489079 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489082 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489085 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489087 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489090 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489092 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:28:11.489099 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489095 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489097 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489100 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489103 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489105 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489108 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489111 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489114 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489117 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489120 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489122 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489125 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489133 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489136 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489139 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489147 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489150 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489153 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489155 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489158 2549 feature_gate.go:328] unrecognized feature gate: Example May 27 21:28:11.489599 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489160 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489163 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489165 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489168 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489170 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489173 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489175 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489178 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489180 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489182 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489185 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489187 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489190 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489195 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489199 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489203 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489206 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489209 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489211 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:28:11.490090 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489214 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489217 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489219 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489222 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489224 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489227 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489231 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489234 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489237 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489239 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489241 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489244 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489247 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489249 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489252 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489254 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489257 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489259 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489262 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:28:11.490578 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489264 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489269 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489274 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489277 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489279 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489282 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489285 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489709 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489715 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489718 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489722 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489725 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489728 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489731 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489734 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489737 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489740 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489742 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489745 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:28:11.491032 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489748 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489753 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489756 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489759 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489762 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489766 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489770 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489773 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489775 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489778 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489780 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489783 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489785 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489788 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489790 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489793 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489795 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489798 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489800 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:28:11.491506 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489803 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489807 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489809 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489812 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489815 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489817 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489819 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489822 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489824 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489827 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489829 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489832 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489834 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489837 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489840 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489843 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489845 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489848 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489850 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489853 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:28:11.492012 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489855 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489858 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489860 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489863 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489865 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489867 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489870 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489872 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489875 2549 feature_gate.go:328] unrecognized feature gate: Example May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489879 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489881 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489884 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489886 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489889 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489892 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489895 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489898 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489901 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489903 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489906 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:28:11.492514 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489908 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489911 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489913 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489916 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489919 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489921 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489924 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489927 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489929 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489932 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489934 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489937 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489939 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489942 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.489945 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491141 2549 flags.go:64] FLAG: --address="0.0.0.0" May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491151 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491157 2549 flags.go:64] FLAG: --anonymous-auth="true" May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491162 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491167 2549 flags.go:64] FLAG: --authentication-token-webhook="false" May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491171 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 27 21:28:11.493010 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491176 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491180 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491183 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491186 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491190 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491194 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491197 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491200 2549 flags.go:64] FLAG: --cgroup-root="" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491203 2549 flags.go:64] FLAG: --cgroups-per-qos="true" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491206 2549 flags.go:64] FLAG: --client-ca-file="" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491209 2549 flags.go:64] FLAG: --cloud-config="" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491212 2549 flags.go:64] FLAG: --cloud-provider="external" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491215 2549 flags.go:64] FLAG: --cluster-dns="[]" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491220 2549 flags.go:64] FLAG: --cluster-domain="" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491223 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491226 2549 flags.go:64] FLAG: --config-dir="" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491229 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491232 2549 flags.go:64] FLAG: --container-log-max-files="5" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491236 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491240 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491243 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491247 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491249 2549 flags.go:64] FLAG: --contention-profiling="false" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491253 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" May 27 21:28:11.493550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491256 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491260 2549 flags.go:64] FLAG: --cpu-manager-policy="none" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491263 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491267 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491270 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491272 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491276 2549 flags.go:64] FLAG: --enable-load-reader="false" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491279 2549 flags.go:64] FLAG: --enable-server="true" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491282 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491286 2549 flags.go:64] FLAG: --event-burst="100" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491289 2549 flags.go:64] FLAG: --event-qps="50" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491292 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491295 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491299 2549 flags.go:64] FLAG: --eviction-hard="" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491302 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491306 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491309 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491311 2549 flags.go:64] FLAG: --eviction-soft="" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491315 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491317 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491320 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491323 2549 flags.go:64] FLAG: --experimental-mounter-path="" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491326 2549 flags.go:64] FLAG: --fail-cgroupv1="false" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491329 2549 flags.go:64] FLAG: --fail-swap-on="true" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491342 2549 flags.go:64] FLAG: --feature-gates="" May 27 21:28:11.494124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491347 2549 flags.go:64] FLAG: --file-check-frequency="20s" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491350 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491353 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491357 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491360 2549 flags.go:64] FLAG: --healthz-port="10248" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491363 2549 flags.go:64] FLAG: --help="false" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491366 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-133-190.ec2.internal" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491370 2549 flags.go:64] FLAG: --housekeeping-interval="10s" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491373 2549 flags.go:64] FLAG: --http-check-frequency="20s" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491376 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491380 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491383 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491386 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491389 2549 flags.go:64] FLAG: --image-service-endpoint="" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491391 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491394 2549 flags.go:64] FLAG: --kube-api-burst="100" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491397 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491400 2549 flags.go:64] FLAG: --kube-api-qps="50" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491403 2549 flags.go:64] FLAG: --kube-reserved="" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491407 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491410 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491413 2549 flags.go:64] FLAG: --kubelet-cgroups="" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491416 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491419 2549 flags.go:64] FLAG: --lock-file="" May 27 21:28:11.494762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491422 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491425 2549 flags.go:64] FLAG: --log-flush-frequency="5s" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491428 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491434 2549 flags.go:64] FLAG: --log-json-split-stream="false" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491436 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491439 2549 flags.go:64] FLAG: --log-text-split-stream="false" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491442 2549 flags.go:64] FLAG: --logging-format="text" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491445 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491448 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491451 2549 flags.go:64] FLAG: --manifest-url="" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491454 2549 flags.go:64] FLAG: --manifest-url-header="" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491458 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491462 2549 flags.go:64] FLAG: --max-open-files="1000000" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491466 2549 flags.go:64] FLAG: --max-pods="110" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491469 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491473 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491476 2549 flags.go:64] FLAG: --memory-manager-policy="None" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491479 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491482 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491486 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491489 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491496 2549 flags.go:64] FLAG: --node-status-max-images="50" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491499 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491502 2549 flags.go:64] FLAG: --oom-score-adj="-999" May 27 21:28:11.495358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491505 2549 flags.go:64] FLAG: --pod-cidr="" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491508 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491515 2549 flags.go:64] FLAG: --pod-manifest-path="" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491518 2549 flags.go:64] FLAG: --pod-max-pids="-1" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491522 2549 flags.go:64] FLAG: --pods-per-core="0" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491525 2549 flags.go:64] FLAG: --port="10250" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491528 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491531 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03aad79984aa661a1" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491534 2549 flags.go:64] FLAG: --qos-reserved="" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491537 2549 flags.go:64] FLAG: --read-only-port="10255" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491540 2549 flags.go:64] FLAG: --register-node="true" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491543 2549 flags.go:64] FLAG: --register-schedulable="true" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491546 2549 flags.go:64] FLAG: --register-with-taints="" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491550 2549 flags.go:64] FLAG: --registry-burst="10" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491553 2549 flags.go:64] FLAG: --registry-qps="5" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491555 2549 flags.go:64] FLAG: --reserved-cpus="" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491558 2549 flags.go:64] FLAG: --reserved-memory="" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491565 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491569 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491572 2549 flags.go:64] FLAG: --rotate-certificates="false" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491575 2549 flags.go:64] FLAG: --rotate-server-certificates="false" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491578 2549 flags.go:64] FLAG: --runonce="false" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491581 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491584 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491591 2549 flags.go:64] FLAG: --seccomp-default="false" May 27 21:28:11.495926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491594 2549 flags.go:64] FLAG: --serialize-image-pulls="true" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491597 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491600 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491604 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491607 2549 flags.go:64] FLAG: --storage-driver-password="root" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491610 2549 flags.go:64] FLAG: --storage-driver-secure="false" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491613 2549 flags.go:64] FLAG: --storage-driver-table="stats" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491617 2549 flags.go:64] FLAG: --storage-driver-user="root" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491619 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491623 2549 flags.go:64] FLAG: --sync-frequency="1m0s" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491626 2549 flags.go:64] FLAG: --system-cgroups="" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491629 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491634 2549 flags.go:64] FLAG: --system-reserved-cgroup="" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491637 2549 flags.go:64] FLAG: --tls-cert-file="" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491641 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491645 2549 flags.go:64] FLAG: --tls-min-version="" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491648 2549 flags.go:64] FLAG: --tls-private-key-file="" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491651 2549 flags.go:64] FLAG: --topology-manager-policy="none" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491654 2549 flags.go:64] FLAG: --topology-manager-policy-options="" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491656 2549 flags.go:64] FLAG: --topology-manager-scope="container" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491659 2549 flags.go:64] FLAG: --v="2" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491663 2549 flags.go:64] FLAG: --version="false" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491668 2549 flags.go:64] FLAG: --vmodule="" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491672 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.491675 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 27 21:28:11.496538 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491774 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491779 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491783 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491786 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491790 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491793 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491798 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491801 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491804 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491807 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491810 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491813 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491816 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491818 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491821 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491824 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491826 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491829 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491832 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:28:11.497160 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491834 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491837 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491839 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491842 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491845 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491847 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491850 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491852 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491855 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491858 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491860 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491863 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491865 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491868 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491870 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491873 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491875 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491878 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491881 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491885 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:28:11.497650 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491888 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491890 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491894 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491897 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491900 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491902 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491905 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491907 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491910 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491912 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491917 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491920 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491922 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491925 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491927 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491930 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491932 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491935 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491938 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:28:11.498239 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491940 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491943 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491945 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491948 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491950 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491954 2549 feature_gate.go:328] unrecognized feature gate: Example May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491956 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491959 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491961 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491964 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491967 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491970 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491976 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491979 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491982 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491984 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491987 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491989 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491992 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491994 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:28:11.498728 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491997 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:28:11.499223 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.491999 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:28:11.499223 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.492002 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:28:11.499223 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.492006 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:28:11.499223 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.492009 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:28:11.499223 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.492012 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:28:11.499223 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.492015 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:28:11.499223 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.492017 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:28:11.499223 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.492022 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:28:11.500175 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.500155 2549 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 27 21:28:11.500214 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.500176 2549 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 27 21:28:11.500241 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500224 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:28:11.500241 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500230 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:28:11.500241 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500233 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:28:11.500241 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500236 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:28:11.500241 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500239 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:28:11.500241 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500242 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500245 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500248 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500251 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500253 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500256 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500259 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500262 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500268 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500271 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500274 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500276 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500279 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500281 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500284 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500287 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500289 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500292 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500294 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500297 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:28:11.500404 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500299 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500302 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500304 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500307 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500310 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500312 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500315 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500317 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500320 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500323 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500326 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500329 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500345 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500349 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500353 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500356 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500358 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500361 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500364 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:28:11.500894 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500366 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500369 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500378 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500383 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500387 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500390 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500393 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500397 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500400 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500402 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500405 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500408 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500411 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500413 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500416 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500419 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500422 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500424 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500427 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500429 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:28:11.501409 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500432 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500434 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500437 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500439 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500443 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500446 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500449 2549 feature_gate.go:328] unrecognized feature gate: Example May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500452 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500455 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500458 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500461 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500463 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500466 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500468 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500471 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500480 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500483 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500486 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500489 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500491 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:28:11.501903 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500494 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500496 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.500501 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500647 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500652 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500655 2549 feature_gate.go:328] unrecognized feature gate: NewOLM May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500659 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500662 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500664 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500667 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500670 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500672 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500675 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500678 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500680 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500683 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 27 21:28:11.502479 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500686 2549 feature_gate.go:328] unrecognized feature gate: DualReplica May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500688 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500691 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500694 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500697 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500700 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500702 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500705 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500707 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500710 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500712 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500715 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500723 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500726 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500730 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500733 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500736 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500739 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500741 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 27 21:28:11.502881 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500744 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500746 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500749 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500752 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500754 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500756 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500759 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500761 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500764 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500766 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500769 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500771 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500774 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500777 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500779 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500782 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500785 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500788 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500791 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500793 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 27 21:28:11.503356 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500796 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500799 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500801 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500804 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500806 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500809 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500819 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500822 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500825 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500828 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500831 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500833 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500836 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500839 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500841 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500844 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500847 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500849 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500852 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 27 21:28:11.503842 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500855 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500857 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500859 2549 feature_gate.go:328] unrecognized feature gate: Example May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500862 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500864 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500867 2549 feature_gate.go:328] unrecognized feature gate: Example2 May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500869 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500872 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500874 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500877 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500879 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500882 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500884 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500887 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:11.500889 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 27 21:28:11.504313 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.500894 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 27 21:28:11.504696 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.501686 2549 server.go:962] "Client rotation is on, will bootstrap in background" May 27 21:28:11.504696 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.504077 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 27 21:28:11.505056 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.505043 2549 server.go:1019] "Starting client certificate rotation" May 27 21:28:11.505549 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.505529 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:28:11.505588 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.505574 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 27 21:28:11.532268 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.532242 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:28:11.537352 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.537308 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 27 21:28:11.552157 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.552129 2549 log.go:25] "Validated CRI v1 runtime API" May 27 21:28:11.558231 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.558208 2549 log.go:25] "Validated CRI v1 image API" May 27 21:28:11.559787 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.559763 2549 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 27 21:28:11.566980 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.566959 2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:28:11.569128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.569103 2549 fs.go:135] Filesystem UUIDs: map[2dabf3bd-5ebe-4056-9774-46b106e68d53:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c2ebcee9-e530-4d20-81aa-a58b14ed7713:/dev/nvme0n1p3] May 27 21:28:11.569215 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.569126 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 27 21:28:11.573462 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.573349 2549 manager.go:217] Machine: {Timestamp:2026-05-27 21:28:11.572849717 +0000 UTC m=+0.412696679 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100529 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22553ff702eb6dc0437c04019886ff SystemUUID:ec22553f-f702-eb6d-c043-7c04019886ff BootID:636d9f06-b4e9-410d-991e-f87ec40cc579 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a5:c9:17:36:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a5:c9:17:36:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:1e:c0:b5:5e:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 27 21:28:11.574297 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.574284 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 27 21:28:11.574403 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.574390 2549 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 27 21:28:11.576638 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.576608 2549 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 27 21:28:11.576791 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.576641 2549 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-190.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 27 21:28:11.576838 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.576802 2549 topology_manager.go:138] "Creating topology manager with none policy" May 27 21:28:11.576838 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.576812 2549 container_manager_linux.go:306] "Creating device plugin manager" May 27 21:28:11.576838 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.576820 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:28:11.577871 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.577860 2549 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 27 21:28:11.579697 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.579686 2549 state_mem.go:36] "Initialized new in-memory state store" May 27 21:28:11.579818 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.579809 2549 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 27 21:28:11.582816 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.582803 2549 kubelet.go:491] "Attempting to sync node with API server" May 27 21:28:11.582863 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.582825 2549 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 27 21:28:11.582863 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.582839 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 27 21:28:11.582863 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.582849 2549 kubelet.go:397] "Adding apiserver pod source" May 27 21:28:11.582863 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.582860 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 27 21:28:11.584218 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.584204 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:28:11.584273 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.584230 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 27 21:28:11.589268 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.589243 2549 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 27 21:28:11.592069 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.592047 2549 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 27 21:28:11.592974 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.592962 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.592982 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.592992 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.592998 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.593006 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.593012 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.593018 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.593024 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.593031 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 27 21:28:11.593039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.593038 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 27 21:28:11.593267 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.593046 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 27 21:28:11.593463 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.593453 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 27 21:28:11.595449 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.595434 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 27 21:28:11.595449 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.595450 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 27 21:28:11.596912 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.596885 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 27 21:28:11.596968 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.596884 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 27 21:28:11.598739 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.598725 2549 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 27 21:28:11.598799 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.598765 2549 server.go:1295] "Started kubelet" May 27 21:28:11.598919 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.598862 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 27 21:28:11.599071 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.598843 2549 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 27 21:28:11.599161 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.599090 2549 server_v1.go:47] "podresources" method="list" useActivePods=true May 27 21:28:11.599530 ip-10-0-133-190 systemd[1]: Started Kubernetes Kubelet. May 27 21:28:11.600532 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.600496 2549 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 27 21:28:11.600686 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.600660 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sp8kk" May 27 21:28:11.601931 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.601919 2549 server.go:317] "Adding debug handlers to kubelet server" May 27 21:28:11.605319 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.605301 2549 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-190.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 27 21:28:11.606463 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.605361 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-190.ec2.internal.18b38958a7517608 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-190.ec2.internal,UID:ip-10-0-133-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-190.ec2.internal,},FirstTimestamp:2026-05-27 21:28:11.598738952 +0000 UTC m=+0.438585916,LastTimestamp:2026-05-27 21:28:11.598738952 +0000 UTC m=+0.438585916,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-190.ec2.internal,}" May 27 21:28:11.609128 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.609104 2549 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 27 21:28:11.609193 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.609178 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sp8kk" May 27 21:28:11.610551 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.610534 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 27 21:28:11.610551 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.610544 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 27 21:28:11.610666 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.610642 2549 volume_manager.go:295] "The desired_state_of_world populator starts" May 27 21:28:11.610713 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.610669 2549 volume_manager.go:297] "Starting Kubelet Volume Manager" May 27 21:28:11.610783 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.610771 2549 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 27 21:28:11.610851 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.610838 2549 reconstruct.go:97] "Volume reconstruction finished" May 27 21:28:11.610851 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.610851 2549 reconciler.go:26] "Reconciler: start to sync state" May 27 21:28:11.611774 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.611663 2549 factory.go:55] Registering systemd factory May 27 21:28:11.611774 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.611680 2549 factory.go:223] Registration of the systemd container factory successfully May 27 21:28:11.612003 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.611916 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:11.612003 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.611969 2549 factory.go:153] Registering CRI-O factory May 27 21:28:11.612003 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.611986 2549 factory.go:223] Registration of the crio container factory successfully May 27 21:28:11.612129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.612044 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 27 21:28:11.612129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.612070 2549 factory.go:103] Registering Raw factory May 27 21:28:11.612129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.612084 2549 manager.go:1196] Started watching for new ooms in manager May 27 21:28:11.612717 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.612703 2549 manager.go:319] Starting recovery of all containers May 27 21:28:11.616902 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.616875 2549 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:28:11.624350 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.624202 2549 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-190.ec2.internal\" not found" node="ip-10-0-133-190.ec2.internal" May 27 21:28:11.625159 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.625142 2549 manager.go:324] Recovery completed May 27 21:28:11.629236 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.629223 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:28:11.631078 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.631060 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" May 27 21:28:11.631142 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.631109 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:28:11.631142 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.631120 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" May 27 21:28:11.631685 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.631664 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" May 27 21:28:11.631685 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.631676 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 27 21:28:11.631758 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.631695 2549 state_mem.go:36] "Initialized new in-memory state store" May 27 21:28:11.635461 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.635449 2549 policy_none.go:49] "None policy: Start" May 27 21:28:11.635512 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.635467 2549 memory_manager.go:186] "Starting memorymanager" policy="None" May 27 21:28:11.635512 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.635477 2549 state_mem.go:35] "Initializing new in-memory state store" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.679002 2549 manager.go:341] "Starting Device Plugin manager" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.679040 2549 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.679050 2549 server.go:85] "Starting device plugin registration server" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.679351 2549 eviction_manager.go:189] "Eviction manager: starting control loop" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.679375 2549 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.679465 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.679552 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.679562 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.680110 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 27 21:28:11.687745 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.680148 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:11.707738 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.707702 2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 27 21:28:11.709026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.709005 2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 27 21:28:11.709143 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.709034 2549 status_manager.go:230] "Starting to sync pod status with apiserver" May 27 21:28:11.709143 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.709055 2549 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 27 21:28:11.709143 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.709061 2549 kubelet.go:2451] "Starting kubelet main sync loop" May 27 21:28:11.709143 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.709098 2549 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 27 21:28:11.711389 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.711371 2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:28:11.780245 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.780143 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:28:11.781104 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.781089 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" May 27 21:28:11.781163 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.781119 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:28:11.781163 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.781134 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" May 27 21:28:11.781163 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.781157 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-190.ec2.internal" May 27 21:28:11.789963 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.789945 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-190.ec2.internal" May 27 21:28:11.790018 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.789971 2549 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-190.ec2.internal\": node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:11.806663 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.806642 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:11.809344 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.809318 2549 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"] May 27 21:28:11.809445 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.809394 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:28:11.810256 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.810242 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" May 27 21:28:11.810302 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.810268 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:28:11.810302 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.810278 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" May 27 21:28:11.811614 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.811602 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:28:11.811774 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.811759 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:11.811812 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.811789 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:28:11.812374 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.812357 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" May 27 21:28:11.812478 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.812384 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:28:11.812478 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.812395 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" May 27 21:28:11.812478 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.812359 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" May 27 21:28:11.812478 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.812469 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:28:11.812632 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.812481 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" May 27 21:28:11.813567 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.813552 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" May 27 21:28:11.813605 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.813586 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 27 21:28:11.814228 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.814214 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" May 27 21:28:11.814294 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.814242 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" May 27 21:28:11.814294 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.814253 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" May 27 21:28:11.836027 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.835999 2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-190.ec2.internal\" not found" node="ip-10-0-133-190.ec2.internal" May 27 21:28:11.840377 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.840359 2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-190.ec2.internal\" not found" node="ip-10-0-133-190.ec2.internal" May 27 21:28:11.907225 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:11.907178 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:11.911454 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.911431 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec1b2b5c19ba8bf0340683f61d591907-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"ec1b2b5c19ba8bf0340683f61d591907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:11.911544 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:11.911468 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec1b2b5c19ba8bf0340683f61d591907-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"ec1b2b5c19ba8bf0340683f61d591907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:12.008287 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.008260 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.012607 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.012584 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec1b2b5c19ba8bf0340683f61d591907-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"ec1b2b5c19ba8bf0340683f61d591907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:12.012666 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.012526 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec1b2b5c19ba8bf0340683f61d591907-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"ec1b2b5c19ba8bf0340683f61d591907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:12.012666 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.012653 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec1b2b5c19ba8bf0340683f61d591907-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"ec1b2b5c19ba8bf0340683f61d591907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:12.012752 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.012676 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0071387b81c31677807d5d21ba6390ac-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"0071387b81c31677807d5d21ba6390ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" May 27 21:28:12.012752 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.012724 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec1b2b5c19ba8bf0340683f61d591907-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"ec1b2b5c19ba8bf0340683f61d591907\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:12.109063 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.108985 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.113325 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.113291 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0071387b81c31677807d5d21ba6390ac-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"0071387b81c31677807d5d21ba6390ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" May 27 21:28:12.113423 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.113372 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0071387b81c31677807d5d21ba6390ac-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"0071387b81c31677807d5d21ba6390ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" May 27 21:28:12.138461 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.138432 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:12.143238 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.143217 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" May 27 21:28:12.210089 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.210034 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.310525 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.310484 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.405691 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.405609 2549 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:28:12.410792 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.410769 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.505223 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.505178 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 27 21:28:12.505766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.505364 2549 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:28:12.505766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.505382 2549 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:28:12.505766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.505382 2549 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 27 21:28:12.511366 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.511330 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.610967 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.610942 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 27 21:28:12.610967 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.610924 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 21:23:11 +0000 UTC" deadline="2028-02-16 19:49:19.11159756 +0000 UTC" May 27 21:28:12.611225 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.610979 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15118h21m6.500621998s" May 27 21:28:12.611433 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.611415 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.627556 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.627525 2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 27 21:28:12.652233 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.652204 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ll6fx" May 27 21:28:12.660200 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.660144 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ll6fx" May 27 21:28:12.698835 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:12.698802 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0071387b81c31677807d5d21ba6390ac.slice/crio-159f12ea1b7fa27933daf8b8dd2f7a8fb65a0b2a88051c763907d25abf136bf6 WatchSource:0}: Error finding container 159f12ea1b7fa27933daf8b8dd2f7a8fb65a0b2a88051c763907d25abf136bf6: Status 404 returned error can't find the container with id 159f12ea1b7fa27933daf8b8dd2f7a8fb65a0b2a88051c763907d25abf136bf6 May 27 21:28:12.699028 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:12.699014 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1b2b5c19ba8bf0340683f61d591907.slice/crio-fd03d7bd36477cba444eea5cf8649fc8e3ccd6d2e9ed7892f1b6036763db03ca WatchSource:0}: Error finding container fd03d7bd36477cba444eea5cf8649fc8e3ccd6d2e9ed7892f1b6036763db03ca: Status 404 returned error can't find the container with id fd03d7bd36477cba444eea5cf8649fc8e3ccd6d2e9ed7892f1b6036763db03ca May 27 21:28:12.704308 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.704283 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:28:12.711594 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.711573 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.712263 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.712226 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"ec1b2b5c19ba8bf0340683f61d591907","Type":"ContainerStarted","Data":"fd03d7bd36477cba444eea5cf8649fc8e3ccd6d2e9ed7892f1b6036763db03ca"} May 27 21:28:12.713063 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:12.713045 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" event={"ID":"0071387b81c31677807d5d21ba6390ac","Type":"ContainerStarted","Data":"159f12ea1b7fa27933daf8b8dd2f7a8fb65a0b2a88051c763907d25abf136bf6"} May 27 21:28:12.812226 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.812187 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:12.912699 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:12.912611 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:13.013050 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.013022 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:13.113855 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.113815 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" May 27 21:28:13.119762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.119740 2549 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:28:13.211915 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.211835 2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" May 27 21:28:13.224293 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.224254 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:28:13.225451 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.225429 2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" May 27 21:28:13.233050 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.233025 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 27 21:28:13.584963 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.584878 2549 apiserver.go:52] "Watching apiserver" May 27 21:28:13.596090 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.596063 2549 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 27 21:28:13.598995 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.598969 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-9sg2g","openshift-network-operator/iptables-alerter-rntmn","openshift-ovn-kubernetes/ovnkube-node-2tnmz","kube-system/konnectivity-agent-t9gld","kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62","openshift-cluster-node-tuning-operator/tuned-4mgw8","openshift-dns/node-resolver-ls77t","openshift-multus/multus-additional-cni-plugins-k5nf4","openshift-multus/multus-s7msk","openshift-multus/network-metrics-daemon-l6qxd","openshift-image-registry/node-ca-cgdsd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal"] May 27 21:28:13.603136 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.603113 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.605208 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.605108 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.605319 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.605237 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.606249 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.606226 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c4hqf\"" May 27 21:28:13.606249 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.606239 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 27 21:28:13.606398 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.606236 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 27 21:28:13.607196 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.607158 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 27 21:28:13.607316 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.607282 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 27 21:28:13.607438 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.607351 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 27 21:28:13.607517 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.607498 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 27 21:28:13.607867 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.607822 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:13.608110 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.608088 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 27 21:28:13.608214 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.608091 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-88j95\"" May 27 21:28:13.608400 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.608378 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 27 21:28:13.608400 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.608395 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jtb6t\"" May 27 21:28:13.608547 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.608534 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 27 21:28:13.608602 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.608569 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 27 21:28:13.608656 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.608634 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 27 21:28:13.609617 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.609599 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 27 21:28:13.610288 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.610062 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.610288 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.610092 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 27 21:28:13.610288 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.610124 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t752l\"" May 27 21:28:13.612159 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.612139 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4gsxg\"" May 27 21:28:13.612251 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.612174 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 27 21:28:13.612251 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.612211 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 27 21:28:13.612251 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.612246 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 27 21:28:13.614531 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.614502 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:13.614641 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.614612 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:13.614739 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.614668 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.617275 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.617255 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 27 21:28:13.617275 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.617274 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 27 21:28:13.617485 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.617425 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rbkkl\"" May 27 21:28:13.617666 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.617649 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.620572 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.620549 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 27 21:28:13.620681 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.620657 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 27 21:28:13.620780 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.620760 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 27 21:28:13.620851 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.620832 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 27 21:28:13.621004 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.620983 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s2l9m\"" May 27 21:28:13.621131 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.621116 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 27 21:28:13.622019 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.621995 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-var-lib-kubelet\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622113 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622035 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-host\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622113 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622066 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.622113 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622094 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.622273 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622128 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-socket-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.622273 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622202 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.622273 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622230 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysctl-d\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622273 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622254 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysctl-conf\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622484 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622291 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-tuned\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622484 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622350 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-kubelet\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.622484 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622379 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-systemd-units\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.622484 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622402 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-ovnkube-script-lib\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.622484 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-registration-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.622484 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622452 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysconfig\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622484 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622474 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-systemd\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622496 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-etc-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622517 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622540 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-cni-bin\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622561 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-cni-netd\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622609 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-device-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622640 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld7pb\" (UniqueName: \"kubernetes.io/projected/3752bb25-8f61-4e62-a698-5b1096ff5038-kube-api-access-ld7pb\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622665 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-sys\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622689 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-lib-modules\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622713 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-tmp\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622738 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbqgp\" (UniqueName: \"kubernetes.io/projected/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-kube-api-access-kbqgp\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.622784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622772 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-slash\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622814 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7msk" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622810 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-run-ovn-kubernetes\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-env-overrides\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8da5db53-913d-4cd1-939a-646114d832f0-konnectivity-ca\") pod \"konnectivity-agent-t9gld\" (UID: \"8da5db53-913d-4cd1-939a-646114d832f0\") " pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.622981 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-run\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623035 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8w78\" (UniqueName: \"kubernetes.io/projected/816d229e-fd1b-48a9-9a08-887e14e44e52-kube-api-access-n8w78\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623061 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-modprobe-d\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623133 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-iptables-alerter-script\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623160 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-host-slash\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623182 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xxbp\" (UniqueName: \"kubernetes.io/projected/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-kube-api-access-4xxbp\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623210 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-var-lib-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623235 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-node-log\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623270 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623261 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-log-socket\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623286 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-ovnkube-config\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623310 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-kubernetes\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623351 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8da5db53-913d-4cd1-939a-646114d832f0-agent-certs\") pod \"konnectivity-agent-t9gld\" (UID: \"8da5db53-913d-4cd1-939a-646114d832f0\") " pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623374 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-sys-fs\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623398 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-run-netns\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623436 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-systemd\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623456 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-ovn\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623471 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/816d229e-fd1b-48a9-9a08-887e14e44e52-ovn-node-metrics-cert\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.623766 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.623490 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:13.624780 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.624754 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 27 21:28:13.625017 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.624993 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4frb9\"" May 27 21:28:13.625226 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.625212 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:13.625226 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.625223 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.625366 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.625284 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:13.627151 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.627136 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 27 21:28:13.627730 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.627712 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 27 21:28:13.627850 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.627722 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 27 21:28:13.627850 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.627773 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-khf67\"" May 27 21:28:13.660830 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.660803 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:23:12 +0000 UTC" deadline="2028-01-18 14:31:38.963344146 +0000 UTC" May 27 21:28:13.660830 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.660827 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14417h3m25.302519847s" May 27 21:28:13.702567 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.702538 2549 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:28:13.711924 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.711898 2549 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 27 21:28:13.723802 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723773 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-modprobe-d\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.723968 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723822 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-host-slash\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.723968 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723852 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-var-lib-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.723968 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723879 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-node-log\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.723968 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723902 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-log-socket\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.723968 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723928 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-host-slash\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.723968 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723931 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-socket-dir-parent\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.723968 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723957 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-modprobe-d\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723993 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37736595-f26f-4455-8d5c-b7cbad923ad0-tmp-dir\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.723997 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-var-lib-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724031 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88wb\" (UniqueName: \"kubernetes.io/projected/37736595-f26f-4455-8d5c-b7cbad923ad0-kube-api-access-d88wb\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724060 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-cni-binary-copy\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724070 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-node-log\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724082 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-os-release\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724115 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-conf-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724132 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-log-socket\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724140 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpmbm\" (UniqueName: \"kubernetes.io/projected/71222d0a-e311-4912-bc4d-d822abd1c9af-kube-api-access-jpmbm\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724177 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-run-netns\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.724318 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724208 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-systemd\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.724857 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724528 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-systemd\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.724857 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724767 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-ovn\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.724981 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724915 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-ovn\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.725029 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724985 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-system-cni-dir\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.725076 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725039 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.725123 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725072 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7b71697-67eb-43b0-80ef-c4773220cf8d-cni-binary-copy\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.725123 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725104 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37736595-f26f-4455-8d5c-b7cbad923ad0-hosts-file\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.725211 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725142 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.725211 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725174 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.725301 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725220 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-cni-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.725301 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725254 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-k8s-cni-cncf-io\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.725301 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725290 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysctl-d\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.725446 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725327 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysctl-conf\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.725446 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725405 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-kubelet\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.725446 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725437 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-systemd-units\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.725589 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725574 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-ovnkube-script-lib\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.725649 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725636 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-device-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.725695 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725670 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-etc-kubernetes\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.725743 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725715 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysconfig\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.725784 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725771 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-systemd\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.725889 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725847 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-etc-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.725935 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725902 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-cni-bin\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.725979 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725933 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7a806a8-63c2-4eff-a538-ce53e1b14446-serviceca\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.726028 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.725979 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbqgp\" (UniqueName: \"kubernetes.io/projected/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-kube-api-access-kbqgp\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.726069 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726052 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-run-ovn-kubernetes\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.726123 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726110 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-env-overrides\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.726189 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726174 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b692l\" (UniqueName: \"kubernetes.io/projected/af21fafe-e0a8-44a6-b21a-52698d6cf989-kube-api-access-b692l\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.726236 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726208 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-netns\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.726281 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726249 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-daemon-config\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.726328 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726293 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-run\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.726395 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726324 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-cnibin\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.726505 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726478 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-iptables-alerter-script\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.726550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726521 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xxbp\" (UniqueName: \"kubernetes.io/projected/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-kube-api-access-4xxbp\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.726597 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726550 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-ovnkube-config\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.726642 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726579 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8da5db53-913d-4cd1-939a-646114d832f0-agent-certs\") pod \"konnectivity-agent-t9gld\" (UID: \"8da5db53-913d-4cd1-939a-646114d832f0\") " pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:13.726642 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726624 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-kubernetes\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.726727 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726696 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-sys-fs\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.726773 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726760 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-hostroot\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.726877 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726833 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-multus-certs\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.726928 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726908 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/816d229e-fd1b-48a9-9a08-887e14e44e52-ovn-node-metrics-cert\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.726975 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726939 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:13.726975 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726969 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-system-cni-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.727057 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.726998 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2d2r\" (UniqueName: \"kubernetes.io/projected/a7b71697-67eb-43b0-80ef-c4773220cf8d-kube-api-access-c2d2r\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.727057 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727030 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-var-lib-kubelet\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.727144 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727070 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-host\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.727144 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727100 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.727228 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727149 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-socket-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.727286 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727261 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-run-ovn-kubernetes\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.727392 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727372 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-run\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.727392 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727369 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-cnibin\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.727481 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727443 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.727481 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727447 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:13.727573 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727563 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-tuned\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.727620 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727605 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-registration-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.727669 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727630 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.727770 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727689 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.727770 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727754 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 27 21:28:13.727868 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727795 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-cni-multus\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.727868 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727793 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysctl-d\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.727868 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727833 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-kubelet\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.727868 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727859 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b97n7\" (UniqueName: \"kubernetes.io/projected/d7a806a8-63c2-4eff-a538-ce53e1b14446-kube-api-access-b97n7\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.728039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727927 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.728039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727907 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-sys-fs\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.728039 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.727930 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-env-overrides\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.728169 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.728043 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-cni-netd\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.728527 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.728502 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ld7pb\" (UniqueName: \"kubernetes.io/projected/3752bb25-8f61-4e62-a698-5b1096ff5038-kube-api-access-ld7pb\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.728632 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.728575 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysctl-conf\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.728691 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.728667 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-ovnkube-config\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.728867 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.728719 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/816d229e-fd1b-48a9-9a08-887e14e44e52-ovnkube-script-lib\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.728924 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.728895 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.729022 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.728948 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-kubelet\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.729022 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.728999 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7a806a8-63c2-4eff-a538-ce53e1b14446-host\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.729224 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729053 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-sys\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.729224 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729101 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-lib-modules\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.729224 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729178 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-tmp\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.729224 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729204 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-lib-modules\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.729437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729228 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-slash\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.729437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729304 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-sys\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.729437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729305 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-run-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.729437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729383 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-iptables-alerter-script\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.729437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729426 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-registration-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.729437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729433 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-cni-bin\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.729714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729479 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-kubernetes\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.729714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729495 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-cni-netd\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.729714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729532 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-device-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.729714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729584 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-systemd-units\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.729714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729629 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-sysconfig\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.729714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729679 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8da5db53-913d-4cd1-939a-646114d832f0-konnectivity-ca\") pod \"konnectivity-agent-t9gld\" (UID: \"8da5db53-913d-4cd1-939a-646114d832f0\") " pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:13.730079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729730 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-slash\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.730079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729793 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3752bb25-8f61-4e62-a698-5b1096ff5038-socket-dir\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.730079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729795 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-os-release\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.730079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729852 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.730079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729902 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8w78\" (UniqueName: \"kubernetes.io/projected/816d229e-fd1b-48a9-9a08-887e14e44e52-kube-api-access-n8w78\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.730079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729937 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-systemd\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.730079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729942 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-cni-bin\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.730079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.729862 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-var-lib-kubelet\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.730475 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.730261 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8da5db53-913d-4cd1-939a-646114d832f0-konnectivity-ca\") pod \"konnectivity-agent-t9gld\" (UID: \"8da5db53-913d-4cd1-939a-646114d832f0\") " pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:13.730475 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.730351 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-host\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.730475 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.730381 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-etc-openvswitch\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.730961 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.724597 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/816d229e-fd1b-48a9-9a08-887e14e44e52-host-run-netns\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.731446 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.731423 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-etc-tuned\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.731550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.731526 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/816d229e-fd1b-48a9-9a08-887e14e44e52-ovn-node-metrics-cert\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.731664 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.731639 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8da5db53-913d-4cd1-939a-646114d832f0-agent-certs\") pod \"konnectivity-agent-t9gld\" (UID: \"8da5db53-913d-4cd1-939a-646114d832f0\") " pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:13.732445 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.732412 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-tmp\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.735278 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.735246 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:28:13.735386 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.735283 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:28:13.735386 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.735297 2549 projected.go:194] Error preparing data for projected volume kube-api-access-m55cx for pod openshift-network-diagnostics/network-check-target-9sg2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:13.735753 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.735736 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx podName:060cb363-5937-4748-833a-0e3b9237c830 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:14.235466901 +0000 UTC m=+3.075313872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m55cx" (UniqueName: "kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx") pod "network-check-target-9sg2g" (UID: "060cb363-5937-4748-833a-0e3b9237c830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:13.736521 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.736426 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xxbp\" (UniqueName: \"kubernetes.io/projected/a0db37c4-8e13-4591-9ee5-e9e71630a3c0-kube-api-access-4xxbp\") pod \"iptables-alerter-rntmn\" (UID: \"a0db37c4-8e13-4591-9ee5-e9e71630a3c0\") " pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.737691 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.737669 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8w78\" (UniqueName: \"kubernetes.io/projected/816d229e-fd1b-48a9-9a08-887e14e44e52-kube-api-access-n8w78\") pod \"ovnkube-node-2tnmz\" (UID: \"816d229e-fd1b-48a9-9a08-887e14e44e52\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.737856 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.737836 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld7pb\" (UniqueName: \"kubernetes.io/projected/3752bb25-8f61-4e62-a698-5b1096ff5038-kube-api-access-ld7pb\") pod \"aws-ebs-csi-driver-node-2fk62\" (UID: \"3752bb25-8f61-4e62-a698-5b1096ff5038\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.738775 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.738754 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbqgp\" (UniqueName: \"kubernetes.io/projected/eebeeeab-f9c4-4d99-aa60-a5aeed9665d3-kube-api-access-kbqgp\") pod \"tuned-4mgw8\" (UID: \"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3\") " pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.830463 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830430 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.830463 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830467 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-cni-multus\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830488 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-kubelet\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830509 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b97n7\" (UniqueName: \"kubernetes.io/projected/d7a806a8-63c2-4eff-a538-ce53e1b14446-kube-api-access-b97n7\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830551 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-cni-multus\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830563 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-kubelet\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830605 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7a806a8-63c2-4eff-a538-ce53e1b14446-host\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830637 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-os-release\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830660 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830681 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-cni-bin\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.830703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830684 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7a806a8-63c2-4eff-a538-ce53e1b14446-host\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830710 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-socket-dir-parent\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830745 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-os-release\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830751 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37736595-f26f-4455-8d5c-b7cbad923ad0-tmp-dir\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830784 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d88wb\" (UniqueName: \"kubernetes.io/projected/37736595-f26f-4455-8d5c-b7cbad923ad0-kube-api-access-d88wb\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830811 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-cni-binary-copy\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830843 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-os-release\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830816 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-var-lib-cni-bin\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830874 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-conf-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830929 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpmbm\" (UniqueName: \"kubernetes.io/projected/71222d0a-e311-4912-bc4d-d822abd1c9af-kube-api-access-jpmbm\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830956 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-os-release\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830963 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-system-cni-dir\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830989 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.830990 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-conf-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831084 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37736595-f26f-4455-8d5c-b7cbad923ad0-tmp-dir\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831139 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7b71697-67eb-43b0-80ef-c4773220cf8d-cni-binary-copy\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831123 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831192 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831191 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37736595-f26f-4455-8d5c-b7cbad923ad0-hosts-file\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831266 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-socket-dir-parent\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831271 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-cni-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831284 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831318 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-system-cni-dir\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831308 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-k8s-cni-cncf-io\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831355 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-cni-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831392 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-k8s-cni-cncf-io\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831411 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-etc-kubernetes\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831420 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37736595-f26f-4455-8d5c-b7cbad923ad0-hosts-file\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831454 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7a806a8-63c2-4eff-a538-ce53e1b14446-serviceca\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831473 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-etc-kubernetes\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831491 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b692l\" (UniqueName: \"kubernetes.io/projected/af21fafe-e0a8-44a6-b21a-52698d6cf989-kube-api-access-b692l\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831519 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-netns\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.831781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831544 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-daemon-config\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831569 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-cnibin\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831581 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-netns\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831598 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-hostroot\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831625 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-multus-certs\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831636 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7b71697-67eb-43b0-80ef-c4773220cf8d-cni-binary-copy\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831684 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-system-cni-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831700 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-hostroot\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831716 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2d2r\" (UniqueName: \"kubernetes.io/projected/a7b71697-67eb-43b0-80ef-c4773220cf8d-kube-api-access-c2d2r\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831727 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af21fafe-e0a8-44a6-b21a-52698d6cf989-cni-binary-copy\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831743 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af21fafe-e0a8-44a6-b21a-52698d6cf989-cnibin\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831745 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-cnibin\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831786 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831794 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-cnibin\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831796 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-host-run-multus-certs\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831818 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7b71697-67eb-43b0-80ef-c4773220cf8d-system-cni-dir\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.831940 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7a806a8-63c2-4eff-a538-ce53e1b14446-serviceca\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.831948 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:13.832609 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:13.832008 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:28:14.331995481 +0000 UTC m=+3.171842446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:13.833565 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.832063 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a7b71697-67eb-43b0-80ef-c4773220cf8d-multus-daemon-config\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.836751 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.836694 2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:28:13.838570 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.838543 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b97n7\" (UniqueName: \"kubernetes.io/projected/d7a806a8-63c2-4eff-a538-ce53e1b14446-kube-api-access-b97n7\") pod \"node-ca-cgdsd\" (UID: \"d7a806a8-63c2-4eff-a538-ce53e1b14446\") " pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:13.843690 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.843656 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2d2r\" (UniqueName: \"kubernetes.io/projected/a7b71697-67eb-43b0-80ef-c4773220cf8d-kube-api-access-c2d2r\") pod \"multus-s7msk\" (UID: \"a7b71697-67eb-43b0-80ef-c4773220cf8d\") " pod="openshift-multus/multus-s7msk" May 27 21:28:13.843814 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.843709 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88wb\" (UniqueName: \"kubernetes.io/projected/37736595-f26f-4455-8d5c-b7cbad923ad0-kube-api-access-d88wb\") pod \"node-resolver-ls77t\" (UID: \"37736595-f26f-4455-8d5c-b7cbad923ad0\") " pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.844054 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.844034 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b692l\" (UniqueName: \"kubernetes.io/projected/af21fafe-e0a8-44a6-b21a-52698d6cf989-kube-api-access-b692l\") pod \"multus-additional-cni-plugins-k5nf4\" (UID: \"af21fafe-e0a8-44a6-b21a-52698d6cf989\") " pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.844416 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.844392 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpmbm\" (UniqueName: \"kubernetes.io/projected/71222d0a-e311-4912-bc4d-d822abd1c9af-kube-api-access-jpmbm\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:13.915366 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.915315 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" May 27 21:28:13.926177 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.926144 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rntmn" May 27 21:28:13.933882 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.933856 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:13.939523 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.939502 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:13.945150 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.945122 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" May 27 21:28:13.952808 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.952780 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ls77t" May 27 21:28:13.959428 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.959402 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" May 27 21:28:13.967167 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.967139 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7msk" May 27 21:28:13.971863 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:13.971838 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cgdsd" May 27 21:28:14.334487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.334411 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:14.334487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.334452 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:14.334660 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:14.334579 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:28:14.334660 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:14.334600 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:28:14.334660 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:14.334610 2549 projected.go:194] Error preparing data for projected volume kube-api-access-m55cx for pod openshift-network-diagnostics/network-check-target-9sg2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:14.334660 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:14.334625 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:14.334660 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:14.334661 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx podName:060cb363-5937-4748-833a-0e3b9237c830 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:15.334647482 +0000 UTC m=+4.174494445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m55cx" (UniqueName: "kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx") pod "network-check-target-9sg2g" (UID: "060cb363-5937-4748-833a-0e3b9237c830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:14.334811 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:14.334694 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:28:15.334682361 +0000 UTC m=+4.174529311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:14.359806 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:14.359779 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b71697_67eb_43b0_80ef_c4773220cf8d.slice/crio-14cbd12b44bfbb0feaa8370f0cbf72051dee603ec74d97b1e78df6ea44d23321 WatchSource:0}: Error finding container 14cbd12b44bfbb0feaa8370f0cbf72051dee603ec74d97b1e78df6ea44d23321: Status 404 returned error can't find the container with id 14cbd12b44bfbb0feaa8370f0cbf72051dee603ec74d97b1e78df6ea44d23321 May 27 21:28:14.361318 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:14.361296 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816d229e_fd1b_48a9_9a08_887e14e44e52.slice/crio-c3f4fefeaf373844636c0a24392e61ce14099f8e4e32a08ddfa12d070ffded7a WatchSource:0}: Error finding container c3f4fefeaf373844636c0a24392e61ce14099f8e4e32a08ddfa12d070ffded7a: Status 404 returned error can't find the container with id c3f4fefeaf373844636c0a24392e61ce14099f8e4e32a08ddfa12d070ffded7a May 27 21:28:14.362520 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:14.362438 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf21fafe_e0a8_44a6_b21a_52698d6cf989.slice/crio-8d19b63a0ddf936954299f11a7d826399739980164fe09e890e057436d0630eb WatchSource:0}: Error finding container 8d19b63a0ddf936954299f11a7d826399739980164fe09e890e057436d0630eb: Status 404 returned error can't find the container with id 8d19b63a0ddf936954299f11a7d826399739980164fe09e890e057436d0630eb May 27 21:28:14.366524 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:14.366303 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37736595_f26f_4455_8d5c_b7cbad923ad0.slice/crio-6ada9ecf14f585345e308dc89150a8350e720c9d9f567cd3565f844a9864273e WatchSource:0}: Error finding container 6ada9ecf14f585345e308dc89150a8350e720c9d9f567cd3565f844a9864273e: Status 404 returned error can't find the container with id 6ada9ecf14f585345e308dc89150a8350e720c9d9f567cd3565f844a9864273e May 27 21:28:14.367023 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:14.366999 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebeeeab_f9c4_4d99_aa60_a5aeed9665d3.slice/crio-7a52514e8bb7c8f1d19fc9a307de53c6ad05701f31664fd2efaf1c92f20fa134 WatchSource:0}: Error finding container 7a52514e8bb7c8f1d19fc9a307de53c6ad05701f31664fd2efaf1c92f20fa134: Status 404 returned error can't find the container with id 7a52514e8bb7c8f1d19fc9a307de53c6ad05701f31664fd2efaf1c92f20fa134 May 27 21:28:14.368258 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:14.368239 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a806a8_63c2_4eff_a538_ce53e1b14446.slice/crio-54397057c58aa9293a766e50da99935c7397ebf0346fb7c9224592ca3a646d82 WatchSource:0}: Error finding container 54397057c58aa9293a766e50da99935c7397ebf0346fb7c9224592ca3a646d82: Status 404 returned error can't find the container with id 54397057c58aa9293a766e50da99935c7397ebf0346fb7c9224592ca3a646d82 May 27 21:28:14.661534 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.661353 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:23:12 +0000 UTC" deadline="2027-12-16 01:18:48.274498082 +0000 UTC" May 27 21:28:14.661534 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.661531 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13611h50m33.612974043s" May 27 21:28:14.718315 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.718275 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" event={"ID":"0071387b81c31677807d5d21ba6390ac","Type":"ContainerStarted","Data":"c0976524c8d0bb22a318f7f64ebed29cc66d881173b55863290d5d485db3e0cc"} May 27 21:28:14.719985 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.719932 2549 generic.go:358] "Generic (PLEG): container finished" podID="ec1b2b5c19ba8bf0340683f61d591907" containerID="715a3858e76a2689ce6fe5707b067891492aa5d5f1413834049678134595b1a7" exitCode=0 May 27 21:28:14.720103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.720011 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"ec1b2b5c19ba8bf0340683f61d591907","Type":"ContainerDied","Data":"715a3858e76a2689ce6fe5707b067891492aa5d5f1413834049678134595b1a7"} May 27 21:28:14.721170 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.721141 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9gld" event={"ID":"8da5db53-913d-4cd1-939a-646114d832f0","Type":"ContainerStarted","Data":"ba0731caa4178382fa7d464e68370192fbe2537a0b531903384eac383cd712db"} May 27 21:28:14.722265 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.722230 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cgdsd" event={"ID":"d7a806a8-63c2-4eff-a538-ce53e1b14446","Type":"ContainerStarted","Data":"54397057c58aa9293a766e50da99935c7397ebf0346fb7c9224592ca3a646d82"} May 27 21:28:14.723387 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.723363 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ls77t" event={"ID":"37736595-f26f-4455-8d5c-b7cbad923ad0","Type":"ContainerStarted","Data":"6ada9ecf14f585345e308dc89150a8350e720c9d9f567cd3565f844a9864273e"} May 27 21:28:14.724415 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.724392 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rntmn" event={"ID":"a0db37c4-8e13-4591-9ee5-e9e71630a3c0","Type":"ContainerStarted","Data":"b924d0f823da3a1b2f4491bdd53426473539166a5aa198a4e707c023ac88be46"} May 27 21:28:14.725601 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.725577 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" event={"ID":"3752bb25-8f61-4e62-a698-5b1096ff5038","Type":"ContainerStarted","Data":"4b99e5e7c9357b23d41969bab366a727ea5831871bfc03febe4355283cd7d6ef"} May 27 21:28:14.726585 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.726565 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" event={"ID":"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3","Type":"ContainerStarted","Data":"7a52514e8bb7c8f1d19fc9a307de53c6ad05701f31664fd2efaf1c92f20fa134"} May 27 21:28:14.727662 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.727634 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" event={"ID":"af21fafe-e0a8-44a6-b21a-52698d6cf989","Type":"ContainerStarted","Data":"8d19b63a0ddf936954299f11a7d826399739980164fe09e890e057436d0630eb"} May 27 21:28:14.728721 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.728688 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"c3f4fefeaf373844636c0a24392e61ce14099f8e4e32a08ddfa12d070ffded7a"} May 27 21:28:14.729723 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.729700 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7msk" event={"ID":"a7b71697-67eb-43b0-80ef-c4773220cf8d","Type":"ContainerStarted","Data":"14cbd12b44bfbb0feaa8370f0cbf72051dee603ec74d97b1e78df6ea44d23321"} May 27 21:28:14.730876 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.730818 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" podStartSLOduration=1.730805782 podStartE2EDuration="1.730805782s" podCreationTimestamp="2026-05-27 21:28:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:28:14.730765439 +0000 UTC m=+3.570612411" watchObservedRunningTime="2026-05-27 21:28:14.730805782 +0000 UTC m=+3.570652755" May 27 21:28:14.783366 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:14.783317 2549 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 27 21:28:15.345795 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:15.345754 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:15.346003 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:15.345816 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:15.346003 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:15.345978 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:15.346118 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:15.346049 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:28:17.346026878 +0000 UTC m=+6.185873841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:15.346612 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:15.346493 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:28:15.346612 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:15.346515 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:28:15.346612 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:15.346528 2549 projected.go:194] Error preparing data for projected volume kube-api-access-m55cx for pod openshift-network-diagnostics/network-check-target-9sg2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:15.346612 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:15.346574 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx podName:060cb363-5937-4748-833a-0e3b9237c830 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:17.346559035 +0000 UTC m=+6.186405987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m55cx" (UniqueName: "kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx") pod "network-check-target-9sg2g" (UID: "060cb363-5937-4748-833a-0e3b9237c830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:15.709938 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:15.709413 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:15.709938 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:15.709445 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:15.709938 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:15.709545 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:15.709938 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:15.709629 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:15.756661 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:15.756614 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"ec1b2b5c19ba8bf0340683f61d591907","Type":"ContainerStarted","Data":"173fca6d3465278e2d17336cafb56ef58cc43db716ac213b1ccc75f13b927904"} May 27 21:28:15.774995 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:15.774418 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" podStartSLOduration=2.774397771 podStartE2EDuration="2.774397771s" podCreationTimestamp="2026-05-27 21:28:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:28:15.77322881 +0000 UTC m=+4.613075785" watchObservedRunningTime="2026-05-27 21:28:15.774397771 +0000 UTC m=+4.614244744" May 27 21:28:17.370619 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:17.370576 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:17.370619 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:17.370645 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:17.371186 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:17.370759 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:17.371186 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:17.370826 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:28:21.370803424 +0000 UTC m=+10.210650398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:17.371186 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:17.370759 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:28:17.371186 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:17.370857 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:28:17.371186 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:17.370870 2549 projected.go:194] Error preparing data for projected volume kube-api-access-m55cx for pod openshift-network-diagnostics/network-check-target-9sg2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:17.371186 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:17.370927 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx podName:060cb363-5937-4748-833a-0e3b9237c830 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:21.370911568 +0000 UTC m=+10.210758532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m55cx" (UniqueName: "kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx") pod "network-check-target-9sg2g" (UID: "060cb363-5937-4748-833a-0e3b9237c830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:17.710158 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:17.710077 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:17.710426 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:17.710077 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:17.710426 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:17.710215 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:17.710426 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:17.710391 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:19.710282 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:19.710248 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:19.710799 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:19.710397 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:19.710799 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:19.710533 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:19.710799 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:19.710651 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:21.405519 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:21.405477 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:21.405982 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:21.405532 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:21.405982 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:21.405686 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:21.405982 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:21.405751 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:28:29.40573287 +0000 UTC m=+18.245579822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:21.406195 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:21.406172 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:28:21.406250 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:21.406196 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:28:21.406250 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:21.406209 2549 projected.go:194] Error preparing data for projected volume kube-api-access-m55cx for pod openshift-network-diagnostics/network-check-target-9sg2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:21.406376 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:21.406260 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx podName:060cb363-5937-4748-833a-0e3b9237c830 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:29.406239585 +0000 UTC m=+18.246086542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m55cx" (UniqueName: "kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx") pod "network-check-target-9sg2g" (UID: "060cb363-5937-4748-833a-0e3b9237c830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:21.713500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:21.713093 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:21.713500 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:21.713232 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:21.713500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:21.713323 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:21.713500 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:21.713410 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:23.709532 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:23.709492 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:23.709967 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:23.709492 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:23.709967 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:23.709635 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:23.709967 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:23.709729 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:25.709633 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:25.709598 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:25.710108 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:25.709728 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:25.710108 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:25.709773 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:25.710108 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:25.709869 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:27.709792 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:27.709749 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:27.710263 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:27.709773 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:27.710263 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:27.709887 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:27.710263 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:27.709984 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:29.466449 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:29.466404 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:29.466901 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:29.466465 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:29.466901 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:29.466569 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:29.466901 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:29.466624 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:28:45.466609783 +0000 UTC m=+34.306456733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:29.466901 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:29.466571 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:28:29.466901 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:29.466670 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:28:29.466901 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:29.466683 2549 projected.go:194] Error preparing data for projected volume kube-api-access-m55cx for pod openshift-network-diagnostics/network-check-target-9sg2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:29.466901 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:29.466725 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx podName:060cb363-5937-4748-833a-0e3b9237c830 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:45.466715027 +0000 UTC m=+34.306561993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m55cx" (UniqueName: "kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx") pod "network-check-target-9sg2g" (UID: "060cb363-5937-4748-833a-0e3b9237c830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:29.710557 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:29.710415 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:29.710557 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:29.710547 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:29.710767 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:29.710415 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:29.710767 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:29.710712 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:31.710896 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:31.710847 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:31.711298 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:31.710967 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:31.711298 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:31.711019 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:31.711298 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:31.711149 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:32.789059 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.788771 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cgdsd" event={"ID":"d7a806a8-63c2-4eff-a538-ce53e1b14446","Type":"ContainerStarted","Data":"e682b8ac8c7c8a99ebdba17313afcd6c571ebed2d1810fd41491a5965ac1e83b"} May 27 21:28:32.790281 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.790086 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ls77t" event={"ID":"37736595-f26f-4455-8d5c-b7cbad923ad0","Type":"ContainerStarted","Data":"a6382da7dfec933b9083561c56c85ef5ad89ca22a08909f80ac6fb4614e80d3a"} May 27 21:28:32.791635 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.791608 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" event={"ID":"3752bb25-8f61-4e62-a698-5b1096ff5038","Type":"ContainerStarted","Data":"f765d1593b449b205468594a029e466483d92ef34712b5e391770682b2663f8f"} May 27 21:28:32.792842 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.792814 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" event={"ID":"eebeeeab-f9c4-4d99-aa60-a5aeed9665d3","Type":"ContainerStarted","Data":"22cad4e996b8174a7d51077036b9b96020a446532d9e9bf237bada46af6ac07b"} May 27 21:28:32.794135 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.794107 2549 generic.go:358] "Generic (PLEG): container finished" podID="af21fafe-e0a8-44a6-b21a-52698d6cf989" containerID="c249275311d499ab5d5ab122122741e35e142cf225790d1b59aef206abf19e1a" exitCode=0 May 27 21:28:32.794222 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.794175 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" event={"ID":"af21fafe-e0a8-44a6-b21a-52698d6cf989","Type":"ContainerDied","Data":"c249275311d499ab5d5ab122122741e35e142cf225790d1b59aef206abf19e1a"} May 27 21:28:32.795882 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.795867 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:28:32.796182 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.796166 2549 generic.go:358] "Generic (PLEG): container finished" podID="816d229e-fd1b-48a9-9a08-887e14e44e52" containerID="683cd0f543bbb3978a9d33606fcb12d8d0abcea761dff72ae38145f7be57c763" exitCode=1 May 27 21:28:32.796262 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.796235 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"c28ba9156a04597beb5efc0b70c711963bb386502faeba2e1b5be3126e8ebf5f"} May 27 21:28:32.796311 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.796262 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerDied","Data":"683cd0f543bbb3978a9d33606fcb12d8d0abcea761dff72ae38145f7be57c763"} May 27 21:28:32.796311 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.796277 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"3bf2faf13bf120b13eab4f50f8fc95d2ab30b2ac21f90613c119e37e14cf0f26"} May 27 21:28:32.797603 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.797585 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7msk" event={"ID":"a7b71697-67eb-43b0-80ef-c4773220cf8d","Type":"ContainerStarted","Data":"7d6472f6f5ce57591d65b6a99f86e79ce7def79f18bdc5393fc06d732f16419b"} May 27 21:28:32.798786 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.798768 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9gld" event={"ID":"8da5db53-913d-4cd1-939a-646114d832f0","Type":"ContainerStarted","Data":"610a5827156071e099ca3ce9972ea4e9f4c75658357e9785bbde8cd59164495f"} May 27 21:28:32.805175 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.805131 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cgdsd" podStartSLOduration=3.946980158 podStartE2EDuration="21.805120198s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.371112342 +0000 UTC m=+3.210959308" lastFinishedPulling="2026-05-27 21:28:32.229252383 +0000 UTC m=+21.069099348" observedRunningTime="2026-05-27 21:28:32.804828836 +0000 UTC m=+21.644675808" watchObservedRunningTime="2026-05-27 21:28:32.805120198 +0000 UTC m=+21.644967166" May 27 21:28:32.824589 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.824537 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4mgw8" podStartSLOduration=3.713453312 podStartE2EDuration="21.824524083s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.368983322 +0000 UTC m=+3.208830287" lastFinishedPulling="2026-05-27 21:28:32.48005409 +0000 UTC m=+21.319901058" observedRunningTime="2026-05-27 21:28:32.824350989 +0000 UTC m=+21.664197958" watchObservedRunningTime="2026-05-27 21:28:32.824524083 +0000 UTC m=+21.664371054" May 27 21:28:32.884224 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.884169 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-s7msk" podStartSLOduration=3.944038869 podStartE2EDuration="21.884149645s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.364668256 +0000 UTC m=+3.204515221" lastFinishedPulling="2026-05-27 21:28:32.304779034 +0000 UTC m=+21.144625997" observedRunningTime="2026-05-27 21:28:32.883393615 +0000 UTC m=+21.723240589" watchObservedRunningTime="2026-05-27 21:28:32.884149645 +0000 UTC m=+21.723996617" May 27 21:28:32.908222 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:32.908170 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t9gld" podStartSLOduration=4.103527058 podStartE2EDuration="21.908148316s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.373751526 +0000 UTC m=+3.213598489" lastFinishedPulling="2026-05-27 21:28:32.178372782 +0000 UTC m=+21.018219747" observedRunningTime="2026-05-27 21:28:32.90707808 +0000 UTC m=+21.746925053" watchObservedRunningTime="2026-05-27 21:28:32.908148316 +0000 UTC m=+21.747995289" May 27 21:28:33.709364 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.709289 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:33.709364 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.709312 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:33.709665 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:33.709432 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:33.709665 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:33.709577 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:33.733625 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.733589 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 27 21:28:33.802032 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.801994 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rntmn" event={"ID":"a0db37c4-8e13-4591-9ee5-e9e71630a3c0","Type":"ContainerStarted","Data":"4a8ffdf78c3ec56daf62e80fad2d86b094fbb6381a039aa7cb32d70fb0df2106"} May 27 21:28:33.803843 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.803817 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" event={"ID":"3752bb25-8f61-4e62-a698-5b1096ff5038","Type":"ContainerStarted","Data":"aaed39c5a1158827a9cd6cb4efb54d31a21522fbf55c3134e21f56c47a084e71"} May 27 21:28:33.806639 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.806616 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:28:33.807040 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.807014 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"b020767ee070ab0cc13ce0e5c3d766500ddd945d041024108316d387835d99ab"} May 27 21:28:33.807133 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.807050 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"3fb55fb89086fddfff578bdceff794d0d5691bbe022915301be34d03428ad9d7"} May 27 21:28:33.807133 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.807064 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"8bd1f598cfed1450b083470aa6c98e99ede2d71c9bd92a95bdeeb231838455b4"} May 27 21:28:33.818022 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.817966 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ls77t" podStartSLOduration=8.782713939 podStartE2EDuration="22.817950638s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.368374624 +0000 UTC m=+3.208221588" lastFinishedPulling="2026-05-27 21:28:28.403611336 +0000 UTC m=+17.243458287" observedRunningTime="2026-05-27 21:28:32.926307438 +0000 UTC m=+21.766154409" watchObservedRunningTime="2026-05-27 21:28:33.817950638 +0000 UTC m=+22.657797610" May 27 21:28:33.818635 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:33.818601 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rntmn" podStartSLOduration=8.788083135 podStartE2EDuration="22.818591046s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.373104903 +0000 UTC m=+3.212951853" lastFinishedPulling="2026-05-27 21:28:28.403612809 +0000 UTC m=+17.243459764" observedRunningTime="2026-05-27 21:28:33.817651736 +0000 UTC m=+22.657498708" watchObservedRunningTime="2026-05-27 21:28:33.818591046 +0000 UTC m=+22.658438019" May 27 21:28:34.694661 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:34.694561 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T21:28:33.733617378Z","UUID":"a8643314-198e-4bc0-8a98-9c16a5ca303b","Handler":null,"Name":"","Endpoint":""} May 27 21:28:34.697859 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:34.697830 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 27 21:28:34.697859 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:34.697863 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 27 21:28:35.693744 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:35.693702 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:35.694541 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:35.694516 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:35.709408 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:35.709377 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:35.709588 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:35.709541 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:35.709667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:35.709573 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:35.709725 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:35.709677 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:35.811902 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:35.811860 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" event={"ID":"3752bb25-8f61-4e62-a698-5b1096ff5038","Type":"ContainerStarted","Data":"6c3b7535ea1644ac70f98046fa99999c60c3f90a10ecd66b913abe972333ad8a"} May 27 21:28:35.814885 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:35.814864 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:28:35.815261 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:35.815235 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"b14f73e1b47f40705767636a85272221c6aae3ff0b4ea8da3cd88ac986a22bfc"} May 27 21:28:35.831480 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:35.831430 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fk62" podStartSLOduration=4.476518693 podStartE2EDuration="24.831414278s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.37109375 +0000 UTC m=+3.210940701" lastFinishedPulling="2026-05-27 21:28:34.725989322 +0000 UTC m=+23.565836286" observedRunningTime="2026-05-27 21:28:35.831349847 +0000 UTC m=+24.671196815" watchObservedRunningTime="2026-05-27 21:28:35.831414278 +0000 UTC m=+24.671261251" May 27 21:28:37.710249 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.709935 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:37.710897 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.709992 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:37.710897 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:37.710356 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:37.710897 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:37.710426 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:37.821399 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.821368 2549 generic.go:358] "Generic (PLEG): container finished" podID="af21fafe-e0a8-44a6-b21a-52698d6cf989" containerID="8fe1ba2c5311b5386737876c9750ba562e112d324f6e5ba79e288e9f666b72ca" exitCode=0 May 27 21:28:37.821543 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.821451 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" event={"ID":"af21fafe-e0a8-44a6-b21a-52698d6cf989","Type":"ContainerDied","Data":"8fe1ba2c5311b5386737876c9750ba562e112d324f6e5ba79e288e9f666b72ca"} May 27 21:28:37.824540 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.824521 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:28:37.824880 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.824858 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"4c4610ab86f3ef43834ea17c7482f59982f9c993999299ebac1363392656a2a5"} May 27 21:28:37.825169 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.825144 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:37.825385 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.825371 2549 scope.go:117] "RemoveContainer" containerID="683cd0f543bbb3978a9d33606fcb12d8d0abcea761dff72ae38145f7be57c763" May 27 21:28:37.842189 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:37.842107 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:38.828247 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:38.828215 2549 generic.go:358] "Generic (PLEG): container finished" podID="af21fafe-e0a8-44a6-b21a-52698d6cf989" containerID="d7dad187e10df78db180aa0d07344cdf39374ca76c55d891dfc4ba50344e88c0" exitCode=0 May 27 21:28:38.828678 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:38.828307 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" event={"ID":"af21fafe-e0a8-44a6-b21a-52698d6cf989","Type":"ContainerDied","Data":"d7dad187e10df78db180aa0d07344cdf39374ca76c55d891dfc4ba50344e88c0"} May 27 21:28:38.831704 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:38.831686 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:28:38.832059 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:38.832027 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" event={"ID":"816d229e-fd1b-48a9-9a08-887e14e44e52","Type":"ContainerStarted","Data":"2c85f15c7031694c7f8a5261d3aae91de5ab02556fb84a3d0dc7dab3ef90e973"} May 27 21:28:38.832258 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:38.832241 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:38.832299 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:38.832270 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:38.847790 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:38.847758 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:28:38.916122 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:38.916017 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" podStartSLOduration=10.002917895 podStartE2EDuration="27.916003772s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.363533635 +0000 UTC m=+3.203380595" lastFinishedPulling="2026-05-27 21:28:32.276619508 +0000 UTC m=+21.116466472" observedRunningTime="2026-05-27 21:28:38.914465817 +0000 UTC m=+27.754312789" watchObservedRunningTime="2026-05-27 21:28:38.916003772 +0000 UTC m=+27.755850744" May 27 21:28:39.259926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:39.259813 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9sg2g"] May 27 21:28:39.260075 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:39.259937 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l6qxd"] May 27 21:28:39.260075 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:39.259959 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:39.260075 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:39.260058 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:39.260229 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:39.260169 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:39.260314 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:39.260291 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:39.835959 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:39.835775 2549 generic.go:358] "Generic (PLEG): container finished" podID="af21fafe-e0a8-44a6-b21a-52698d6cf989" containerID="651b5eb3044f3d85d49bcc270f5ad2cf3afc562bf0a64cb887c53788006dcf71" exitCode=0 May 27 21:28:39.836417 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:39.835857 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" event={"ID":"af21fafe-e0a8-44a6-b21a-52698d6cf989","Type":"ContainerDied","Data":"651b5eb3044f3d85d49bcc270f5ad2cf3afc562bf0a64cb887c53788006dcf71"} May 27 21:28:40.709816 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:40.709778 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:40.709986 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:40.709909 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:41.710825 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:41.710746 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:41.711318 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:41.710849 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:42.710317 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:42.710276 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:42.710510 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:42.710424 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:43.421599 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:43.421567 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:43.422245 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:43.421714 2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 27 21:28:43.422245 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:43.422208 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t9gld" May 27 21:28:43.709919 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:43.709835 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:43.710067 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:43.709988 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:28:44.710157 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:44.710105 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:44.710797 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:44.710248 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9sg2g" podUID="060cb363-5937-4748-833a-0e3b9237c830" May 27 21:28:45.458994 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.458966 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeReady" May 27 21:28:45.459172 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.459093 2549 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 27 21:28:45.478453 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.478419 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:45.478453 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.478460 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:45.478677 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.478596 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 27 21:28:45.478677 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.478613 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:45.478677 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.478621 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 27 21:28:45.478677 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.478634 2549 projected.go:194] Error preparing data for projected volume kube-api-access-m55cx for pod openshift-network-diagnostics/network-check-target-9sg2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:45.478677 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.478672 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:29:17.478656466 +0000 UTC m=+66.318503416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : object "openshift-multus"/"metrics-daemon-secret" not registered May 27 21:28:45.478850 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.478688 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx podName:060cb363-5937-4748-833a-0e3b9237c830 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:17.478680404 +0000 UTC m=+66.318527362 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m55cx" (UniqueName: "kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx") pod "network-check-target-9sg2g" (UID: "060cb363-5937-4748-833a-0e3b9237c830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 27 21:28:45.513277 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.513244 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f56nx"] May 27 21:28:45.526788 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.526754 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wdqdc"] May 27 21:28:45.526948 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.526911 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.530798 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.530570 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xztv5\"" May 27 21:28:45.530798 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.530568 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 27 21:28:45.530798 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.530575 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 27 21:28:45.551067 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.551039 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdqdc"] May 27 21:28:45.551067 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.551067 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f56nx"] May 27 21:28:45.551258 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.551160 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:45.554260 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.554239 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vmd24\"" May 27 21:28:45.554888 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.554870 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 27 21:28:45.555124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.555107 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 27 21:28:45.555208 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.555113 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 27 21:28:45.679582 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.679545 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6gwj\" (UniqueName: \"kubernetes.io/projected/ac73cbfc-b095-4c18-9076-f2f8bde69750-kube-api-access-l6gwj\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:45.679582 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.679582 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.679772 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.679653 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkwh\" (UniqueName: \"kubernetes.io/projected/3374966c-0179-4b59-8d58-b8e0292031f6-kube-api-access-4jkwh\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.679772 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.679699 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:45.679772 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.679725 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3374966c-0179-4b59-8d58-b8e0292031f6-config-volume\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.679772 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.679746 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3374966c-0179-4b59-8d58-b8e0292031f6-tmp-dir\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.710157 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.710077 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:28:45.712563 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.712540 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:28:45.712563 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.712560 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdzf7\"" May 27 21:28:45.781025 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.780989 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkwh\" (UniqueName: \"kubernetes.io/projected/3374966c-0179-4b59-8d58-b8e0292031f6-kube-api-access-4jkwh\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.781217 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.781035 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:45.781217 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.781056 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3374966c-0179-4b59-8d58-b8e0292031f6-config-volume\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.781217 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.781076 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3374966c-0179-4b59-8d58-b8e0292031f6-tmp-dir\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.781217 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.781102 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6gwj\" (UniqueName: \"kubernetes.io/projected/ac73cbfc-b095-4c18-9076-f2f8bde69750-kube-api-access-l6gwj\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:45.781217 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.781125 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.781217 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.781166 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:28:45.781625 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.781231 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:28:45.781625 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.781235 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert podName:ac73cbfc-b095-4c18-9076-f2f8bde69750 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:46.281213458 +0000 UTC m=+35.121060426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert") pod "ingress-canary-wdqdc" (UID: "ac73cbfc-b095-4c18-9076-f2f8bde69750") : secret "canary-serving-cert" not found May 27 21:28:45.781625 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:45.781288 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls podName:3374966c-0179-4b59-8d58-b8e0292031f6 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:46.281273312 +0000 UTC m=+35.121120262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls") pod "dns-default-f56nx" (UID: "3374966c-0179-4b59-8d58-b8e0292031f6") : secret "dns-default-metrics-tls" not found May 27 21:28:45.781625 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.781517 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3374966c-0179-4b59-8d58-b8e0292031f6-tmp-dir\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.781835 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.781695 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3374966c-0179-4b59-8d58-b8e0292031f6-config-volume\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.794455 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.794421 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkwh\" (UniqueName: \"kubernetes.io/projected/3374966c-0179-4b59-8d58-b8e0292031f6-kube-api-access-4jkwh\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:45.794542 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:45.794486 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6gwj\" (UniqueName: \"kubernetes.io/projected/ac73cbfc-b095-4c18-9076-f2f8bde69750-kube-api-access-l6gwj\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:46.285498 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:46.285403 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:46.285498 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:46.285458 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:46.285729 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:46.285555 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:28:46.285729 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:46.285563 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:28:46.285729 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:46.285608 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls podName:3374966c-0179-4b59-8d58-b8e0292031f6 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:47.28559434 +0000 UTC m=+36.125441291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls") pod "dns-default-f56nx" (UID: "3374966c-0179-4b59-8d58-b8e0292031f6") : secret "dns-default-metrics-tls" not found May 27 21:28:46.285729 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:46.285622 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert podName:ac73cbfc-b095-4c18-9076-f2f8bde69750 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:47.28561553 +0000 UTC m=+36.125462480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert") pod "ingress-canary-wdqdc" (UID: "ac73cbfc-b095-4c18-9076-f2f8bde69750") : secret "canary-serving-cert" not found May 27 21:28:46.709463 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:46.709427 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:28:46.712083 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:46.712058 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:28:46.712794 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:46.712779 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:28:46.713138 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:46.712788 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s5jvq\"" May 27 21:28:46.854328 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:46.854293 2549 generic.go:358] "Generic (PLEG): container finished" podID="af21fafe-e0a8-44a6-b21a-52698d6cf989" containerID="b072873dd8fb3167d4de04dff49a606e028f662ec705d69e1e2a422a718afeac" exitCode=0 May 27 21:28:46.854328 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:46.854331 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" event={"ID":"af21fafe-e0a8-44a6-b21a-52698d6cf989","Type":"ContainerDied","Data":"b072873dd8fb3167d4de04dff49a606e028f662ec705d69e1e2a422a718afeac"} May 27 21:28:47.294731 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.294649 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:47.294731 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.294705 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:47.294900 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:47.294799 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:28:47.294900 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:47.294803 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:28:47.294900 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:47.294852 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls podName:3374966c-0179-4b59-8d58-b8e0292031f6 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:49.294837428 +0000 UTC m=+38.134684377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls") pod "dns-default-f56nx" (UID: "3374966c-0179-4b59-8d58-b8e0292031f6") : secret "dns-default-metrics-tls" not found May 27 21:28:47.294900 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:47.294865 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert podName:ac73cbfc-b095-4c18-9076-f2f8bde69750 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:49.294859976 +0000 UTC m=+38.134706926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert") pod "ingress-canary-wdqdc" (UID: "ac73cbfc-b095-4c18-9076-f2f8bde69750") : secret "canary-serving-cert" not found May 27 21:28:47.506482 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.506447 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-67xzr"] May 27 21:28:47.521865 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.521804 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-67xzr"] May 27 21:28:47.522030 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.521934 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.524578 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.524552 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 27 21:28:47.697604 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.697567 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a36291c-83d8-4650-9659-dff5ac538053-kubelet-config\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.697604 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.697606 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a36291c-83d8-4650-9659-dff5ac538053-dbus\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.697819 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.697638 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a36291c-83d8-4650-9659-dff5ac538053-original-pull-secret\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.798777 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.798736 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a36291c-83d8-4650-9659-dff5ac538053-kubelet-config\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.798777 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.798779 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a36291c-83d8-4650-9659-dff5ac538053-dbus\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.799282 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.798874 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a36291c-83d8-4650-9659-dff5ac538053-kubelet-config\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.799282 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.798926 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a36291c-83d8-4650-9659-dff5ac538053-original-pull-secret\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.799282 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.798967 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a36291c-83d8-4650-9659-dff5ac538053-dbus\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.801887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.801866 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a36291c-83d8-4650-9659-dff5ac538053-original-pull-secret\") pod \"global-pull-secret-syncer-67xzr\" (UID: \"2a36291c-83d8-4650-9659-dff5ac538053\") " pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.830657 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.830624 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67xzr" May 27 21:28:47.861645 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.861598 2549 generic.go:358] "Generic (PLEG): container finished" podID="af21fafe-e0a8-44a6-b21a-52698d6cf989" containerID="df37a9857db0d2e409377fbdfcd0c63b9411e4c0f773deedad876a0100d0341c" exitCode=0 May 27 21:28:47.861794 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:47.861663 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" event={"ID":"af21fafe-e0a8-44a6-b21a-52698d6cf989","Type":"ContainerDied","Data":"df37a9857db0d2e409377fbdfcd0c63b9411e4c0f773deedad876a0100d0341c"} May 27 21:28:48.024034 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:48.024002 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-67xzr"] May 27 21:28:48.028193 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:28:48.028166 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a36291c_83d8_4650_9659_dff5ac538053.slice/crio-1b5252fe56dd4771eebb8ce5c6a252ee89a8e972eee5dbaff826e69c47bb967b WatchSource:0}: Error finding container 1b5252fe56dd4771eebb8ce5c6a252ee89a8e972eee5dbaff826e69c47bb967b: Status 404 returned error can't find the container with id 1b5252fe56dd4771eebb8ce5c6a252ee89a8e972eee5dbaff826e69c47bb967b May 27 21:28:48.864819 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:48.864781 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-67xzr" event={"ID":"2a36291c-83d8-4650-9659-dff5ac538053","Type":"ContainerStarted","Data":"1b5252fe56dd4771eebb8ce5c6a252ee89a8e972eee5dbaff826e69c47bb967b"} May 27 21:28:48.867793 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:48.867757 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" event={"ID":"af21fafe-e0a8-44a6-b21a-52698d6cf989","Type":"ContainerStarted","Data":"84cf8019e36ce23bba8637ad53262ea5bdaed644cfa6ba20fa3cfbd8dd746f0d"} May 27 21:28:48.892027 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:48.891940 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k5nf4" podStartSLOduration=6.467746489 podStartE2EDuration="37.891923751s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:14.366266735 +0000 UTC m=+3.206113700" lastFinishedPulling="2026-05-27 21:28:45.790443997 +0000 UTC m=+34.630290962" observedRunningTime="2026-05-27 21:28:48.890830274 +0000 UTC m=+37.730677246" watchObservedRunningTime="2026-05-27 21:28:48.891923751 +0000 UTC m=+37.731770722" May 27 21:28:49.310512 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:49.310469 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:49.310688 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:49.310567 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:49.310688 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:49.310647 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:28:49.310688 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:49.310667 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:28:49.310822 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:49.310715 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls podName:3374966c-0179-4b59-8d58-b8e0292031f6 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:53.310698563 +0000 UTC m=+42.150545518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls") pod "dns-default-f56nx" (UID: "3374966c-0179-4b59-8d58-b8e0292031f6") : secret "dns-default-metrics-tls" not found May 27 21:28:49.310822 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:49.310733 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert podName:ac73cbfc-b095-4c18-9076-f2f8bde69750 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:53.31072618 +0000 UTC m=+42.150573130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert") pod "ingress-canary-wdqdc" (UID: "ac73cbfc-b095-4c18-9076-f2f8bde69750") : secret "canary-serving-cert" not found May 27 21:28:52.876773 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:52.876731 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-67xzr" event={"ID":"2a36291c-83d8-4650-9659-dff5ac538053","Type":"ContainerStarted","Data":"673f37e6a1f2f58168202c6da58f3b913fb44deb4e48e4a4eab12db711add9a6"} May 27 21:28:52.892311 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:52.892250 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-67xzr" podStartSLOduration=1.913753523 podStartE2EDuration="5.892231665s" podCreationTimestamp="2026-05-27 21:28:47 +0000 UTC" firstStartedPulling="2026-05-27 21:28:48.029924961 +0000 UTC m=+36.869771911" lastFinishedPulling="2026-05-27 21:28:52.008403086 +0000 UTC m=+40.848250053" observedRunningTime="2026-05-27 21:28:52.892025109 +0000 UTC m=+41.731872081" watchObservedRunningTime="2026-05-27 21:28:52.892231665 +0000 UTC m=+41.732078644" May 27 21:28:53.344523 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:53.344482 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:28:53.344669 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:28:53.344566 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:28:53.344669 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:53.344643 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:28:53.344741 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:53.344672 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:28:53.344741 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:53.344712 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls podName:3374966c-0179-4b59-8d58-b8e0292031f6 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:01.344693163 +0000 UTC m=+50.184540120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls") pod "dns-default-f56nx" (UID: "3374966c-0179-4b59-8d58-b8e0292031f6") : secret "dns-default-metrics-tls" not found May 27 21:28:53.344741 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:28:53.344727 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert podName:ac73cbfc-b095-4c18-9076-f2f8bde69750 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:01.344720726 +0000 UTC m=+50.184567676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert") pod "ingress-canary-wdqdc" (UID: "ac73cbfc-b095-4c18-9076-f2f8bde69750") : secret "canary-serving-cert" not found May 27 21:29:01.397058 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:01.397014 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:29:01.397601 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:01.397078 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:29:01.397601 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:01.397166 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:29:01.397601 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:01.397188 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:29:01.397601 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:01.397243 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert podName:ac73cbfc-b095-4c18-9076-f2f8bde69750 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:17.397228091 +0000 UTC m=+66.237075042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert") pod "ingress-canary-wdqdc" (UID: "ac73cbfc-b095-4c18-9076-f2f8bde69750") : secret "canary-serving-cert" not found May 27 21:29:01.397601 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:01.397258 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls podName:3374966c-0179-4b59-8d58-b8e0292031f6 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:17.397252751 +0000 UTC m=+66.237099700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls") pod "dns-default-f56nx" (UID: "3374966c-0179-4b59-8d58-b8e0292031f6") : secret "dns-default-metrics-tls" not found May 27 21:29:10.849081 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:10.849022 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tnmz" May 27 21:29:17.406065 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.406023 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:29:17.406482 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.406093 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:29:17.406482 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:17.406174 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:29:17.406482 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:17.406202 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:29:17.406482 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:17.406250 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls podName:3374966c-0179-4b59-8d58-b8e0292031f6 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:49.406234034 +0000 UTC m=+98.246080984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls") pod "dns-default-f56nx" (UID: "3374966c-0179-4b59-8d58-b8e0292031f6") : secret "dns-default-metrics-tls" not found May 27 21:29:17.406482 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:17.406265 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert podName:ac73cbfc-b095-4c18-9076-f2f8bde69750 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:49.406258248 +0000 UTC m=+98.246105197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert") pod "ingress-canary-wdqdc" (UID: "ac73cbfc-b095-4c18-9076-f2f8bde69750") : secret "canary-serving-cert" not found May 27 21:29:17.506978 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.506935 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:29:17.506978 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.506981 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:29:17.509546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.509526 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 27 21:29:17.509596 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.509525 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 27 21:29:17.517553 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:17.517520 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 21:29:17.517705 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:17.517610 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:30:21.517588581 +0000 UTC m=+130.357435535 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : secret "metrics-daemon-secret" not found May 27 21:29:17.519654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.519638 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 27 21:29:17.531019 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.530992 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55cx\" (UniqueName: \"kubernetes.io/projected/060cb363-5937-4748-833a-0e3b9237c830-kube-api-access-m55cx\") pod \"network-check-target-9sg2g\" (UID: \"060cb363-5937-4748-833a-0e3b9237c830\") " pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:29:17.620921 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.620894 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s5jvq\"" May 27 21:29:17.629022 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.628997 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:29:17.760942 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.760912 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9sg2g"] May 27 21:29:17.764121 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:29:17.764089 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060cb363_5937_4748_833a_0e3b9237c830.slice/crio-37da400a80f78311eb22d4a24762346a4144e06116b206d2024930b47a40c169 WatchSource:0}: Error finding container 37da400a80f78311eb22d4a24762346a4144e06116b206d2024930b47a40c169: Status 404 returned error can't find the container with id 37da400a80f78311eb22d4a24762346a4144e06116b206d2024930b47a40c169 May 27 21:29:17.926781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:17.926688 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9sg2g" event={"ID":"060cb363-5937-4748-833a-0e3b9237c830","Type":"ContainerStarted","Data":"37da400a80f78311eb22d4a24762346a4144e06116b206d2024930b47a40c169"} May 27 21:29:21.936386 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:21.936346 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9sg2g" event={"ID":"060cb363-5937-4748-833a-0e3b9237c830","Type":"ContainerStarted","Data":"c022cd0f5bd0576a0a466c47044c3070f1c571b35fff3456e60df982ec122926"} May 27 21:29:21.936804 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:21.936493 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:29:21.952158 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:21.952107 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9sg2g" podStartSLOduration=67.678080006 podStartE2EDuration="1m10.952091039s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:29:17.765872418 +0000 UTC m=+66.605719368" lastFinishedPulling="2026-05-27 21:29:21.039883436 +0000 UTC m=+69.879730401" observedRunningTime="2026-05-27 21:29:21.951360161 +0000 UTC m=+70.791207136" watchObservedRunningTime="2026-05-27 21:29:21.952091039 +0000 UTC m=+70.791938010" May 27 21:29:49.431055 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:49.431001 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:29:49.431532 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:49.431074 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:29:49.431532 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:49.431162 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 27 21:29:49.431532 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:49.431223 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert podName:ac73cbfc-b095-4c18-9076-f2f8bde69750 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:53.431207367 +0000 UTC m=+162.271054317 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert") pod "ingress-canary-wdqdc" (UID: "ac73cbfc-b095-4c18-9076-f2f8bde69750") : secret "canary-serving-cert" not found May 27 21:29:49.431532 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:49.431160 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 27 21:29:49.431532 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:29:49.431299 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls podName:3374966c-0179-4b59-8d58-b8e0292031f6 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:53.431284517 +0000 UTC m=+162.271131467 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls") pod "dns-default-f56nx" (UID: "3374966c-0179-4b59-8d58-b8e0292031f6") : secret "dns-default-metrics-tls" not found May 27 21:29:52.940030 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:29:52.940000 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9sg2g" May 27 21:30:20.974480 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.974444 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg"] May 27 21:30:20.977229 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.977212 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:20.978474 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.978451 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn"] May 27 21:30:20.979807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.979782 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 27 21:30:20.979946 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.979926 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 27 21:30:20.980762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.980746 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 27 21:30:20.980846 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.980773 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 27 21:30:20.980846 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.980805 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zrkrg\"" May 27 21:30:20.981132 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.981115 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:20.982680 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.982659 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db84bfd77-5nzzn"] May 27 21:30:20.983646 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.983629 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 27 21:30:20.983783 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.983768 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 27 21:30:20.983853 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.983791 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d4g76\"" May 27 21:30:20.983907 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.983849 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 27 21:30:20.985282 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.985262 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:20.988547 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.988520 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 27 21:30:20.989056 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.989038 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 27 21:30:20.989463 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.989446 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 27 21:30:20.989718 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.989699 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8rshs\"" May 27 21:30:20.995114 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.995094 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg"] May 27 21:30:20.995311 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.995295 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 27 21:30:20.995684 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:20.995665 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn"] May 27 21:30:21.008513 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.008482 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db84bfd77-5nzzn"] May 27 21:30:21.058822 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.058790 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-trusted-ca\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.058822 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.058821 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-bound-sa-token\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.059026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.058840 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:21.059026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.058872 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-image-registry-private-configuration\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.059026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.058936 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.059026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.058971 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bbcb93e-21d4-434c-a504-984d55db2c6b-serving-cert\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.059026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.059008 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-ca-trust-extracted\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.059229 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.059033 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-certificates\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.059229 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.059052 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vkw2\" (UniqueName: \"kubernetes.io/projected/7403cafb-f750-4930-ab21-305b257f54f0-kube-api-access-4vkw2\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:21.059229 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.059073 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv466\" (UniqueName: \"kubernetes.io/projected/5bbcb93e-21d4-434c-a504-984d55db2c6b-kube-api-access-hv466\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.059229 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.059116 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5bbcb93e-21d4-434c-a504-984d55db2c6b-config\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.059229 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.059189 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmt57\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-kube-api-access-cmt57\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.059441 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.059263 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-installation-pull-secrets\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.160527 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.160474 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vkw2\" (UniqueName: \"kubernetes.io/projected/7403cafb-f750-4930-ab21-305b257f54f0-kube-api-access-4vkw2\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:21.160527 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.160528 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hv466\" (UniqueName: \"kubernetes.io/projected/5bbcb93e-21d4-434c-a504-984d55db2c6b-kube-api-access-hv466\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.160733 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.160647 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5bbcb93e-21d4-434c-a504-984d55db2c6b-config\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.160733 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.160701 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmt57\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-kube-api-access-cmt57\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.160807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.160759 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-installation-pull-secrets\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.160807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.160786 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-trusted-ca\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.160905 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.160808 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-bound-sa-token\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.160905 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.160832 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:21.161002 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.160923 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:30:21.161002 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.160983 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls podName:7403cafb-f750-4930-ab21-305b257f54f0 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:21.660963916 +0000 UTC m=+130.500810880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls") pod "cluster-samples-operator-697587599-gvvwn" (UID: "7403cafb-f750-4930-ab21-305b257f54f0") : secret "samples-operator-tls" not found May 27 21:30:21.161103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.161007 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-image-registry-private-configuration\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.161103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.161065 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.161103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.161094 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bbcb93e-21d4-434c-a504-984d55db2c6b-serving-cert\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.161244 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.161146 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-ca-trust-extracted\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.161244 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.161167 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:30:21.161244 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.161186 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db84bfd77-5nzzn: secret "image-registry-tls" not found May 27 21:30:21.161244 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.161186 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-certificates\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.161466 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.161248 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls podName:b2261dcc-f571-48c7-8652-6d0ebb9f48b7 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:21.661230507 +0000 UTC m=+130.501077460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls") pod "image-registry-6db84bfd77-5nzzn" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7") : secret "image-registry-tls" not found May 27 21:30:21.161466 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.161296 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5bbcb93e-21d4-434c-a504-984d55db2c6b-config\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.161593 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.161564 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-ca-trust-extracted\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.161755 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.161735 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-certificates\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.162019 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.162001 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-trusted-ca\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.163586 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.163567 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5bbcb93e-21d4-434c-a504-984d55db2c6b-serving-cert\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.163985 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.163964 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-installation-pull-secrets\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.164022 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.163984 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-image-registry-private-configuration\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.170301 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.170272 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-bound-sa-token\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.171169 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.171144 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv466\" (UniqueName: \"kubernetes.io/projected/5bbcb93e-21d4-434c-a504-984d55db2c6b-kube-api-access-hv466\") pod \"service-ca-operator-57b5b68b8-4skgg\" (UID: \"5bbcb93e-21d4-434c-a504-984d55db2c6b\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.171289 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.171265 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmt57\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-kube-api-access-cmt57\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.171390 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.171371 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vkw2\" (UniqueName: \"kubernetes.io/projected/7403cafb-f750-4930-ab21-305b257f54f0-kube-api-access-4vkw2\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:21.186379 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.186354 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz"] May 27 21:30:21.190734 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.190714 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.191758 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.191737 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-c5g7l"] May 27 21:30:21.194441 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.194425 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.195769 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.195752 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 27 21:30:21.196091 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.196069 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 27 21:30:21.196190 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.196127 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 27 21:30:21.198360 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.198326 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tlgtx\"" May 27 21:30:21.198673 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.198652 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 27 21:30:21.198742 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.198699 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 27 21:30:21.198792 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.198739 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 27 21:30:21.198927 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.198900 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 27 21:30:21.198999 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.198984 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jvh2v\"" May 27 21:30:21.199047 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.199036 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 27 21:30:21.204182 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.204160 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 27 21:30:21.209534 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.209510 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz"] May 27 21:30:21.211010 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.210991 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-c5g7l"] May 27 21:30:21.262449 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262358 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd2d615e-5d8e-4e73-9e11-62024901986b-serving-cert\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.262449 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262420 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd2d615e-5d8e-4e73-9e11-62024901986b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.262672 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262462 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd2d615e-5d8e-4e73-9e11-62024901986b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.262672 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262484 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-249wx\" (UniqueName: \"kubernetes.io/projected/a238b30e-4eb3-4df6-968e-3718aba71c96-kube-api-access-249wx\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.262672 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262510 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fd2d615e-5d8e-4e73-9e11-62024901986b-snapshots\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.262672 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262609 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgskw\" (UniqueName: \"kubernetes.io/projected/fd2d615e-5d8e-4e73-9e11-62024901986b-kube-api-access-vgskw\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.262853 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262688 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.262853 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262722 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a238b30e-4eb3-4df6-968e-3718aba71c96-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.262853 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.262752 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd2d615e-5d8e-4e73-9e11-62024901986b-tmp\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.286961 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.286935 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" May 27 21:30:21.364036 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364008 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.364036 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364045 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a238b30e-4eb3-4df6-968e-3718aba71c96-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.364236 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364068 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd2d615e-5d8e-4e73-9e11-62024901986b-tmp\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.364236 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364095 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd2d615e-5d8e-4e73-9e11-62024901986b-serving-cert\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.364236 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.364162 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:30:21.364236 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.364232 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls podName:a238b30e-4eb3-4df6-968e-3718aba71c96 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:21.864208298 +0000 UTC m=+130.704055252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5t5mz" (UID: "a238b30e-4eb3-4df6-968e-3718aba71c96") : secret "cluster-monitoring-operator-tls" not found May 27 21:30:21.364550 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364524 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd2d615e-5d8e-4e73-9e11-62024901986b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.364629 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364608 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd2d615e-5d8e-4e73-9e11-62024901986b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.364687 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364659 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-249wx\" (UniqueName: \"kubernetes.io/projected/a238b30e-4eb3-4df6-968e-3718aba71c96-kube-api-access-249wx\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.364737 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364695 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fd2d615e-5d8e-4e73-9e11-62024901986b-snapshots\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.364786 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364767 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgskw\" (UniqueName: \"kubernetes.io/projected/fd2d615e-5d8e-4e73-9e11-62024901986b-kube-api-access-vgskw\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.365170 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364910 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a238b30e-4eb3-4df6-968e-3718aba71c96-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.365170 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.364613 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd2d615e-5d8e-4e73-9e11-62024901986b-tmp\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.365317 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.365177 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd2d615e-5d8e-4e73-9e11-62024901986b-service-ca-bundle\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.365317 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.365224 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd2d615e-5d8e-4e73-9e11-62024901986b-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.365579 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.365559 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fd2d615e-5d8e-4e73-9e11-62024901986b-snapshots\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.366680 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.366663 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd2d615e-5d8e-4e73-9e11-62024901986b-serving-cert\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.379865 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.379837 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgskw\" (UniqueName: \"kubernetes.io/projected/fd2d615e-5d8e-4e73-9e11-62024901986b-kube-api-access-vgskw\") pod \"insights-operator-78bdfb888c-c5g7l\" (UID: \"fd2d615e-5d8e-4e73-9e11-62024901986b\") " pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.387744 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.387719 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-249wx\" (UniqueName: \"kubernetes.io/projected/a238b30e-4eb3-4df6-968e-3718aba71c96-kube-api-access-249wx\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.430955 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.430915 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg"] May 27 21:30:21.434780 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:30:21.434755 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbcb93e_21d4_434c_a504_984d55db2c6b.slice/crio-059ee130ee1d299dcf310886cd29daa433f8beb825075a12d7979a5395029c96 WatchSource:0}: Error finding container 059ee130ee1d299dcf310886cd29daa433f8beb825075a12d7979a5395029c96: Status 404 returned error can't find the container with id 059ee130ee1d299dcf310886cd29daa433f8beb825075a12d7979a5395029c96 May 27 21:30:21.505351 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.505309 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" May 27 21:30:21.566876 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.566845 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:30:21.567035 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.566981 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 27 21:30:21.567094 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.567047 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs podName:71222d0a-e311-4912-bc4d-d822abd1c9af nodeName:}" failed. No retries permitted until 2026-05-27 21:32:23.567030542 +0000 UTC m=+252.406877493 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs") pod "network-metrics-daemon-l6qxd" (UID: "71222d0a-e311-4912-bc4d-d822abd1c9af") : secret "metrics-daemon-secret" not found May 27 21:30:21.628635 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.628596 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-c5g7l"] May 27 21:30:21.631138 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:30:21.631115 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd2d615e_5d8e_4e73_9e11_62024901986b.slice/crio-a6effa0b44730f390ff7453ec730044d9e2740465cf9cff150a81beb8d265e5d WatchSource:0}: Error finding container a6effa0b44730f390ff7453ec730044d9e2740465cf9cff150a81beb8d265e5d: Status 404 returned error can't find the container with id a6effa0b44730f390ff7453ec730044d9e2740465cf9cff150a81beb8d265e5d May 27 21:30:21.668095 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.668066 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:21.668095 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.668105 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:21.668295 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.668230 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:30:21.668295 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.668258 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:30:21.668295 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.668270 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db84bfd77-5nzzn: secret "image-registry-tls" not found May 27 21:30:21.668417 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.668299 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls podName:7403cafb-f750-4930-ab21-305b257f54f0 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:22.668280185 +0000 UTC m=+131.508127158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls") pod "cluster-samples-operator-697587599-gvvwn" (UID: "7403cafb-f750-4930-ab21-305b257f54f0") : secret "samples-operator-tls" not found May 27 21:30:21.668417 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.668313 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls podName:b2261dcc-f571-48c7-8652-6d0ebb9f48b7 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:22.668307596 +0000 UTC m=+131.508154546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls") pod "image-registry-6db84bfd77-5nzzn" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7") : secret "image-registry-tls" not found May 27 21:30:21.869659 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:21.869612 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:21.869861 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.869745 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:30:21.869861 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:21.869818 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls podName:a238b30e-4eb3-4df6-968e-3718aba71c96 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:22.869798085 +0000 UTC m=+131.709645036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5t5mz" (UID: "a238b30e-4eb3-4df6-968e-3718aba71c96") : secret "cluster-monitoring-operator-tls" not found May 27 21:30:22.046897 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:22.046860 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" event={"ID":"fd2d615e-5d8e-4e73-9e11-62024901986b","Type":"ContainerStarted","Data":"a6effa0b44730f390ff7453ec730044d9e2740465cf9cff150a81beb8d265e5d"} May 27 21:30:22.047844 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:22.047819 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" event={"ID":"5bbcb93e-21d4-434c-a504-984d55db2c6b","Type":"ContainerStarted","Data":"059ee130ee1d299dcf310886cd29daa433f8beb825075a12d7979a5395029c96"} May 27 21:30:22.675490 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:22.675452 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:22.675683 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:22.675497 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:22.675683 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:22.675601 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:30:22.675683 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:22.675622 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:30:22.675683 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:22.675633 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db84bfd77-5nzzn: secret "image-registry-tls" not found May 27 21:30:22.675683 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:22.675673 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls podName:7403cafb-f750-4930-ab21-305b257f54f0 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:24.675653341 +0000 UTC m=+133.515500306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls") pod "cluster-samples-operator-697587599-gvvwn" (UID: "7403cafb-f750-4930-ab21-305b257f54f0") : secret "samples-operator-tls" not found May 27 21:30:22.675901 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:22.675691 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls podName:b2261dcc-f571-48c7-8652-6d0ebb9f48b7 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:24.675682305 +0000 UTC m=+133.515529255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls") pod "image-registry-6db84bfd77-5nzzn" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7") : secret "image-registry-tls" not found May 27 21:30:22.877850 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:22.877804 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:22.878016 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:22.877956 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:30:22.878056 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:22.878031 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls podName:a238b30e-4eb3-4df6-968e-3718aba71c96 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:24.878014882 +0000 UTC m=+133.717861831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5t5mz" (UID: "a238b30e-4eb3-4df6-968e-3718aba71c96") : secret "cluster-monitoring-operator-tls" not found May 27 21:30:24.692161 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:24.692114 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:24.692544 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:24.692172 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:24.692544 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:24.692272 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:30:24.692544 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:24.692357 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls podName:7403cafb-f750-4930-ab21-305b257f54f0 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:28.692320348 +0000 UTC m=+137.532167302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls") pod "cluster-samples-operator-697587599-gvvwn" (UID: "7403cafb-f750-4930-ab21-305b257f54f0") : secret "samples-operator-tls" not found May 27 21:30:24.692544 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:24.692273 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:30:24.692544 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:24.692405 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db84bfd77-5nzzn: secret "image-registry-tls" not found May 27 21:30:24.692544 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:24.692478 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls podName:b2261dcc-f571-48c7-8652-6d0ebb9f48b7 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:28.692455892 +0000 UTC m=+137.532302858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls") pod "image-registry-6db84bfd77-5nzzn" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7") : secret "image-registry-tls" not found May 27 21:30:24.893495 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:24.893442 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:24.893670 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:24.893596 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:30:24.893670 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:24.893661 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls podName:a238b30e-4eb3-4df6-968e-3718aba71c96 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:28.893644816 +0000 UTC m=+137.733491770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5t5mz" (UID: "a238b30e-4eb3-4df6-968e-3718aba71c96") : secret "cluster-monitoring-operator-tls" not found May 27 21:30:25.055292 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.055186 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" event={"ID":"5bbcb93e-21d4-434c-a504-984d55db2c6b","Type":"ContainerStarted","Data":"bd0e09856566277e520c6a7e87f4feca6ad2eb4a76806a4210cb381635992384"} May 27 21:30:25.056520 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.056494 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" event={"ID":"fd2d615e-5d8e-4e73-9e11-62024901986b","Type":"ContainerStarted","Data":"d61a01c3b1df6d87e36832dc79f4f0fdd6e098b08cc1d56d67ef750dbcc0a87c"} May 27 21:30:25.075618 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.075572 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" podStartSLOduration=2.497131478 podStartE2EDuration="5.075557413s" podCreationTimestamp="2026-05-27 21:30:20 +0000 UTC" firstStartedPulling="2026-05-27 21:30:21.43647797 +0000 UTC m=+130.276324920" lastFinishedPulling="2026-05-27 21:30:24.014903906 +0000 UTC m=+132.854750855" observedRunningTime="2026-05-27 21:30:25.074869616 +0000 UTC m=+133.914716588" watchObservedRunningTime="2026-05-27 21:30:25.075557413 +0000 UTC m=+133.915404387" May 27 21:30:25.101576 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.101511 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" podStartSLOduration=1.717276593 podStartE2EDuration="4.101488635s" podCreationTimestamp="2026-05-27 21:30:21 +0000 UTC" firstStartedPulling="2026-05-27 21:30:21.632750755 +0000 UTC m=+130.472597706" lastFinishedPulling="2026-05-27 21:30:24.016962786 +0000 UTC m=+132.856809748" observedRunningTime="2026-05-27 21:30:25.101415068 +0000 UTC m=+133.941262040" watchObservedRunningTime="2026-05-27 21:30:25.101488635 +0000 UTC m=+133.941335609" May 27 21:30:25.448937 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.448904 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x"] May 27 21:30:25.452045 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.452029 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" May 27 21:30:25.455155 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.455125 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 27 21:30:25.455297 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.455125 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7nmr8\"" May 27 21:30:25.455465 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.455448 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 27 21:30:25.487569 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.487511 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x"] May 27 21:30:25.600714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.600673 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hfkd\" (UniqueName: \"kubernetes.io/projected/f424d97b-9184-4b48-8d90-2e0f040bd7c2-kube-api-access-8hfkd\") pod \"migrator-b985f5d89-q4j7x\" (UID: \"f424d97b-9184-4b48-8d90-2e0f040bd7c2\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" May 27 21:30:25.701397 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.701285 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hfkd\" (UniqueName: \"kubernetes.io/projected/f424d97b-9184-4b48-8d90-2e0f040bd7c2-kube-api-access-8hfkd\") pod \"migrator-b985f5d89-q4j7x\" (UID: \"f424d97b-9184-4b48-8d90-2e0f040bd7c2\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" May 27 21:30:25.710626 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.710590 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hfkd\" (UniqueName: \"kubernetes.io/projected/f424d97b-9184-4b48-8d90-2e0f040bd7c2-kube-api-access-8hfkd\") pod \"migrator-b985f5d89-q4j7x\" (UID: \"f424d97b-9184-4b48-8d90-2e0f040bd7c2\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" May 27 21:30:25.761171 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.761131 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" May 27 21:30:25.889089 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:25.889056 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x"] May 27 21:30:25.891913 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:30:25.891882 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf424d97b_9184_4b48_8d90_2e0f040bd7c2.slice/crio-8553cfd45c0a7ef4770c5d8de958b4cb145d101818437ca9b25af2ce0128ab14 WatchSource:0}: Error finding container 8553cfd45c0a7ef4770c5d8de958b4cb145d101818437ca9b25af2ce0128ab14: Status 404 returned error can't find the container with id 8553cfd45c0a7ef4770c5d8de958b4cb145d101818437ca9b25af2ce0128ab14 May 27 21:30:26.059351 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:26.059252 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" event={"ID":"f424d97b-9184-4b48-8d90-2e0f040bd7c2","Type":"ContainerStarted","Data":"8553cfd45c0a7ef4770c5d8de958b4cb145d101818437ca9b25af2ce0128ab14"} May 27 21:30:27.153848 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:27.153822 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ls77t_37736595-f26f-4455-8d5c-b7cbad923ad0/dns-node-resolver/0.log" May 27 21:30:28.068125 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:28.068088 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" event={"ID":"f424d97b-9184-4b48-8d90-2e0f040bd7c2","Type":"ContainerStarted","Data":"6adcf4ba279730c295bab63c82a1ed67f0f8ae1ed1da6e2dc18d37b3a7657188"} May 27 21:30:28.068291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:28.068132 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" event={"ID":"f424d97b-9184-4b48-8d90-2e0f040bd7c2","Type":"ContainerStarted","Data":"0ca4e8207567d25b55ed095ac63aa4c6e555066a9ebc1bd75dbaedd1691de30e"} May 27 21:30:28.091573 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:28.091523 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-q4j7x" podStartSLOduration=1.8478774150000001 podStartE2EDuration="3.091507778s" podCreationTimestamp="2026-05-27 21:30:25 +0000 UTC" firstStartedPulling="2026-05-27 21:30:25.893713423 +0000 UTC m=+134.733560374" lastFinishedPulling="2026-05-27 21:30:27.137343773 +0000 UTC m=+135.977190737" observedRunningTime="2026-05-27 21:30:28.090626345 +0000 UTC m=+136.930473316" watchObservedRunningTime="2026-05-27 21:30:28.091507778 +0000 UTC m=+136.931354751" May 27 21:30:28.154953 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:28.154927 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cgdsd_d7a806a8-63c2-4eff-a538-ce53e1b14446/node-ca/0.log" May 27 21:30:28.725288 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:28.725253 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:28.725480 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:28.725297 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:28.725480 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:28.725427 2549 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 27 21:30:28.725480 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:28.725467 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 27 21:30:28.725579 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:28.725486 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db84bfd77-5nzzn: secret "image-registry-tls" not found May 27 21:30:28.725579 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:28.725494 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls podName:7403cafb-f750-4930-ab21-305b257f54f0 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:36.725478557 +0000 UTC m=+145.565325507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls") pod "cluster-samples-operator-697587599-gvvwn" (UID: "7403cafb-f750-4930-ab21-305b257f54f0") : secret "samples-operator-tls" not found May 27 21:30:28.725579 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:28.725527 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls podName:b2261dcc-f571-48c7-8652-6d0ebb9f48b7 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:36.725514772 +0000 UTC m=+145.565361723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls") pod "image-registry-6db84bfd77-5nzzn" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7") : secret "image-registry-tls" not found May 27 21:30:28.927467 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:28.927425 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:28.927634 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:28.927539 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:30:28.927634 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:28.927592 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls podName:a238b30e-4eb3-4df6-968e-3718aba71c96 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:36.927577616 +0000 UTC m=+145.767424566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5t5mz" (UID: "a238b30e-4eb3-4df6-968e-3718aba71c96") : secret "cluster-monitoring-operator-tls" not found May 27 21:30:36.792612 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:36.792535 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:36.792612 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:36.792619 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:36.795064 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:36.795036 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7403cafb-f750-4930-ab21-305b257f54f0-samples-operator-tls\") pod \"cluster-samples-operator-697587599-gvvwn\" (UID: \"7403cafb-f750-4930-ab21-305b257f54f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:36.795166 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:36.795045 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"image-registry-6db84bfd77-5nzzn\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:36.894650 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:36.894601 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" May 27 21:30:36.899472 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:36.899449 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:36.994844 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:36.994793 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:36.995024 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:36.994954 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 27 21:30:36.995024 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:36.995024 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls podName:a238b30e-4eb3-4df6-968e-3718aba71c96 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:52.995003056 +0000 UTC m=+161.834850006 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-5t5mz" (UID: "a238b30e-4eb3-4df6-968e-3718aba71c96") : secret "cluster-monitoring-operator-tls" not found May 27 21:30:37.036047 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:37.036022 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db84bfd77-5nzzn"] May 27 21:30:37.038226 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:30:37.038186 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2261dcc_f571_48c7_8652_6d0ebb9f48b7.slice/crio-75e011b5e55531e90d18adb0f7e341100bb28d2272390e47f9a5d39bd6138ff5 WatchSource:0}: Error finding container 75e011b5e55531e90d18adb0f7e341100bb28d2272390e47f9a5d39bd6138ff5: Status 404 returned error can't find the container with id 75e011b5e55531e90d18adb0f7e341100bb28d2272390e47f9a5d39bd6138ff5 May 27 21:30:37.046319 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:37.046298 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn"] May 27 21:30:37.091633 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:37.091604 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" event={"ID":"7403cafb-f750-4930-ab21-305b257f54f0","Type":"ContainerStarted","Data":"495204534a690e0daec1e17d57f8625ed61f19ee75cdc51c37d847de47187c97"} May 27 21:30:37.092829 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:37.092805 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" event={"ID":"b2261dcc-f571-48c7-8652-6d0ebb9f48b7","Type":"ContainerStarted","Data":"75e011b5e55531e90d18adb0f7e341100bb28d2272390e47f9a5d39bd6138ff5"} May 27 21:30:38.096414 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:38.096370 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" event={"ID":"b2261dcc-f571-48c7-8652-6d0ebb9f48b7","Type":"ContainerStarted","Data":"6e374292ba8f6e44ddb335f3409edfbc2a40e3565701dbc0b73389caf8e52104"} May 27 21:30:38.096882 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:38.096483 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:30:38.120189 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:38.120133 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" podStartSLOduration=18.12011577 podStartE2EDuration="18.12011577s" podCreationTimestamp="2026-05-27 21:30:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:30:38.118854965 +0000 UTC m=+146.958701936" watchObservedRunningTime="2026-05-27 21:30:38.12011577 +0000 UTC m=+146.959962742" May 27 21:30:40.102689 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:40.102656 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" event={"ID":"7403cafb-f750-4930-ab21-305b257f54f0","Type":"ContainerStarted","Data":"102ba15ba102a7b3b1f16192e5492bcde5a36d51cd847eaf3d23131d80299e7b"} May 27 21:30:40.102689 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:40.102691 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" event={"ID":"7403cafb-f750-4930-ab21-305b257f54f0","Type":"ContainerStarted","Data":"868fbf8277ca6873e1de4d6e7ce31cfeb61889e516e9e66c1a42348d63078159"} May 27 21:30:40.133291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:40.131798 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-gvvwn" podStartSLOduration=17.942580842 podStartE2EDuration="20.131778334s" podCreationTimestamp="2026-05-27 21:30:20 +0000 UTC" firstStartedPulling="2026-05-27 21:30:37.087192119 +0000 UTC m=+145.927039073" lastFinishedPulling="2026-05-27 21:30:39.276389603 +0000 UTC m=+148.116236565" observedRunningTime="2026-05-27 21:30:40.130277769 +0000 UTC m=+148.970124733" watchObservedRunningTime="2026-05-27 21:30:40.131778334 +0000 UTC m=+148.971625306" May 27 21:30:48.537473 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:48.537428 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f56nx" podUID="3374966c-0179-4b59-8d58-b8e0292031f6" May 27 21:30:48.559601 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:48.559566 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-wdqdc" podUID="ac73cbfc-b095-4c18-9076-f2f8bde69750" May 27 21:30:48.718231 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:30:48.718175 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l6qxd" podUID="71222d0a-e311-4912-bc4d-d822abd1c9af" May 27 21:30:49.124449 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:49.124418 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f56nx" May 27 21:30:53.019242 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.019202 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:53.021603 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.021583 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a238b30e-4eb3-4df6-968e-3718aba71c96-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-5t5mz\" (UID: \"a238b30e-4eb3-4df6-968e-3718aba71c96\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:53.301199 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.301095 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" May 27 21:30:53.421431 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.421401 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz"] May 27 21:30:53.424437 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:30:53.424410 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda238b30e_4eb3_4df6_968e_3718aba71c96.slice/crio-3494cb05ae316c8431491cf47c330cda3afe81b893f756e5164ebe97df93161f WatchSource:0}: Error finding container 3494cb05ae316c8431491cf47c330cda3afe81b893f756e5164ebe97df93161f: Status 404 returned error can't find the container with id 3494cb05ae316c8431491cf47c330cda3afe81b893f756e5164ebe97df93161f May 27 21:30:53.523363 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.523304 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:30:53.523541 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.523414 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:30:53.525970 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.525942 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3374966c-0179-4b59-8d58-b8e0292031f6-metrics-tls\") pod \"dns-default-f56nx\" (UID: \"3374966c-0179-4b59-8d58-b8e0292031f6\") " pod="openshift-dns/dns-default-f56nx" May 27 21:30:53.526073 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.525978 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac73cbfc-b095-4c18-9076-f2f8bde69750-cert\") pod \"ingress-canary-wdqdc\" (UID: \"ac73cbfc-b095-4c18-9076-f2f8bde69750\") " pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:30:53.627394 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.627364 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xztv5\"" May 27 21:30:53.635296 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.635271 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f56nx" May 27 21:30:53.757980 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:53.757946 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f56nx"] May 27 21:30:53.760717 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:30:53.760685 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3374966c_0179_4b59_8d58_b8e0292031f6.slice/crio-d401fb500de61110f0f4c2d67ff4602b7f7079b494b931b58edfe7881cd7d6fc WatchSource:0}: Error finding container d401fb500de61110f0f4c2d67ff4602b7f7079b494b931b58edfe7881cd7d6fc: Status 404 returned error can't find the container with id d401fb500de61110f0f4c2d67ff4602b7f7079b494b931b58edfe7881cd7d6fc May 27 21:30:54.137396 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:54.137355 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" event={"ID":"a238b30e-4eb3-4df6-968e-3718aba71c96","Type":"ContainerStarted","Data":"3494cb05ae316c8431491cf47c330cda3afe81b893f756e5164ebe97df93161f"} May 27 21:30:54.138435 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:54.138405 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f56nx" event={"ID":"3374966c-0179-4b59-8d58-b8e0292031f6","Type":"ContainerStarted","Data":"d401fb500de61110f0f4c2d67ff4602b7f7079b494b931b58edfe7881cd7d6fc"} May 27 21:30:55.099271 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.099232 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f747x"] May 27 21:30:55.102705 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.102667 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.105475 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.105441 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8gwtp\"" May 27 21:30:55.105657 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.105641 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 27 21:30:55.106397 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.106205 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 27 21:30:55.115207 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.115181 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f747x"] May 27 21:30:55.124877 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.124840 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db84bfd77-5nzzn"] May 27 21:30:55.130220 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.130169 2549 patch_prober.go:28] interesting pod/image-registry-6db84bfd77-5nzzn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 27 21:30:55.130381 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.130244 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" podUID="b2261dcc-f571-48c7-8652-6d0ebb9f48b7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 27 21:30:55.136441 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.136364 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8vq4\" (UniqueName: \"kubernetes.io/projected/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-kube-api-access-p8vq4\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.136441 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.136430 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.136656 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.136485 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.136656 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.136544 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-crio-socket\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.136656 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.136593 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-data-volume\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.238001 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.237941 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-data-volume\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.238481 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.238022 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8vq4\" (UniqueName: \"kubernetes.io/projected/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-kube-api-access-p8vq4\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.238481 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.238075 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.238481 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.238235 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.238481 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.238286 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-crio-socket\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.238481 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.238365 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-data-volume\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.238481 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.238432 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-crio-socket\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.238850 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.238826 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.240708 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.240684 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.247178 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.247149 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8vq4\" (UniqueName: \"kubernetes.io/projected/ab62135e-1fa1-4254-80cd-b1a7fa8daa5c-kube-api-access-p8vq4\") pod \"insights-runtime-extractor-f747x\" (UID: \"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c\") " pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.412515 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.412426 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f747x" May 27 21:30:55.760918 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:55.760865 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f747x"] May 27 21:30:55.765952 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:30:55.765912 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab62135e_1fa1_4254_80cd_b1a7fa8daa5c.slice/crio-9a220410142785d4b5340706d142a79a28f71d6bca661c6f965366d176f4b632 WatchSource:0}: Error finding container 9a220410142785d4b5340706d142a79a28f71d6bca661c6f965366d176f4b632: Status 404 returned error can't find the container with id 9a220410142785d4b5340706d142a79a28f71d6bca661c6f965366d176f4b632 May 27 21:30:56.146419 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:56.146385 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" event={"ID":"a238b30e-4eb3-4df6-968e-3718aba71c96","Type":"ContainerStarted","Data":"c29e6de47b8de70b50eaa4d51d4f3ff04d64b56a1128dc9e10b42246cbfda7bc"} May 27 21:30:56.148078 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:56.148051 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f56nx" event={"ID":"3374966c-0179-4b59-8d58-b8e0292031f6","Type":"ContainerStarted","Data":"fd2f339adee0a5e728e7f8797462883ba574f2f918a5e7f6f33846fa314257c6"} May 27 21:30:56.148213 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:56.148085 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f56nx" event={"ID":"3374966c-0179-4b59-8d58-b8e0292031f6","Type":"ContainerStarted","Data":"1f11958ac99af64ca7c9d4e98d9c6413ab8e34124e30a280d7b65d4ff51bdc9a"} May 27 21:30:56.148213 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:56.148193 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f56nx" May 27 21:30:56.149382 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:56.149357 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f747x" event={"ID":"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c","Type":"ContainerStarted","Data":"0af6c8d4424dcd5997649e026b3320c5cc4834c1a457e12f1b715da915d94e9a"} May 27 21:30:56.149477 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:56.149385 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f747x" event={"ID":"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c","Type":"ContainerStarted","Data":"9a220410142785d4b5340706d142a79a28f71d6bca661c6f965366d176f4b632"} May 27 21:30:56.163227 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:56.163185 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-5t5mz" podStartSLOduration=32.987106166 podStartE2EDuration="35.163172874s" podCreationTimestamp="2026-05-27 21:30:21 +0000 UTC" firstStartedPulling="2026-05-27 21:30:53.426291132 +0000 UTC m=+162.266138082" lastFinishedPulling="2026-05-27 21:30:55.602357826 +0000 UTC m=+164.442204790" observedRunningTime="2026-05-27 21:30:56.161478286 +0000 UTC m=+165.001325258" watchObservedRunningTime="2026-05-27 21:30:56.163172874 +0000 UTC m=+165.003019846" May 27 21:30:56.183233 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:56.183188 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-f56nx" podStartSLOduration=129.347619485 podStartE2EDuration="2m11.183174947s" podCreationTimestamp="2026-05-27 21:28:45 +0000 UTC" firstStartedPulling="2026-05-27 21:30:53.762582139 +0000 UTC m=+162.602429089" lastFinishedPulling="2026-05-27 21:30:55.598137581 +0000 UTC m=+164.437984551" observedRunningTime="2026-05-27 21:30:56.183012865 +0000 UTC m=+165.022859839" watchObservedRunningTime="2026-05-27 21:30:56.183174947 +0000 UTC m=+165.023021919" May 27 21:30:57.153791 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:57.153754 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f747x" event={"ID":"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c","Type":"ContainerStarted","Data":"66def3dbffff53b84a196319f2f256764cd13352d3c020cbc2eaf121c63e8ae9"} May 27 21:30:58.157731 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:58.157693 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f747x" event={"ID":"ab62135e-1fa1-4254-80cd-b1a7fa8daa5c","Type":"ContainerStarted","Data":"b62a5dfde49d7f3c0d99bbd6c0ed36d2eb48201e2ac0044e96efecdf84db557e"} May 27 21:30:58.174706 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:30:58.174658 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f747x" podStartSLOduration=1.011771066 podStartE2EDuration="3.174645601s" podCreationTimestamp="2026-05-27 21:30:55 +0000 UTC" firstStartedPulling="2026-05-27 21:30:55.820495199 +0000 UTC m=+164.660342153" lastFinishedPulling="2026-05-27 21:30:57.983369734 +0000 UTC m=+166.823216688" observedRunningTime="2026-05-27 21:30:58.174381336 +0000 UTC m=+167.014228307" watchObservedRunningTime="2026-05-27 21:30:58.174645601 +0000 UTC m=+167.014492596" May 27 21:31:00.710173 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:00.710071 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:31:00.713047 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:00.713027 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vmd24\"" May 27 21:31:00.721191 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:00.721170 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdqdc" May 27 21:31:00.846527 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:00.846491 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdqdc"] May 27 21:31:00.849462 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:31:00.849434 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac73cbfc_b095_4c18_9076_f2f8bde69750.slice/crio-a6c766a82b7427bf063c1b1c59eb68494eeca5ea2818011f2fcd4488b0740ff5 WatchSource:0}: Error finding container a6c766a82b7427bf063c1b1c59eb68494eeca5ea2818011f2fcd4488b0740ff5: Status 404 returned error can't find the container with id a6c766a82b7427bf063c1b1c59eb68494eeca5ea2818011f2fcd4488b0740ff5 May 27 21:31:01.166042 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:01.166006 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdqdc" event={"ID":"ac73cbfc-b095-4c18-9076-f2f8bde69750","Type":"ContainerStarted","Data":"a6c766a82b7427bf063c1b1c59eb68494eeca5ea2818011f2fcd4488b0740ff5"} May 27 21:31:01.711733 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:01.711689 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:31:03.172439 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:03.172403 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdqdc" event={"ID":"ac73cbfc-b095-4c18-9076-f2f8bde69750","Type":"ContainerStarted","Data":"87fda85ec064e61d6048def15bf81a27a8b962cd3bca11e72d1de34bafc1f4ac"} May 27 21:31:03.190053 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:03.190008 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wdqdc" podStartSLOduration=136.558896171 podStartE2EDuration="2m18.189993198s" podCreationTimestamp="2026-05-27 21:28:45 +0000 UTC" firstStartedPulling="2026-05-27 21:31:00.851225807 +0000 UTC m=+169.691072760" lastFinishedPulling="2026-05-27 21:31:02.482322837 +0000 UTC m=+171.322169787" observedRunningTime="2026-05-27 21:31:03.188733625 +0000 UTC m=+172.028580609" watchObservedRunningTime="2026-05-27 21:31:03.189993198 +0000 UTC m=+172.029840214" May 27 21:31:05.129062 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.129035 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:31:05.601804 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.601773 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm"] May 27 21:31:05.603838 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.603822 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.605961 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.605921 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 27 21:31:05.606084 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.605990 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k4pd7\"" May 27 21:31:05.606084 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.606005 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 27 21:31:05.606084 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.606068 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 27 21:31:05.615320 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.615297 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm"] May 27 21:31:05.635753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.635727 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zvwwb"] May 27 21:31:05.637959 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.637936 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.640225 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.640203 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 27 21:31:05.640370 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.640204 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 27 21:31:05.640456 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.640431 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 27 21:31:05.640622 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.640606 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2qckr\"" May 27 21:31:05.719273 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719236 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/396390f7-8bf2-4884-95c6-ab68386f61f6-metrics-client-ca\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.719487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719288 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.719487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719318 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-root\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.719487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719376 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-wtmp\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.719487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719404 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-tls\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.719487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719cb89e-4691-4b88-8a84-634c91319ced-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.719487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719456 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-sys\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.719785 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719516 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-textfile\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.719785 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719548 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwnpp\" (UniqueName: \"kubernetes.io/projected/396390f7-8bf2-4884-95c6-ab68386f61f6-kube-api-access-jwnpp\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.719785 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719573 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.719785 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719603 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s27vq\" (UniqueName: \"kubernetes.io/projected/719cb89e-4691-4b88-8a84-634c91319ced-kube-api-access-s27vq\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.719785 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719632 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.719785 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.719682 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.820824 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.820786 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-textfile\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.820824 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.820827 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwnpp\" (UniqueName: \"kubernetes.io/projected/396390f7-8bf2-4884-95c6-ab68386f61f6-kube-api-access-jwnpp\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821059 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.820848 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.821059 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.820869 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s27vq\" (UniqueName: \"kubernetes.io/projected/719cb89e-4691-4b88-8a84-634c91319ced-kube-api-access-s27vq\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.821059 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.820891 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821059 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.820924 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821263 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:31:05.821059 2549 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 27 21:31:05.821263 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821079 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/396390f7-8bf2-4884-95c6-ab68386f61f6-metrics-client-ca\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821263 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:31:05.821123 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-tls podName:719cb89e-4691-4b88-8a84-634c91319ced nodeName:}" failed. No retries permitted until 2026-05-27 21:31:06.32110567 +0000 UTC m=+175.160952623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-bg2wm" (UID: "719cb89e-4691-4b88-8a84-634c91319ced") : secret "openshift-state-metrics-tls" not found May 27 21:31:05.821263 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821172 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.821263 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821207 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-root\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821263 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821230 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-textfile\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821263 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821239 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-wtmp\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821725 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821295 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-root\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821725 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821294 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-tls\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821725 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821369 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719cb89e-4691-4b88-8a84-634c91319ced-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.821725 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821396 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-sys\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821725 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821473 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-sys\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821725 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821546 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-wtmp\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821725 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821586 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.821725 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.821643 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/396390f7-8bf2-4884-95c6-ab68386f61f6-metrics-client-ca\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.822154 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.822129 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719cb89e-4691-4b88-8a84-634c91319ced-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.823455 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.823427 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.823625 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.823610 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/396390f7-8bf2-4884-95c6-ab68386f61f6-node-exporter-tls\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.823669 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.823652 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.832312 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.832283 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s27vq\" (UniqueName: \"kubernetes.io/projected/719cb89e-4691-4b88-8a84-634c91319ced-kube-api-access-s27vq\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:05.832499 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.832473 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwnpp\" (UniqueName: \"kubernetes.io/projected/396390f7-8bf2-4884-95c6-ab68386f61f6-kube-api-access-jwnpp\") pod \"node-exporter-zvwwb\" (UID: \"396390f7-8bf2-4884-95c6-ab68386f61f6\") " pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.947026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:05.946936 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zvwwb" May 27 21:31:05.955965 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:31:05.955935 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396390f7_8bf2_4884_95c6_ab68386f61f6.slice/crio-1c2a8adb858f2e2de86d0d0156a174092ca1ec47bd0d8159fcc3bc159be2da67 WatchSource:0}: Error finding container 1c2a8adb858f2e2de86d0d0156a174092ca1ec47bd0d8159fcc3bc159be2da67: Status 404 returned error can't find the container with id 1c2a8adb858f2e2de86d0d0156a174092ca1ec47bd0d8159fcc3bc159be2da67 May 27 21:31:06.155762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.155731 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f56nx" May 27 21:31:06.181068 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.181039 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvwwb" event={"ID":"396390f7-8bf2-4884-95c6-ab68386f61f6","Type":"ContainerStarted","Data":"1c2a8adb858f2e2de86d0d0156a174092ca1ec47bd0d8159fcc3bc159be2da67"} May 27 21:31:06.326163 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.326077 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:06.328938 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.328916 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/719cb89e-4691-4b88-8a84-634c91319ced-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-bg2wm\" (UID: \"719cb89e-4691-4b88-8a84-634c91319ced\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:06.512905 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.512856 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" May 27 21:31:06.666553 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.666398 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm"] May 27 21:31:06.744781 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.744747 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:31:06.748054 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.748031 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.750695 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.750665 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 21:31:06.750822 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.750752 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 21:31:06.751065 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.751027 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 21:31:06.751218 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.751189 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4qvhf\"" May 27 21:31:06.751437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.751400 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 21:31:06.751553 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.751462 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 21:31:06.752076 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.751824 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 21:31:06.752154 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.752077 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 21:31:06.752491 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.752475 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 21:31:06.761449 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.761427 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 21:31:06.765616 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.765594 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:31:06.831906 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.831855 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.831906 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.831944 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.831989 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832042 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljcxq\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-kube-api-access-ljcxq\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832070 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-config-out\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832115 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-web-config\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832543 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832150 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832543 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832176 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832543 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832208 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832543 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832239 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832543 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832266 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.832543 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.832302 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.876556 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:31:06.876477 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719cb89e_4691_4b88_8a84_634c91319ced.slice/crio-890782d0acfd194eec4fd97bafef5c5a8ed8ba15d43b25e58bf2d9672d0b5313 WatchSource:0}: Error finding container 890782d0acfd194eec4fd97bafef5c5a8ed8ba15d43b25e58bf2d9672d0b5313: Status 404 returned error can't find the container with id 890782d0acfd194eec4fd97bafef5c5a8ed8ba15d43b25e58bf2d9672d0b5313 May 27 21:31:06.932762 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.932736 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-web-config\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.932862 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.932776 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.932862 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.932796 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.932862 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.932827 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.933044 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.932864 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.933044 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933005 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.933143 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933097 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.933194 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933154 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.933301 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933193 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.933301 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933247 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.934000 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933754 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.934000 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933817 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.934000 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933846 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljcxq\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-kube-api-access-ljcxq\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.934000 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933902 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-config-out\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.934000 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.933918 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.934849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.934824 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.935859 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.935812 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.936168 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.936133 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.936415 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.936395 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-web-config\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.936817 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.936793 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.937013 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.936996 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.937440 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.937402 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.937674 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.937655 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.937786 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.937769 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.938029 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.938010 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-config-out\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:06.941786 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:06.941764 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljcxq\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-kube-api-access-ljcxq\") pod \"alertmanager-main-0\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:07.061704 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.061672 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:31:07.185640 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.185606 2549 generic.go:358] "Generic (PLEG): container finished" podID="396390f7-8bf2-4884-95c6-ab68386f61f6" containerID="f197ccb5c617632d091b54a02275b6abb1e92e7918fb3f93ad7c7ae82307662e" exitCode=0 May 27 21:31:07.186046 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.185697 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvwwb" event={"ID":"396390f7-8bf2-4884-95c6-ab68386f61f6","Type":"ContainerDied","Data":"f197ccb5c617632d091b54a02275b6abb1e92e7918fb3f93ad7c7ae82307662e"} May 27 21:31:07.187500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.187478 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" event={"ID":"719cb89e-4691-4b88-8a84-634c91319ced","Type":"ContainerStarted","Data":"59e5f10f5f6f0354c33d2dc5f4c042ef36eef3716d33638bf51da1b30374b2db"} May 27 21:31:07.187603 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.187507 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" event={"ID":"719cb89e-4691-4b88-8a84-634c91319ced","Type":"ContainerStarted","Data":"b1764e9d0b3f5c4728733f0b6b31e9fe911ea81072607688167a9a6c1f39e3e0"} May 27 21:31:07.187603 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.187521 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" event={"ID":"719cb89e-4691-4b88-8a84-634c91319ced","Type":"ContainerStarted","Data":"890782d0acfd194eec4fd97bafef5c5a8ed8ba15d43b25e58bf2d9672d0b5313"} May 27 21:31:07.212593 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.212569 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:31:07.216415 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:31:07.216390 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa26a64_11c5_4795_9e50_46da84fd143e.slice/crio-c048c40f0d6fcd09370c16727b3fd43c9815ec7d8eefefa9901c55860ec9cad6 WatchSource:0}: Error finding container c048c40f0d6fcd09370c16727b3fd43c9815ec7d8eefefa9901c55860ec9cad6: Status 404 returned error can't find the container with id c048c40f0d6fcd09370c16727b3fd43c9815ec7d8eefefa9901c55860ec9cad6 May 27 21:31:07.764490 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.764454 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f99d985d8-qclqq"] May 27 21:31:07.767737 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.767715 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.770827 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.770765 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 27 21:31:07.771402 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.771385 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m7smz\"" May 27 21:31:07.772095 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.771726 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 27 21:31:07.772095 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.771755 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 27 21:31:07.772095 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.771905 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 27 21:31:07.772095 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.772024 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-71nicoa43pl6d\"" May 27 21:31:07.772095 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.772042 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 27 21:31:07.782384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.782327 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f99d985d8-qclqq"] May 27 21:31:07.841218 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.841183 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.841570 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.841263 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-grpc-tls\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.841570 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.841363 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kslh\" (UniqueName: \"kubernetes.io/projected/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-kube-api-access-4kslh\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.841570 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.841401 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.841570 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.841424 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-metrics-client-ca\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.841570 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.841451 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-tls\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.841570 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.841494 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.841570 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.841531 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.942562 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.942493 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.942562 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.942548 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.942813 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.942585 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.942813 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.942752 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-grpc-tls\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.942916 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.942862 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kslh\" (UniqueName: \"kubernetes.io/projected/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-kube-api-access-4kslh\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.942916 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.942894 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.943022 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.942923 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-metrics-client-ca\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.943022 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.942954 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-tls\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.944428 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.944152 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-metrics-client-ca\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.946379 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.946352 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.946826 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.946781 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-tls\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.947380 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.947356 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.947522 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.947498 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.947700 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.947679 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.948992 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.948802 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-secret-grpc-tls\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:07.952563 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:07.952542 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kslh\" (UniqueName: \"kubernetes.io/projected/a8d4df8f-9a42-4c3a-85d6-daf9795f6893-kube-api-access-4kslh\") pod \"thanos-querier-f99d985d8-qclqq\" (UID: \"a8d4df8f-9a42-4c3a-85d6-daf9795f6893\") " pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:08.079286 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:08.079202 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:08.192993 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:08.192954 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvwwb" event={"ID":"396390f7-8bf2-4884-95c6-ab68386f61f6","Type":"ContainerStarted","Data":"3ef419350f6ff861ed43b7b5ef5f63f0939bda344f1173d3d819825d1db03558"} May 27 21:31:08.193442 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:08.193000 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zvwwb" event={"ID":"396390f7-8bf2-4884-95c6-ab68386f61f6","Type":"ContainerStarted","Data":"e4ca5f96005354e60c795e5a49fd48cfb1db670a40e4c32274bec73838bd8cc5"} May 27 21:31:08.194158 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:08.194102 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerStarted","Data":"c048c40f0d6fcd09370c16727b3fd43c9815ec7d8eefefa9901c55860ec9cad6"} May 27 21:31:08.219955 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:08.219887 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zvwwb" podStartSLOduration=2.269797516 podStartE2EDuration="3.219869035s" podCreationTimestamp="2026-05-27 21:31:05 +0000 UTC" firstStartedPulling="2026-05-27 21:31:05.957910449 +0000 UTC m=+174.797757398" lastFinishedPulling="2026-05-27 21:31:06.907981941 +0000 UTC m=+175.747828917" observedRunningTime="2026-05-27 21:31:08.218504815 +0000 UTC m=+177.058351788" watchObservedRunningTime="2026-05-27 21:31:08.219869035 +0000 UTC m=+177.059716011" May 27 21:31:08.548993 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:08.548947 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f99d985d8-qclqq"] May 27 21:31:08.552754 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:31:08.552728 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d4df8f_9a42_4c3a_85d6_daf9795f6893.slice/crio-51f70d729d4ba30dc7ba14f931c8674aaec1f7160413a9bdf2ede9b6da831894 WatchSource:0}: Error finding container 51f70d729d4ba30dc7ba14f931c8674aaec1f7160413a9bdf2ede9b6da831894: Status 404 returned error can't find the container with id 51f70d729d4ba30dc7ba14f931c8674aaec1f7160413a9bdf2ede9b6da831894 May 27 21:31:09.198265 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:09.198233 2549 generic.go:358] "Generic (PLEG): container finished" podID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerID="ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3" exitCode=0 May 27 21:31:09.198738 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:09.198298 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerDied","Data":"ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3"} May 27 21:31:09.199434 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:09.199400 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" event={"ID":"a8d4df8f-9a42-4c3a-85d6-daf9795f6893","Type":"ContainerStarted","Data":"51f70d729d4ba30dc7ba14f931c8674aaec1f7160413a9bdf2ede9b6da831894"} May 27 21:31:09.201368 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:09.201323 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" event={"ID":"719cb89e-4691-4b88-8a84-634c91319ced","Type":"ContainerStarted","Data":"b41eb5ef7a844d6c0c54526ffd4c397bea0540cca177104a227fc266f028daf5"} May 27 21:31:09.265051 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:09.264993 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-bg2wm" podStartSLOduration=2.875119117 podStartE2EDuration="4.264977141s" podCreationTimestamp="2026-05-27 21:31:05 +0000 UTC" firstStartedPulling="2026-05-27 21:31:07.019404827 +0000 UTC m=+175.859251780" lastFinishedPulling="2026-05-27 21:31:08.409262836 +0000 UTC m=+177.249109804" observedRunningTime="2026-05-27 21:31:09.264267681 +0000 UTC m=+178.104114693" watchObservedRunningTime="2026-05-27 21:31:09.264977141 +0000 UTC m=+178.104824113" May 27 21:31:10.133553 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.133494 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d7769bd5b-t27vf"] May 27 21:31:10.137610 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.137582 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.141470 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.141151 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ekrts6hbb2bnd\"" May 27 21:31:10.141470 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.141179 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 27 21:31:10.141470 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.141276 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 27 21:31:10.141470 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.141155 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n6cqk\"" May 27 21:31:10.141470 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.141155 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 27 21:31:10.142428 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.142317 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 27 21:31:10.153540 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.153506 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7769bd5b-t27vf"] May 27 21:31:10.266109 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.266074 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-secret-metrics-server-client-certs\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.266604 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.266204 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-secret-metrics-server-tls\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.266604 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.266255 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37d9957a-f8ac-482f-a4dc-663ff79e2a73-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.266604 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.266325 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-client-ca-bundle\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.266604 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.266402 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/37d9957a-f8ac-482f-a4dc-663ff79e2a73-audit-log\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.266604 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.266447 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/37d9957a-f8ac-482f-a4dc-663ff79e2a73-metrics-server-audit-profiles\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.266604 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.266472 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgxrt\" (UniqueName: \"kubernetes.io/projected/37d9957a-f8ac-482f-a4dc-663ff79e2a73-kube-api-access-qgxrt\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.367794 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.367751 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-secret-metrics-server-tls\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.367794 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.367796 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37d9957a-f8ac-482f-a4dc-663ff79e2a73-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.368024 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.367832 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-client-ca-bundle\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.368024 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.367864 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/37d9957a-f8ac-482f-a4dc-663ff79e2a73-audit-log\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.368024 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.368004 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/37d9957a-f8ac-482f-a4dc-663ff79e2a73-metrics-server-audit-profiles\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.368173 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.368048 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgxrt\" (UniqueName: \"kubernetes.io/projected/37d9957a-f8ac-482f-a4dc-663ff79e2a73-kube-api-access-qgxrt\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.368173 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.368132 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-secret-metrics-server-client-certs\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.368295 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.368270 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/37d9957a-f8ac-482f-a4dc-663ff79e2a73-audit-log\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.368849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.368813 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37d9957a-f8ac-482f-a4dc-663ff79e2a73-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.369134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.369110 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/37d9957a-f8ac-482f-a4dc-663ff79e2a73-metrics-server-audit-profiles\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.371026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.370963 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-client-ca-bundle\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.371026 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.370964 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-secret-metrics-server-tls\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.371160 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.371086 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/37d9957a-f8ac-482f-a4dc-663ff79e2a73-secret-metrics-server-client-certs\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.381788 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.381758 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgxrt\" (UniqueName: \"kubernetes.io/projected/37d9957a-f8ac-482f-a4dc-663ff79e2a73-kube-api-access-qgxrt\") pod \"metrics-server-7d7769bd5b-t27vf\" (UID: \"37d9957a-f8ac-482f-a4dc-663ff79e2a73\") " pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:10.450896 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:10.450796 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:11.131821 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.131792 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7769bd5b-t27vf"] May 27 21:31:11.135236 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:31:11.135204 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d9957a_f8ac_482f_a4dc_663ff79e2a73.slice/crio-75d716ff32829022b0d97dce78864b6d0e5bc9437e80e8d041916321e33bae70 WatchSource:0}: Error finding container 75d716ff32829022b0d97dce78864b6d0e5bc9437e80e8d041916321e33bae70: Status 404 returned error can't find the container with id 75d716ff32829022b0d97dce78864b6d0e5bc9437e80e8d041916321e33bae70 May 27 21:31:11.213324 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.213282 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerStarted","Data":"4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2"} May 27 21:31:11.213512 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.213327 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerStarted","Data":"8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88"} May 27 21:31:11.213512 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.213361 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerStarted","Data":"658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9"} May 27 21:31:11.216274 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.216232 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" event={"ID":"a8d4df8f-9a42-4c3a-85d6-daf9795f6893","Type":"ContainerStarted","Data":"99202136cc651943f75b769a912ab43be4afc022940642fbcd93af55f1524448"} May 27 21:31:11.216274 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.216272 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" event={"ID":"a8d4df8f-9a42-4c3a-85d6-daf9795f6893","Type":"ContainerStarted","Data":"306cb47d046d5bb6e4fda9aea1afd3cdb642b7b6fdc8fdf07011dc9d718ff14f"} May 27 21:31:11.216486 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.216285 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" event={"ID":"a8d4df8f-9a42-4c3a-85d6-daf9795f6893","Type":"ContainerStarted","Data":"8fc2edc72a012bed14c7838396637bf1c097f7dbe1a000fe1ea9ef7425f1479d"} May 27 21:31:11.217694 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.217656 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" event={"ID":"37d9957a-f8ac-482f-a4dc-663ff79e2a73","Type":"ContainerStarted","Data":"75d716ff32829022b0d97dce78864b6d0e5bc9437e80e8d041916321e33bae70"} May 27 21:31:11.951934 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.951898 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:31:11.956794 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.956766 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:11.962424 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.962394 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 21:31:11.965018 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.964991 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 21:31:11.967159 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.967139 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 21:31:11.967703 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.967684 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 21:31:11.969960 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.968684 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 21:31:11.969960 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.969403 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 21:31:11.972527 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.970193 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6qmgle9cvl8qi\"" May 27 21:31:11.972778 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.972707 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 21:31:11.972852 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.972832 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 21:31:11.973014 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.972898 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 21:31:11.973014 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.972901 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d4df2\"" May 27 21:31:11.973583 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.973557 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 21:31:11.975943 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.975924 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 21:31:11.978188 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.978163 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 21:31:11.984215 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:11.984192 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:31:12.081171 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081118 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081171 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081205 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081250 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081281 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081319 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081360 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4764\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-kube-api-access-q4764\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081392 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081423 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081817 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081482 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081817 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081512 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081817 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081559 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081817 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081603 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081817 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081660 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081817 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081721 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.081817 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081777 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.082180 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081834 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.082180 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.081858 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183228 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183194 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183413 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183259 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183413 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183291 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183413 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183352 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183413 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183381 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183413 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183411 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183435 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183469 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183497 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183532 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183557 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183583 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183619 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.183667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183646 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4764\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-kube-api-access-q4764\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.184053 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183668 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.184053 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183678 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.184053 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183720 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.184053 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183769 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.184053 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183802 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.184053 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.183972 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.184845 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.184751 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.185467 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.185440 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.186396 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.186353 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config-out\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.187312 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.186842 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.187785 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.187739 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.188451 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.188407 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.188949 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.188922 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.189325 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.189297 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.189699 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.189654 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.190006 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.189960 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.190138 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.190110 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-web-config\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.190625 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.190603 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.190957 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.190936 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.191390 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.191370 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.191690 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.191672 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.200945 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.200924 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4764\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-kube-api-access-q4764\") pod \"prometheus-k8s-0\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.224248 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.224200 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerStarted","Data":"8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a"} May 27 21:31:12.224418 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.224252 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerStarted","Data":"af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba"} May 27 21:31:12.272626 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.272566 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:12.734812 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:12.734753 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:31:12.737844 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:31:12.737815 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c297be_0862_4bf8_b916_dc8c36d9c19e.slice/crio-a0052bf2478a0893002befb96b8966f4a1e1a59460bf095ddc49e9045f82d1fe WatchSource:0}: Error finding container a0052bf2478a0893002befb96b8966f4a1e1a59460bf095ddc49e9045f82d1fe: Status 404 returned error can't find the container with id a0052bf2478a0893002befb96b8966f4a1e1a59460bf095ddc49e9045f82d1fe May 27 21:31:13.230742 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.230699 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerStarted","Data":"37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e"} May 27 21:31:13.233421 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.233391 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" event={"ID":"a8d4df8f-9a42-4c3a-85d6-daf9795f6893","Type":"ContainerStarted","Data":"e436848868bf2ded5abc7ac8c0cd91ac287d3f5187c3872c8b34d00010a5da5e"} May 27 21:31:13.233421 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.233429 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" event={"ID":"a8d4df8f-9a42-4c3a-85d6-daf9795f6893","Type":"ContainerStarted","Data":"a3f0657d925657bd0cdafab2c9fb9b50dd9499a047d4c956ddec9b600ac35ac3"} May 27 21:31:13.233615 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.233444 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" event={"ID":"a8d4df8f-9a42-4c3a-85d6-daf9795f6893","Type":"ContainerStarted","Data":"da3bf11139ca416d58f0f4854310c341b01f85fb0ac1d0d261618ec8bad482b2"} May 27 21:31:13.233615 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.233555 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:13.234769 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.234745 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" event={"ID":"37d9957a-f8ac-482f-a4dc-663ff79e2a73","Type":"ContainerStarted","Data":"1c483707ac7a7121a055285d6609782c04fb4ea17ccfc4bdf36b470ca284b280"} May 27 21:31:13.236128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.236106 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" exitCode=0 May 27 21:31:13.236240 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.236165 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerDied","Data":"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8"} May 27 21:31:13.236240 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.236183 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerStarted","Data":"a0052bf2478a0893002befb96b8966f4a1e1a59460bf095ddc49e9045f82d1fe"} May 27 21:31:13.259175 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.259125 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.34096981 podStartE2EDuration="7.259109981s" podCreationTimestamp="2026-05-27 21:31:06 +0000 UTC" firstStartedPulling="2026-05-27 21:31:07.21842767 +0000 UTC m=+176.058274624" lastFinishedPulling="2026-05-27 21:31:12.136567842 +0000 UTC m=+180.976414795" observedRunningTime="2026-05-27 21:31:13.257121823 +0000 UTC m=+182.096968795" watchObservedRunningTime="2026-05-27 21:31:13.259109981 +0000 UTC m=+182.098956952" May 27 21:31:13.282440 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.282390 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" podStartSLOduration=2.702284944 podStartE2EDuration="6.282373566s" podCreationTimestamp="2026-05-27 21:31:07 +0000 UTC" firstStartedPulling="2026-05-27 21:31:08.554702194 +0000 UTC m=+177.394549144" lastFinishedPulling="2026-05-27 21:31:12.134790794 +0000 UTC m=+180.974637766" observedRunningTime="2026-05-27 21:31:13.280604276 +0000 UTC m=+182.120451245" watchObservedRunningTime="2026-05-27 21:31:13.282373566 +0000 UTC m=+182.122220548" May 27 21:31:13.336091 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:13.336034 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" podStartSLOduration=1.843517262 podStartE2EDuration="3.336017996s" podCreationTimestamp="2026-05-27 21:31:10 +0000 UTC" firstStartedPulling="2026-05-27 21:31:11.138013219 +0000 UTC m=+179.977860173" lastFinishedPulling="2026-05-27 21:31:12.630513947 +0000 UTC m=+181.470360907" observedRunningTime="2026-05-27 21:31:13.335261395 +0000 UTC m=+182.175108368" watchObservedRunningTime="2026-05-27 21:31:13.336017996 +0000 UTC m=+182.175864967" May 27 21:31:16.248709 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:16.248611 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerStarted","Data":"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f"} May 27 21:31:16.248709 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:16.248653 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerStarted","Data":"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009"} May 27 21:31:16.248709 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:16.248666 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerStarted","Data":"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921"} May 27 21:31:16.248709 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:16.248678 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerStarted","Data":"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727"} May 27 21:31:16.248709 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:16.248689 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerStarted","Data":"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed"} May 27 21:31:16.248709 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:16.248701 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerStarted","Data":"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d"} May 27 21:31:16.277848 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:16.277793 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7714401459999998 podStartE2EDuration="5.277774869s" podCreationTimestamp="2026-05-27 21:31:11 +0000 UTC" firstStartedPulling="2026-05-27 21:31:13.237230256 +0000 UTC m=+182.077077211" lastFinishedPulling="2026-05-27 21:31:15.743564984 +0000 UTC m=+184.583411934" observedRunningTime="2026-05-27 21:31:16.27685447 +0000 UTC m=+185.116701499" watchObservedRunningTime="2026-05-27 21:31:16.277774869 +0000 UTC m=+185.117621842" May 27 21:31:17.273603 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:17.273566 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:31:19.246556 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:19.246525 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f99d985d8-qclqq" May 27 21:31:20.147240 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.147172 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" podUID="b2261dcc-f571-48c7-8652-6d0ebb9f48b7" containerName="registry" containerID="cri-o://6e374292ba8f6e44ddb335f3409edfbc2a40e3565701dbc0b73389caf8e52104" gracePeriod=30 May 27 21:31:20.262393 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.262357 2549 generic.go:358] "Generic (PLEG): container finished" podID="b2261dcc-f571-48c7-8652-6d0ebb9f48b7" containerID="6e374292ba8f6e44ddb335f3409edfbc2a40e3565701dbc0b73389caf8e52104" exitCode=0 May 27 21:31:20.262393 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.262371 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" event={"ID":"b2261dcc-f571-48c7-8652-6d0ebb9f48b7","Type":"ContainerDied","Data":"6e374292ba8f6e44ddb335f3409edfbc2a40e3565701dbc0b73389caf8e52104"} May 27 21:31:20.398974 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.398903 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:31:20.567467 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.567428 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-ca-trust-extracted\") pod \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " May 27 21:31:20.567643 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.567477 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") pod \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " May 27 21:31:20.567643 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.567524 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-image-registry-private-configuration\") pod \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " May 27 21:31:20.567643 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.567551 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-trusted-ca\") pod \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " May 27 21:31:20.567643 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.567593 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-certificates\") pod \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " May 27 21:31:20.567643 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.567633 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmt57\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-kube-api-access-cmt57\") pod \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " May 27 21:31:20.567886 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.567657 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-installation-pull-secrets\") pod \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " May 27 21:31:20.567886 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.567694 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-bound-sa-token\") pod \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\" (UID: \"b2261dcc-f571-48c7-8652-6d0ebb9f48b7\") " May 27 21:31:20.568393 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.568359 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b2261dcc-f571-48c7-8652-6d0ebb9f48b7" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:31:20.568624 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.568601 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b2261dcc-f571-48c7-8652-6d0ebb9f48b7" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:31:20.570257 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.570218 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b2261dcc-f571-48c7-8652-6d0ebb9f48b7" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:31:20.570257 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.570242 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b2261dcc-f571-48c7-8652-6d0ebb9f48b7" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:31:20.570257 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.570251 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b2261dcc-f571-48c7-8652-6d0ebb9f48b7" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:31:20.570495 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.570231 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-kube-api-access-cmt57" (OuterVolumeSpecName: "kube-api-access-cmt57") pod "b2261dcc-f571-48c7-8652-6d0ebb9f48b7" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7"). InnerVolumeSpecName "kube-api-access-cmt57". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:31:20.570495 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.570324 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b2261dcc-f571-48c7-8652-6d0ebb9f48b7" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:31:20.579097 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.579067 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b2261dcc-f571-48c7-8652-6d0ebb9f48b7" (UID: "b2261dcc-f571-48c7-8652-6d0ebb9f48b7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:31:20.668753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.668649 2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-ca-trust-extracted\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:31:20.668753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.668697 2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:31:20.668753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.668708 2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-image-registry-private-configuration\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:31:20.668753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.668717 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-trusted-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:31:20.668753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.668726 2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-registry-certificates\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:31:20.668753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.668736 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmt57\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-kube-api-access-cmt57\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:31:20.668753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.668744 2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-installation-pull-secrets\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:31:20.668753 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:20.668754 2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2261dcc-f571-48c7-8652-6d0ebb9f48b7-bound-sa-token\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:31:21.266716 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:21.266687 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" May 27 21:31:21.267099 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:21.266680 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db84bfd77-5nzzn" event={"ID":"b2261dcc-f571-48c7-8652-6d0ebb9f48b7","Type":"ContainerDied","Data":"75e011b5e55531e90d18adb0f7e341100bb28d2272390e47f9a5d39bd6138ff5"} May 27 21:31:21.267099 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:21.266822 2549 scope.go:117] "RemoveContainer" containerID="6e374292ba8f6e44ddb335f3409edfbc2a40e3565701dbc0b73389caf8e52104" May 27 21:31:21.292469 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:21.292437 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db84bfd77-5nzzn"] May 27 21:31:21.296402 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:21.296377 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6db84bfd77-5nzzn"] May 27 21:31:21.713483 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:21.713450 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2261dcc-f571-48c7-8652-6d0ebb9f48b7" path="/var/lib/kubelet/pods/b2261dcc-f571-48c7-8652-6d0ebb9f48b7/volumes" May 27 21:31:30.296981 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:30.296946 2549 generic.go:358] "Generic (PLEG): container finished" podID="fd2d615e-5d8e-4e73-9e11-62024901986b" containerID="d61a01c3b1df6d87e36832dc79f4f0fdd6e098b08cc1d56d67ef750dbcc0a87c" exitCode=0 May 27 21:31:30.297422 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:30.297028 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" event={"ID":"fd2d615e-5d8e-4e73-9e11-62024901986b","Type":"ContainerDied","Data":"d61a01c3b1df6d87e36832dc79f4f0fdd6e098b08cc1d56d67ef750dbcc0a87c"} May 27 21:31:30.297467 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:30.297429 2549 scope.go:117] "RemoveContainer" containerID="d61a01c3b1df6d87e36832dc79f4f0fdd6e098b08cc1d56d67ef750dbcc0a87c" May 27 21:31:30.451272 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:30.451236 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:30.451455 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:30.451288 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:31.301525 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:31.301491 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-c5g7l" event={"ID":"fd2d615e-5d8e-4e73-9e11-62024901986b","Type":"ContainerStarted","Data":"7292add2895398ab3bd63764552a9ffb523a675af5f6a81bdbe8de6b8fc9b105"} May 27 21:31:31.966183 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:31.966144 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4fa26a64-11c5-4795-9e50-46da84fd143e/init-config-reloader/0.log" May 27 21:31:32.154455 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:32.154428 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4fa26a64-11c5-4795-9e50-46da84fd143e/alertmanager/0.log" May 27 21:31:32.355395 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:32.355353 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4fa26a64-11c5-4795-9e50-46da84fd143e/config-reloader/0.log" May 27 21:31:32.554633 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:32.554608 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4fa26a64-11c5-4795-9e50-46da84fd143e/kube-rbac-proxy-web/0.log" May 27 21:31:32.754592 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:32.754507 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4fa26a64-11c5-4795-9e50-46da84fd143e/kube-rbac-proxy/0.log" May 27 21:31:32.955397 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:32.955363 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4fa26a64-11c5-4795-9e50-46da84fd143e/kube-rbac-proxy-metric/0.log" May 27 21:31:33.154688 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:33.154661 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4fa26a64-11c5-4795-9e50-46da84fd143e/prom-label-proxy/0.log" May 27 21:31:33.356569 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:33.356540 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-5t5mz_a238b30e-4eb3-4df6-968e-3718aba71c96/cluster-monitoring-operator/0.log" May 27 21:31:34.155236 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:34.155193 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d7769bd5b-t27vf_37d9957a-f8ac-482f-a4dc-663ff79e2a73/metrics-server/0.log" May 27 21:31:35.753745 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:35.753720 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvwwb_396390f7-8bf2-4884-95c6-ab68386f61f6/init-textfile/0.log" May 27 21:31:35.956075 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:35.956037 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvwwb_396390f7-8bf2-4884-95c6-ab68386f61f6/node-exporter/0.log" May 27 21:31:36.153856 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:36.153827 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvwwb_396390f7-8bf2-4884-95c6-ab68386f61f6/kube-rbac-proxy/0.log" May 27 21:31:36.353989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:36.353956 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bg2wm_719cb89e-4691-4b88-8a84-634c91319ced/kube-rbac-proxy-main/0.log" May 27 21:31:36.554763 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:36.554685 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bg2wm_719cb89e-4691-4b88-8a84-634c91319ced/kube-rbac-proxy-self/0.log" May 27 21:31:36.753867 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:36.753836 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bg2wm_719cb89e-4691-4b88-8a84-634c91319ced/openshift-state-metrics/0.log" May 27 21:31:36.954162 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:36.954135 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6c297be-0862-4bf8-b916-dc8c36d9c19e/init-config-reloader/0.log" May 27 21:31:37.155654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:37.155626 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6c297be-0862-4bf8-b916-dc8c36d9c19e/prometheus/0.log" May 27 21:31:37.354674 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:37.354642 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6c297be-0862-4bf8-b916-dc8c36d9c19e/config-reloader/0.log" May 27 21:31:37.554714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:37.554676 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6c297be-0862-4bf8-b916-dc8c36d9c19e/thanos-sidecar/0.log" May 27 21:31:37.754823 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:37.754737 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6c297be-0862-4bf8-b916-dc8c36d9c19e/kube-rbac-proxy-web/0.log" May 27 21:31:37.954268 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:37.954232 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6c297be-0862-4bf8-b916-dc8c36d9c19e/kube-rbac-proxy/0.log" May 27 21:31:38.153490 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:38.153457 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a6c297be-0862-4bf8-b916-dc8c36d9c19e/kube-rbac-proxy-thanos/0.log" May 27 21:31:38.954009 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:38.953980 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/thanos-query/0.log" May 27 21:31:39.155278 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:39.155132 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/kube-rbac-proxy-web/0.log" May 27 21:31:39.357686 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:39.357649 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/kube-rbac-proxy/0.log" May 27 21:31:39.553932 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:39.553907 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/prom-label-proxy/0.log" May 27 21:31:39.754493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:39.754421 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/kube-rbac-proxy-rules/0.log" May 27 21:31:39.953975 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:39.953932 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/kube-rbac-proxy-metrics/0.log" May 27 21:31:40.329847 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:40.329815 2549 generic.go:358] "Generic (PLEG): container finished" podID="5bbcb93e-21d4-434c-a504-984d55db2c6b" containerID="bd0e09856566277e520c6a7e87f4feca6ad2eb4a76806a4210cb381635992384" exitCode=0 May 27 21:31:40.330375 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:40.329895 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" event={"ID":"5bbcb93e-21d4-434c-a504-984d55db2c6b","Type":"ContainerDied","Data":"bd0e09856566277e520c6a7e87f4feca6ad2eb4a76806a4210cb381635992384"} May 27 21:31:40.330375 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:40.330328 2549 scope.go:117] "RemoveContainer" containerID="bd0e09856566277e520c6a7e87f4feca6ad2eb4a76806a4210cb381635992384" May 27 21:31:41.333931 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:41.333896 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-4skgg" event={"ID":"5bbcb93e-21d4-434c-a504-984d55db2c6b","Type":"ContainerStarted","Data":"542eb9ae95812da7b3f720397a0d13eb988231d68b72c2bb205c9929084bfd49"} May 27 21:31:41.753970 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:41.753883 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdqdc_ac73cbfc-b095-4c18-9076-f2f8bde69750/serve-healthcheck-canary/0.log" May 27 21:31:50.456367 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:50.456319 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:31:50.460284 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:31:50.460258 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d7769bd5b-t27vf" May 27 21:32:12.273606 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:12.273562 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:12.293980 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:12.293953 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:12.447787 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:12.447758 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:23.616503 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:23.616458 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:32:23.618814 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:23.618784 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71222d0a-e311-4912-bc4d-d822abd1c9af-metrics-certs\") pod \"network-metrics-daemon-l6qxd\" (UID: \"71222d0a-e311-4912-bc4d-d822abd1c9af\") " pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:32:23.915219 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:23.915133 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdzf7\"" May 27 21:32:23.922958 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:23.922931 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l6qxd" May 27 21:32:24.055625 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:24.055588 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l6qxd"] May 27 21:32:24.058610 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:32:24.058577 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71222d0a_e311_4912_bc4d_d822abd1c9af.slice/crio-28a5a061fcd9df5dbf3c89950748719b9cd4f6d8e984114526d08788c88efa41 WatchSource:0}: Error finding container 28a5a061fcd9df5dbf3c89950748719b9cd4f6d8e984114526d08788c88efa41: Status 404 returned error can't find the container with id 28a5a061fcd9df5dbf3c89950748719b9cd4f6d8e984114526d08788c88efa41 May 27 21:32:24.465085 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:24.465040 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6qxd" event={"ID":"71222d0a-e311-4912-bc4d-d822abd1c9af","Type":"ContainerStarted","Data":"28a5a061fcd9df5dbf3c89950748719b9cd4f6d8e984114526d08788c88efa41"} May 27 21:32:25.469815 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:25.469719 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6qxd" event={"ID":"71222d0a-e311-4912-bc4d-d822abd1c9af","Type":"ContainerStarted","Data":"a3e84e7e2e776600a2acf0a26547adb0dc42d4c05c2822b9c0c80985efa2cbad"} May 27 21:32:25.469815 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:25.469765 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l6qxd" event={"ID":"71222d0a-e311-4912-bc4d-d822abd1c9af","Type":"ContainerStarted","Data":"9e90de336950717e219911c9d4f8e120c0aa1e508e43cd6b943a77ebc881be16"} May 27 21:32:25.491241 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:25.491168 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l6qxd" podStartSLOduration=253.44668351 podStartE2EDuration="4m14.491149485s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:32:24.060764074 +0000 UTC m=+252.900611023" lastFinishedPulling="2026-05-27 21:32:25.105230045 +0000 UTC m=+253.945076998" observedRunningTime="2026-05-27 21:32:25.488727389 +0000 UTC m=+254.328574361" watchObservedRunningTime="2026-05-27 21:32:25.491149485 +0000 UTC m=+254.330996460" May 27 21:32:26.105590 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:26.105548 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:32:26.473237 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:26.473139 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy-metric" containerID="cri-o://8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a" gracePeriod=120 May 27 21:32:26.473237 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:26.473139 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="alertmanager" containerID="cri-o://658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9" gracePeriod=120 May 27 21:32:26.473237 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:26.473171 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy-web" containerID="cri-o://4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2" gracePeriod=120 May 27 21:32:26.473237 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:26.473201 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="prom-label-proxy" containerID="cri-o://37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e" gracePeriod=120 May 27 21:32:26.473801 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:26.473221 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="config-reloader" containerID="cri-o://8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88" gracePeriod=120 May 27 21:32:26.473801 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:26.473242 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy" containerID="cri-o://af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba" gracePeriod=120 May 27 21:32:27.479149 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479115 2549 generic.go:358] "Generic (PLEG): container finished" podID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerID="37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e" exitCode=0 May 27 21:32:27.479149 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479142 2549 generic.go:358] "Generic (PLEG): container finished" podID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerID="8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a" exitCode=0 May 27 21:32:27.479149 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479149 2549 generic.go:358] "Generic (PLEG): container finished" podID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerID="af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba" exitCode=0 May 27 21:32:27.479149 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479155 2549 generic.go:358] "Generic (PLEG): container finished" podID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerID="8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88" exitCode=0 May 27 21:32:27.479149 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479160 2549 generic.go:358] "Generic (PLEG): container finished" podID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerID="658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9" exitCode=0 May 27 21:32:27.479667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479190 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerDied","Data":"37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e"} May 27 21:32:27.479667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479225 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerDied","Data":"8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a"} May 27 21:32:27.479667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479235 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerDied","Data":"af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba"} May 27 21:32:27.479667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479244 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerDied","Data":"8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88"} May 27 21:32:27.479667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.479255 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerDied","Data":"658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9"} May 27 21:32:27.714064 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.714038 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:27.848319 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848285 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848319 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848323 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-main-tls\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848369 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-trusted-ca-bundle\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848399 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljcxq\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-kube-api-access-ljcxq\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848428 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-config-volume\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848471 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-web-config\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848501 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-cluster-tls-config\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848531 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-config-out\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848569 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848606 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-main-db\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848659 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-tls-assets\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848693 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-metrics-client-ca\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.848849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848741 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-web\") pod \"4fa26a64-11c5-4795-9e50-46da84fd143e\" (UID: \"4fa26a64-11c5-4795-9e50-46da84fd143e\") " May 27 21:32:27.849091 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.848990 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:32:27.849796 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.849631 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:32:27.849796 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.849759 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:32:27.851417 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.851319 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-kube-api-access-ljcxq" (OuterVolumeSpecName: "kube-api-access-ljcxq") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "kube-api-access-ljcxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:32:27.852851 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.852799 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:27.852939 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.852852 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:27.852939 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.852876 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-config-volume" (OuterVolumeSpecName: "config-volume") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:27.853047 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.852963 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:27.853102 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.853067 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:32:27.853102 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.853069 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-config-out" (OuterVolumeSpecName: "config-out") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:32:27.853189 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.853146 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:27.855930 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.855907 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:27.862651 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.862621 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-web-config" (OuterVolumeSpecName: "web-config") pod "4fa26a64-11c5-4795-9e50-46da84fd143e" (UID: "4fa26a64-11c5-4795-9e50-46da84fd143e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:27.949436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949400 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-tls-assets\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949432 2549 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-metrics-client-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949436 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949444 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949454 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949465 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-main-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949473 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949482 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljcxq\" (UniqueName: \"kubernetes.io/projected/4fa26a64-11c5-4795-9e50-46da84fd143e-kube-api-access-ljcxq\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949490 2549 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-config-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949500 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-web-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949508 2549 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-cluster-tls-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949516 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-config-out\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949525 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fa26a64-11c5-4795-9e50-46da84fd143e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:27.949675 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:27.949533 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a64-11c5-4795-9e50-46da84fd143e-alertmanager-main-db\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:28.488328 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.488295 2549 generic.go:358] "Generic (PLEG): container finished" podID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerID="4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2" exitCode=0 May 27 21:32:28.488769 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.488382 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerDied","Data":"4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2"} May 27 21:32:28.488769 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.488424 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4fa26a64-11c5-4795-9e50-46da84fd143e","Type":"ContainerDied","Data":"c048c40f0d6fcd09370c16727b3fd43c9815ec7d8eefefa9901c55860ec9cad6"} May 27 21:32:28.488769 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.488432 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.488769 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.488442 2549 scope.go:117] "RemoveContainer" containerID="37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e" May 27 21:32:28.496962 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.496941 2549 scope.go:117] "RemoveContainer" containerID="8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a" May 27 21:32:28.504031 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.504012 2549 scope.go:117] "RemoveContainer" containerID="af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba" May 27 21:32:28.510905 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.510887 2549 scope.go:117] "RemoveContainer" containerID="4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2" May 27 21:32:28.519594 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.519569 2549 scope.go:117] "RemoveContainer" containerID="8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88" May 27 21:32:28.522236 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:28.522209 2549 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa26a64_11c5_4795_9e50_46da84fd143e.slice\": RecentStats: unable to find data in memory cache]" May 27 21:32:28.524437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.524415 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:32:28.528716 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.528692 2549 scope.go:117] "RemoveContainer" containerID="658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9" May 27 21:32:28.535880 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.535863 2549 scope.go:117] "RemoveContainer" containerID="ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3" May 27 21:32:28.543086 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.543065 2549 scope.go:117] "RemoveContainer" containerID="37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e" May 27 21:32:28.543351 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:28.543318 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e\": container with ID starting with 37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e not found: ID does not exist" containerID="37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e" May 27 21:32:28.543423 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.543360 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e"} err="failed to get container status \"37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e\": rpc error: code = NotFound desc = could not find container \"37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e\": container with ID starting with 37805077450bcbde7b65cab6e52dfae443f3526bfd428ab5d807c847751b900e not found: ID does not exist" May 27 21:32:28.543423 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.543414 2549 scope.go:117] "RemoveContainer" containerID="8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a" May 27 21:32:28.543651 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:28.543635 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a\": container with ID starting with 8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a not found: ID does not exist" containerID="8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a" May 27 21:32:28.543690 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.543657 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a"} err="failed to get container status \"8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a\": rpc error: code = NotFound desc = could not find container \"8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a\": container with ID starting with 8304cb112dbffcba72a4f0dae706fd9b83668912cd787c51ecd12263c2b7590a not found: ID does not exist" May 27 21:32:28.543690 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.543672 2549 scope.go:117] "RemoveContainer" containerID="af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba" May 27 21:32:28.543890 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:28.543870 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba\": container with ID starting with af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba not found: ID does not exist" containerID="af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba" May 27 21:32:28.543937 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.543897 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba"} err="failed to get container status \"af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba\": rpc error: code = NotFound desc = could not find container \"af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba\": container with ID starting with af9dbb9e7a4762b71bd432edd36b58d411ac35f1805c8bfde054c354633aaeba not found: ID does not exist" May 27 21:32:28.543937 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.543917 2549 scope.go:117] "RemoveContainer" containerID="4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2" May 27 21:32:28.544151 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:28.544128 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2\": container with ID starting with 4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2 not found: ID does not exist" containerID="4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2" May 27 21:32:28.544186 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.544161 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2"} err="failed to get container status \"4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2\": rpc error: code = NotFound desc = could not find container \"4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2\": container with ID starting with 4081ffb57c21e3f7dc25727283082a01e8ff87d2d579193cf8742598f5ef40b2 not found: ID does not exist" May 27 21:32:28.544222 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.544184 2549 scope.go:117] "RemoveContainer" containerID="8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88" May 27 21:32:28.544451 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:28.544428 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88\": container with ID starting with 8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88 not found: ID does not exist" containerID="8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88" May 27 21:32:28.544531 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.544454 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88"} err="failed to get container status \"8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88\": rpc error: code = NotFound desc = could not find container \"8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88\": container with ID starting with 8c34ce4d5562a60328e920f2ccb66a2f9126934460b5419965dc1ffc2827de88 not found: ID does not exist" May 27 21:32:28.544531 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.544471 2549 scope.go:117] "RemoveContainer" containerID="658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9" May 27 21:32:28.544709 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:28.544686 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9\": container with ID starting with 658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9 not found: ID does not exist" containerID="658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9" May 27 21:32:28.544771 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.544718 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9"} err="failed to get container status \"658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9\": rpc error: code = NotFound desc = could not find container \"658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9\": container with ID starting with 658af03f351ab767ba6d950a91a4299a1bf776b32e09f7e1c5ade9a72dacfcb9 not found: ID does not exist" May 27 21:32:28.544771 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.544741 2549 scope.go:117] "RemoveContainer" containerID="ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3" May 27 21:32:28.544970 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:28.544952 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3\": container with ID starting with ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3 not found: ID does not exist" containerID="ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3" May 27 21:32:28.545023 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.544979 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3"} err="failed to get container status \"ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3\": rpc error: code = NotFound desc = could not find container \"ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3\": container with ID starting with ba3bf64465f8143d7c88db3cbcec25b5bd161149ad814354a3e1e22e7877b5a3 not found: ID does not exist" May 27 21:32:28.546664 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.546644 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:32:28.613685 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613646 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:32:28.613950 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613938 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy" May 27 21:32:28.613989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613951 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy" May 27 21:32:28.613989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613964 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="prom-label-proxy" May 27 21:32:28.613989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613969 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="prom-label-proxy" May 27 21:32:28.613989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613980 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="alertmanager" May 27 21:32:28.613989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613985 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="alertmanager" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613992 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy-metric" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.613997 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy-metric" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614009 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy-web" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614015 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy-web" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614023 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="init-config-reloader" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614028 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="init-config-reloader" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614037 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="config-reloader" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614042 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="config-reloader" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614048 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2261dcc-f571-48c7-8652-6d0ebb9f48b7" containerName="registry" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614054 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2261dcc-f571-48c7-8652-6d0ebb9f48b7" containerName="registry" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614098 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2261dcc-f571-48c7-8652-6d0ebb9f48b7" containerName="registry" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614106 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy-web" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614115 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy-metric" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614123 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="alertmanager" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614129 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="prom-label-proxy" May 27 21:32:28.614129 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614134 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="config-reloader" May 27 21:32:28.614768 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.614140 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" containerName="kube-rbac-proxy" May 27 21:32:28.619383 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.619359 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.625975 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.625953 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 27 21:32:28.626088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.625954 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 27 21:32:28.629113 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.629092 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 27 21:32:28.629221 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.629182 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 27 21:32:28.629690 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.629673 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 27 21:32:28.629892 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.629877 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 27 21:32:28.630185 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.630172 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 27 21:32:28.631856 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.631841 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 27 21:32:28.632008 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.631994 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4qvhf\"" May 27 21:32:28.641691 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.641661 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 27 21:32:28.654101 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654070 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/711b343f-a15e-44be-b1bb-2366861c2833-config-out\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654226 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654108 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654226 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654128 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-web-config\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654226 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654153 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/711b343f-a15e-44be-b1bb-2366861c2833-tls-assets\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654226 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654206 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654451 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654226 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711b343f-a15e-44be-b1bb-2366861c2833-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654451 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654247 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/711b343f-a15e-44be-b1bb-2366861c2833-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654451 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654317 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw8kb\" (UniqueName: \"kubernetes.io/projected/711b343f-a15e-44be-b1bb-2366861c2833-kube-api-access-rw8kb\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654451 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654387 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654569 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654569 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654480 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711b343f-a15e-44be-b1bb-2366861c2833-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654569 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654552 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-config-volume\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.654651 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.654636 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.668084 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.668051 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:32:28.755057 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.754962 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755057 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.754997 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711b343f-a15e-44be-b1bb-2366861c2833-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755057 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755019 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-config-volume\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755057 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755049 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755077 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/711b343f-a15e-44be-b1bb-2366861c2833-config-out\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755097 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755116 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-web-config\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755144 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/711b343f-a15e-44be-b1bb-2366861c2833-tls-assets\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755238 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755296 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711b343f-a15e-44be-b1bb-2366861c2833-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755359 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/711b343f-a15e-44be-b1bb-2366861c2833-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755415 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw8kb\" (UniqueName: \"kubernetes.io/projected/711b343f-a15e-44be-b1bb-2366861c2833-kube-api-access-rw8kb\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755444 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.755949 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.755838 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711b343f-a15e-44be-b1bb-2366861c2833-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.756326 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.756298 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/711b343f-a15e-44be-b1bb-2366861c2833-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.757128 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.757100 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/711b343f-a15e-44be-b1bb-2366861c2833-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.758117 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.758087 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/711b343f-a15e-44be-b1bb-2366861c2833-tls-assets\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.758205 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.758186 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-web-config\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.758419 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.758397 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.758872 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.758848 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.758965 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.758854 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.759018 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.758997 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.759304 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.759282 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-config-volume\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.759500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.759483 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/711b343f-a15e-44be-b1bb-2366861c2833-config-out\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.759568 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.759546 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/711b343f-a15e-44be-b1bb-2366861c2833-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.785826 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.785798 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw8kb\" (UniqueName: \"kubernetes.io/projected/711b343f-a15e-44be-b1bb-2366861c2833-kube-api-access-rw8kb\") pod \"alertmanager-main-0\" (UID: \"711b343f-a15e-44be-b1bb-2366861c2833\") " pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:28.928794 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:28.928754 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 27 21:32:29.091541 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:29.091506 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 27 21:32:29.094671 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:32:29.094630 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711b343f_a15e_44be_b1bb_2366861c2833.slice/crio-f1577fa9b1ce724f253892c1ed76461983c360eb5b48802b9410f01fd02d8f92 WatchSource:0}: Error finding container f1577fa9b1ce724f253892c1ed76461983c360eb5b48802b9410f01fd02d8f92: Status 404 returned error can't find the container with id f1577fa9b1ce724f253892c1ed76461983c360eb5b48802b9410f01fd02d8f92 May 27 21:32:29.494011 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:29.493975 2549 generic.go:358] "Generic (PLEG): container finished" podID="711b343f-a15e-44be-b1bb-2366861c2833" containerID="d8177adfac592560e8333e8a89c49e853bc8b86fc7dddd1f917e626575108b7e" exitCode=0 May 27 21:32:29.494506 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:29.494055 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"711b343f-a15e-44be-b1bb-2366861c2833","Type":"ContainerDied","Data":"d8177adfac592560e8333e8a89c49e853bc8b86fc7dddd1f917e626575108b7e"} May 27 21:32:29.494506 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:29.494075 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"711b343f-a15e-44be-b1bb-2366861c2833","Type":"ContainerStarted","Data":"f1577fa9b1ce724f253892c1ed76461983c360eb5b48802b9410f01fd02d8f92"} May 27 21:32:29.714653 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:29.714624 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa26a64-11c5-4795-9e50-46da84fd143e" path="/var/lib/kubelet/pods/4fa26a64-11c5-4795-9e50-46da84fd143e/volumes" May 27 21:32:30.326360 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.326290 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl"] May 27 21:32:30.329772 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.329749 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.333507 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.333480 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 27 21:32:30.333629 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.333564 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wxwb8\"" May 27 21:32:30.333629 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.333575 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 27 21:32:30.333743 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.333625 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 27 21:32:30.333893 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.333877 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 27 21:32:30.335134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.335113 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 27 21:32:30.340593 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.340573 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 27 21:32:30.355286 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.355259 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl"] May 27 21:32:30.366861 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.366836 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-telemeter-client-tls\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.366989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.366866 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcr7c\" (UniqueName: \"kubernetes.io/projected/a0d750b4-b615-43a9-80c8-8c5fb87851da-kube-api-access-wcr7c\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.366989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.366886 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.366989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.366917 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-serving-certs-ca-bundle\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.366989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.366938 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-metrics-client-ca\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.367194 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.367033 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-federate-client-tls\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.367194 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.367096 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.367194 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.367132 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-secret-telemeter-client\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.467849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.467816 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.467849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.467855 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-secret-telemeter-client\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.468103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.467888 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-telemeter-client-tls\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.468103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.467912 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcr7c\" (UniqueName: \"kubernetes.io/projected/a0d750b4-b615-43a9-80c8-8c5fb87851da-kube-api-access-wcr7c\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.468103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.467933 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.468103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.467976 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-serving-certs-ca-bundle\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.468103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.468000 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-metrics-client-ca\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.468103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.468059 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-federate-client-tls\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.468841 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.468815 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-serving-certs-ca-bundle\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.468955 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.468908 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-metrics-client-ca\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.469073 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.469051 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d750b4-b615-43a9-80c8-8c5fb87851da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.470564 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.470540 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.470698 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.470680 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-telemeter-client-tls\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.470889 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.470874 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-federate-client-tls\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.470926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.470904 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0d750b4-b615-43a9-80c8-8c5fb87851da-secret-telemeter-client\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.480890 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.480869 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcr7c\" (UniqueName: \"kubernetes.io/projected/a0d750b4-b615-43a9-80c8-8c5fb87851da-kube-api-access-wcr7c\") pod \"telemeter-client-6f78cbf69b-8n6rl\" (UID: \"a0d750b4-b615-43a9-80c8-8c5fb87851da\") " pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.499775 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.499741 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"711b343f-a15e-44be-b1bb-2366861c2833","Type":"ContainerStarted","Data":"a6cb0f0247e2360fbeff71f392dff4433a17c88606634e7bceaee330caf8cfcd"} May 27 21:32:30.499775 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.499778 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"711b343f-a15e-44be-b1bb-2366861c2833","Type":"ContainerStarted","Data":"2b5ce67e86c16906430702b833362994c6259c5f4966c3f870f1f4e349fa895b"} May 27 21:32:30.500210 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.499790 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"711b343f-a15e-44be-b1bb-2366861c2833","Type":"ContainerStarted","Data":"268ab7c40be02e4f5d6dd0aadc71114c5febc99a0a339b7586f68eddde551f61"} May 27 21:32:30.500210 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.499802 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"711b343f-a15e-44be-b1bb-2366861c2833","Type":"ContainerStarted","Data":"e4032e1f593a48d1d5694b649afc21705b4556b53f882381e5cceb8f8f1381c1"} May 27 21:32:30.500210 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.499812 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"711b343f-a15e-44be-b1bb-2366861c2833","Type":"ContainerStarted","Data":"f0cab28223f67737e6da95c1ffc531da403ccd1a1d49d9a1e44eaf99931927e2"} May 27 21:32:30.500210 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.499824 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"711b343f-a15e-44be-b1bb-2366861c2833","Type":"ContainerStarted","Data":"26d9a59ae6ae787cbdcb703a854dd5e52556819286a942f86517ee50f952ffd6"} May 27 21:32:30.573670 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.573568 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.573548138 podStartE2EDuration="2.573548138s" podCreationTimestamp="2026-05-27 21:32:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:32:30.571799481 +0000 UTC m=+259.411646466" watchObservedRunningTime="2026-05-27 21:32:30.573548138 +0000 UTC m=+259.413395111" May 27 21:32:30.639674 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.639641 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" May 27 21:32:30.693589 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.693535 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:32:30.693975 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.693946 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="prometheus" containerID="cri-o://7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" gracePeriod=600 May 27 21:32:30.694138 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.693980 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" gracePeriod=600 May 27 21:32:30.694417 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.694361 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="config-reloader" containerID="cri-o://12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" gracePeriod=600 May 27 21:32:30.695085 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.694819 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy" containerID="cri-o://a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" gracePeriod=600 May 27 21:32:30.695085 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.694884 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="thanos-sidecar" containerID="cri-o://e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" gracePeriod=600 May 27 21:32:30.695085 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.694933 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy-web" containerID="cri-o://30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" gracePeriod=600 May 27 21:32:30.792993 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.792964 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl"] May 27 21:32:30.820250 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:32:30.820222 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d750b4_b615_43a9_80c8_8c5fb87851da.slice/crio-9b5d963841bfad4d632e35273b2c1edced29707277c6c0c805c8b8e81f29616b WatchSource:0}: Error finding container 9b5d963841bfad4d632e35273b2c1edced29707277c6c0c805c8b8e81f29616b: Status 404 returned error can't find the container with id 9b5d963841bfad4d632e35273b2c1edced29707277c6c0c805c8b8e81f29616b May 27 21:32:30.951739 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.951714 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:30.973212 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973186 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-metrics-client-certs\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973212 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973217 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973498 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973239 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-rulefiles-0\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973498 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973258 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973498 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973284 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-serving-certs-ca-bundle\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973498 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973410 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-tls-assets\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973498 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973452 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-thanos-prometheus-http-client-file\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973748 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973527 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-grpc-tls\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973748 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973580 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-tls\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973748 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973614 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-web-config\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:30.973876 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973744 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:32:30.973876 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.973870 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:30.974792 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.974750 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:32:30.975954 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.975925 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:32:30.976064 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.976019 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:30.976113 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.976055 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:30.976383 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.976359 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:30.976467 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.976415 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config" (OuterVolumeSpecName: "config") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:30.976569 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.976545 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:30.977116 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.977094 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:30.987854 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:30.987819 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-web-config" (OuterVolumeSpecName: "web-config") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:31.074560 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.074524 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-metrics-client-ca\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:31.074560 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.074559 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-kube-rbac-proxy\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:31.074807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.074579 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:31.074807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.074600 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-db\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:31.074807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.074627 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-trusted-ca-bundle\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:31.074807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.074723 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config-out\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:31.074807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.074768 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-kubelet-serving-ca-bundle\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:31.074807 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.074799 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4764\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-kube-api-access-q4764\") pod \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\" (UID: \"a6c297be-0862-4bf8-b916-dc8c36d9c19e\") " May 27 21:32:31.075093 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075070 2549 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-grpc-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075154 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075095 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075154 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075110 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-web-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075154 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075124 2549 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-metrics-client-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075154 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075137 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075154 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075153 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075414 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075166 2549 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075414 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075179 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-tls-assets\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075414 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075193 2549 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.075414 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075064 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:32:31.075414 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075118 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:32:31.075778 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075420 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 27 21:32:31.075838 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.075783 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:32:31.076887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.076862 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:31.077074 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.077056 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-kube-api-access-q4764" (OuterVolumeSpecName: "kube-api-access-q4764") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "kube-api-access-q4764". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 27 21:32:31.077284 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.077267 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config-out" (OuterVolumeSpecName: "config-out") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 27 21:32:31.077351 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.077273 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a6c297be-0862-4bf8-b916-dc8c36d9c19e" (UID: "a6c297be-0862-4bf8-b916-dc8c36d9c19e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 27 21:32:31.176043 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.175987 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-metrics-client-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.176043 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.176036 2549 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-kube-rbac-proxy\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.176043 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.176054 2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a6c297be-0862-4bf8-b916-dc8c36d9c19e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.176289 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.176069 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-k8s-db\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.176289 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.176081 2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.176289 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.176094 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a6c297be-0862-4bf8-b916-dc8c36d9c19e-config-out\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.176289 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.176106 2549 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6c297be-0862-4bf8-b916-dc8c36d9c19e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.176289 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.176119 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4764\" (UniqueName: \"kubernetes.io/projected/a6c297be-0862-4bf8-b916-dc8c36d9c19e-kube-api-access-q4764\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" May 27 21:32:31.503947 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.503904 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" event={"ID":"a0d750b4-b615-43a9-80c8-8c5fb87851da","Type":"ContainerStarted","Data":"9b5d963841bfad4d632e35273b2c1edced29707277c6c0c805c8b8e81f29616b"} May 27 21:32:31.506651 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506626 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" exitCode=0 May 27 21:32:31.506651 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506647 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" exitCode=0 May 27 21:32:31.506651 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506653 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" exitCode=0 May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506658 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" exitCode=0 May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506663 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" exitCode=0 May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506669 2549 generic.go:358] "Generic (PLEG): container finished" podID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" exitCode=0 May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506710 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerDied","Data":"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f"} May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506757 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerDied","Data":"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009"} May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506771 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerDied","Data":"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921"} May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506784 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerDied","Data":"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727"} May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506798 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerDied","Data":"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed"} May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506726 2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506813 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerDied","Data":"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d"} May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506828 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a6c297be-0862-4bf8-b916-dc8c36d9c19e","Type":"ContainerDied","Data":"a0052bf2478a0893002befb96b8966f4a1e1a59460bf095ddc49e9045f82d1fe"} May 27 21:32:31.506887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.506850 2549 scope.go:117] "RemoveContainer" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" May 27 21:32:31.515268 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.515249 2549 scope.go:117] "RemoveContainer" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" May 27 21:32:31.521999 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.521960 2549 scope.go:117] "RemoveContainer" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" May 27 21:32:31.528790 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.528773 2549 scope.go:117] "RemoveContainer" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" May 27 21:32:31.536052 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.536030 2549 scope.go:117] "RemoveContainer" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" May 27 21:32:31.536220 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.536198 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:32:31.542363 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.542323 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:32:31.543248 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.543229 2549 scope.go:117] "RemoveContainer" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" May 27 21:32:31.551173 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.551150 2549 scope.go:117] "RemoveContainer" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" May 27 21:32:31.559526 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.559509 2549 scope.go:117] "RemoveContainer" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" May 27 21:32:31.559800 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:31.559777 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": container with ID starting with d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f not found: ID does not exist" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" May 27 21:32:31.559896 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.559814 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f"} err="failed to get container status \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": rpc error: code = NotFound desc = could not find container \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": container with ID starting with d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f not found: ID does not exist" May 27 21:32:31.559896 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.559842 2549 scope.go:117] "RemoveContainer" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" May 27 21:32:31.560151 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:31.560122 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": container with ID starting with a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009 not found: ID does not exist" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" May 27 21:32:31.560245 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.560159 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009"} err="failed to get container status \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": rpc error: code = NotFound desc = could not find container \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": container with ID starting with a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009 not found: ID does not exist" May 27 21:32:31.560245 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.560183 2549 scope.go:117] "RemoveContainer" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" May 27 21:32:31.560492 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:31.560466 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": container with ID starting with 30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921 not found: ID does not exist" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" May 27 21:32:31.560546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.560501 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921"} err="failed to get container status \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": rpc error: code = NotFound desc = could not find container \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": container with ID starting with 30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921 not found: ID does not exist" May 27 21:32:31.560546 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.560522 2549 scope.go:117] "RemoveContainer" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" May 27 21:32:31.560779 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:31.560762 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": container with ID starting with e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727 not found: ID does not exist" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" May 27 21:32:31.560856 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.560786 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727"} err="failed to get container status \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": rpc error: code = NotFound desc = could not find container \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": container with ID starting with e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727 not found: ID does not exist" May 27 21:32:31.560856 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.560806 2549 scope.go:117] "RemoveContainer" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" May 27 21:32:31.561051 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:31.561034 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": container with ID starting with 12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed not found: ID does not exist" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" May 27 21:32:31.561114 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.561054 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed"} err="failed to get container status \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": rpc error: code = NotFound desc = could not find container \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": container with ID starting with 12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed not found: ID does not exist" May 27 21:32:31.561114 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.561072 2549 scope.go:117] "RemoveContainer" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" May 27 21:32:31.561269 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:31.561252 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": container with ID starting with 7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d not found: ID does not exist" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" May 27 21:32:31.561324 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.561274 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d"} err="failed to get container status \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": rpc error: code = NotFound desc = could not find container \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": container with ID starting with 7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d not found: ID does not exist" May 27 21:32:31.561324 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.561291 2549 scope.go:117] "RemoveContainer" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" May 27 21:32:31.561703 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:32:31.561677 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": container with ID starting with 48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8 not found: ID does not exist" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" May 27 21:32:31.561803 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.561709 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8"} err="failed to get container status \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": rpc error: code = NotFound desc = could not find container \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": container with ID starting with 48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8 not found: ID does not exist" May 27 21:32:31.561803 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.561729 2549 scope.go:117] "RemoveContainer" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" May 27 21:32:31.562115 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.562083 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f"} err="failed to get container status \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": rpc error: code = NotFound desc = could not find container \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": container with ID starting with d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f not found: ID does not exist" May 27 21:32:31.562115 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.562111 2549 scope.go:117] "RemoveContainer" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" May 27 21:32:31.562379 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.562356 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009"} err="failed to get container status \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": rpc error: code = NotFound desc = could not find container \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": container with ID starting with a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009 not found: ID does not exist" May 27 21:32:31.562462 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.562379 2549 scope.go:117] "RemoveContainer" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" May 27 21:32:31.562598 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.562577 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921"} err="failed to get container status \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": rpc error: code = NotFound desc = could not find container \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": container with ID starting with 30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921 not found: ID does not exist" May 27 21:32:31.562669 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.562600 2549 scope.go:117] "RemoveContainer" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" May 27 21:32:31.562876 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.562847 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727"} err="failed to get container status \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": rpc error: code = NotFound desc = could not find container \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": container with ID starting with e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727 not found: ID does not exist" May 27 21:32:31.562959 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.562878 2549 scope.go:117] "RemoveContainer" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" May 27 21:32:31.563131 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.563110 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed"} err="failed to get container status \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": rpc error: code = NotFound desc = could not find container \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": container with ID starting with 12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed not found: ID does not exist" May 27 21:32:31.563206 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.563132 2549 scope.go:117] "RemoveContainer" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" May 27 21:32:31.563444 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.563419 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d"} err="failed to get container status \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": rpc error: code = NotFound desc = could not find container \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": container with ID starting with 7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d not found: ID does not exist" May 27 21:32:31.563524 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.563446 2549 scope.go:117] "RemoveContainer" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" May 27 21:32:31.563667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.563641 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8"} err="failed to get container status \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": rpc error: code = NotFound desc = could not find container \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": container with ID starting with 48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8 not found: ID does not exist" May 27 21:32:31.563667 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.563667 2549 scope.go:117] "RemoveContainer" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" May 27 21:32:31.563945 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.563913 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f"} err="failed to get container status \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": rpc error: code = NotFound desc = could not find container \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": container with ID starting with d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f not found: ID does not exist" May 27 21:32:31.563945 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.563938 2549 scope.go:117] "RemoveContainer" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" May 27 21:32:31.564186 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.564162 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009"} err="failed to get container status \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": rpc error: code = NotFound desc = could not find container \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": container with ID starting with a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009 not found: ID does not exist" May 27 21:32:31.564235 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.564190 2549 scope.go:117] "RemoveContainer" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" May 27 21:32:31.564493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.564464 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921"} err="failed to get container status \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": rpc error: code = NotFound desc = could not find container \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": container with ID starting with 30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921 not found: ID does not exist" May 27 21:32:31.564493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.564492 2549 scope.go:117] "RemoveContainer" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" May 27 21:32:31.564728 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.564711 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727"} err="failed to get container status \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": rpc error: code = NotFound desc = could not find container \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": container with ID starting with e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727 not found: ID does not exist" May 27 21:32:31.564728 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.564728 2549 scope.go:117] "RemoveContainer" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" May 27 21:32:31.564978 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.564953 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed"} err="failed to get container status \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": rpc error: code = NotFound desc = could not find container \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": container with ID starting with 12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed not found: ID does not exist" May 27 21:32:31.565085 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.564980 2549 scope.go:117] "RemoveContainer" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" May 27 21:32:31.565238 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.565202 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d"} err="failed to get container status \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": rpc error: code = NotFound desc = could not find container \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": container with ID starting with 7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d not found: ID does not exist" May 27 21:32:31.565325 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.565241 2549 scope.go:117] "RemoveContainer" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" May 27 21:32:31.565500 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.565481 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8"} err="failed to get container status \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": rpc error: code = NotFound desc = could not find container \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": container with ID starting with 48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8 not found: ID does not exist" May 27 21:32:31.565560 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.565501 2549 scope.go:117] "RemoveContainer" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" May 27 21:32:31.565773 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.565741 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f"} err="failed to get container status \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": rpc error: code = NotFound desc = could not find container \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": container with ID starting with d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f not found: ID does not exist" May 27 21:32:31.565773 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.565772 2549 scope.go:117] "RemoveContainer" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" May 27 21:32:31.566054 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.566025 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009"} err="failed to get container status \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": rpc error: code = NotFound desc = could not find container \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": container with ID starting with a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009 not found: ID does not exist" May 27 21:32:31.566118 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.566058 2549 scope.go:117] "RemoveContainer" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" May 27 21:32:31.566311 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.566283 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921"} err="failed to get container status \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": rpc error: code = NotFound desc = could not find container \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": container with ID starting with 30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921 not found: ID does not exist" May 27 21:32:31.566394 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.566312 2549 scope.go:117] "RemoveContainer" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" May 27 21:32:31.566606 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.566578 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727"} err="failed to get container status \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": rpc error: code = NotFound desc = could not find container \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": container with ID starting with e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727 not found: ID does not exist" May 27 21:32:31.566606 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.566606 2549 scope.go:117] "RemoveContainer" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" May 27 21:32:31.566819 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.566803 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed"} err="failed to get container status \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": rpc error: code = NotFound desc = could not find container \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": container with ID starting with 12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed not found: ID does not exist" May 27 21:32:31.566917 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.566820 2549 scope.go:117] "RemoveContainer" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" May 27 21:32:31.567084 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.567065 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d"} err="failed to get container status \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": rpc error: code = NotFound desc = could not find container \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": container with ID starting with 7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d not found: ID does not exist" May 27 21:32:31.567084 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.567086 2549 scope.go:117] "RemoveContainer" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" May 27 21:32:31.567320 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.567302 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8"} err="failed to get container status \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": rpc error: code = NotFound desc = could not find container \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": container with ID starting with 48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8 not found: ID does not exist" May 27 21:32:31.567413 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.567321 2549 scope.go:117] "RemoveContainer" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" May 27 21:32:31.567600 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.567577 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f"} err="failed to get container status \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": rpc error: code = NotFound desc = could not find container \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": container with ID starting with d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f not found: ID does not exist" May 27 21:32:31.567600 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.567598 2549 scope.go:117] "RemoveContainer" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" May 27 21:32:31.567829 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.567807 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009"} err="failed to get container status \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": rpc error: code = NotFound desc = could not find container \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": container with ID starting with a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009 not found: ID does not exist" May 27 21:32:31.567902 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.567830 2549 scope.go:117] "RemoveContainer" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" May 27 21:32:31.568064 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.568041 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921"} err="failed to get container status \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": rpc error: code = NotFound desc = could not find container \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": container with ID starting with 30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921 not found: ID does not exist" May 27 21:32:31.568141 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.568065 2549 scope.go:117] "RemoveContainer" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" May 27 21:32:31.568402 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.568379 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727"} err="failed to get container status \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": rpc error: code = NotFound desc = could not find container \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": container with ID starting with e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727 not found: ID does not exist" May 27 21:32:31.568488 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.568405 2549 scope.go:117] "RemoveContainer" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" May 27 21:32:31.568647 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.568625 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed"} err="failed to get container status \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": rpc error: code = NotFound desc = could not find container \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": container with ID starting with 12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed not found: ID does not exist" May 27 21:32:31.568647 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.568646 2549 scope.go:117] "RemoveContainer" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" May 27 21:32:31.568899 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.568876 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d"} err="failed to get container status \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": rpc error: code = NotFound desc = could not find container \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": container with ID starting with 7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d not found: ID does not exist" May 27 21:32:31.568982 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.568901 2549 scope.go:117] "RemoveContainer" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" May 27 21:32:31.569173 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.569150 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8"} err="failed to get container status \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": rpc error: code = NotFound desc = could not find container \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": container with ID starting with 48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8 not found: ID does not exist" May 27 21:32:31.569173 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.569172 2549 scope.go:117] "RemoveContainer" containerID="d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f" May 27 21:32:31.569503 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.569395 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f"} err="failed to get container status \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": rpc error: code = NotFound desc = could not find container \"d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f\": container with ID starting with d05710a4cd25821dcbbc2c3c58fce290de4bf0b09e523bfb04f757cb7060b66f not found: ID does not exist" May 27 21:32:31.569503 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.569415 2549 scope.go:117] "RemoveContainer" containerID="a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009" May 27 21:32:31.569757 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.569689 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009"} err="failed to get container status \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": rpc error: code = NotFound desc = could not find container \"a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009\": container with ID starting with a323999f3387452bd61b107d33ebd31d919872af499f7a50a048cda6e1342009 not found: ID does not exist" May 27 21:32:31.569757 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.569710 2549 scope.go:117] "RemoveContainer" containerID="30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921" May 27 21:32:31.570050 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.570024 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921"} err="failed to get container status \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": rpc error: code = NotFound desc = could not find container \"30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921\": container with ID starting with 30d1963fb7ace06130bda344bfb389e420b855f9d34f91b3938f91981fd4d921 not found: ID does not exist" May 27 21:32:31.570271 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.570050 2549 scope.go:117] "RemoveContainer" containerID="e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727" May 27 21:32:31.570686 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.570551 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727"} err="failed to get container status \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": rpc error: code = NotFound desc = could not find container \"e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727\": container with ID starting with e7d07977b9cfd565de996bcf1ec9a1390e58e13a573dc3c70a5aa81e97378727 not found: ID does not exist" May 27 21:32:31.570686 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.570576 2549 scope.go:117] "RemoveContainer" containerID="12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed" May 27 21:32:31.572291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.571841 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed"} err="failed to get container status \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": rpc error: code = NotFound desc = could not find container \"12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed\": container with ID starting with 12257019d3cb46a18b0f20f560483548d29fa7dabc892e03689b1975488f44ed not found: ID does not exist" May 27 21:32:31.572291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.571874 2549 scope.go:117] "RemoveContainer" containerID="7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d" May 27 21:32:31.572291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.572166 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d"} err="failed to get container status \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": rpc error: code = NotFound desc = could not find container \"7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d\": container with ID starting with 7974f82e5dcbec1ced82ffc535666a8edb09f9e5342f28c5ded61254cd0ade0d not found: ID does not exist" May 27 21:32:31.572291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.572191 2549 scope.go:117] "RemoveContainer" containerID="48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8" May 27 21:32:31.572571 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.572510 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8"} err="failed to get container status \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": rpc error: code = NotFound desc = could not find container \"48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8\": container with ID starting with 48e4669939ca2d884ae2786312d128582e1d2fe2186227c74db6b032ce13e3a8 not found: ID does not exist" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.572639 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573145 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy-thanos" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573159 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy-thanos" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573175 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy-web" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573185 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy-web" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573197 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="prometheus" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573205 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="prometheus" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573220 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="config-reloader" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573227 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="config-reloader" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573236 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="thanos-sidecar" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573258 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="thanos-sidecar" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573277 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="init-config-reloader" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573287 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="init-config-reloader" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573306 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573314 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573418 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="thanos-sidecar" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573430 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="config-reloader" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573440 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573448 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy-thanos" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573460 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="prometheus" May 27 21:32:31.573654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.573470 2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" containerName="kube-rbac-proxy-web" May 27 21:32:31.580828 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.580792 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.584489 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.584348 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 27 21:32:31.584489 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.584448 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 27 21:32:31.584790 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.584772 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.585150 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.585453 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.585483 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.585747 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.585767 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6qmgle9cvl8qi\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.585817 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.586033 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d4df2\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.586407 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 27 21:32:31.587493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.586505 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 27 21:32:31.589967 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.588791 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 27 21:32:31.614393 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.613795 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 27 21:32:31.615532 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.615501 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:32:31.680925 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.680891 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-config\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.680925 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.680925 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.680952 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681009 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681041 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681067 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681103 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681130 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93d9d07a-b654-4f30-87b7-81a8233c32a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681147 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93d9d07a-b654-4f30-87b7-81a8233c32a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681193 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681224 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681242 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681275 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681305 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681384 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681325 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681614 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681394 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkphp\" (UniqueName: \"kubernetes.io/projected/93d9d07a-b654-4f30-87b7-81a8233c32a8-kube-api-access-hkphp\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.681614 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.681426 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.715119 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.715085 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6c297be-0862-4bf8-b916-dc8c36d9c19e" path="/var/lib/kubelet/pods/a6c297be-0862-4bf8-b916-dc8c36d9c19e/volumes" May 27 21:32:31.782872 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.782780 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.782872 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.782846 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.782878 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93d9d07a-b654-4f30-87b7-81a8233c32a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.782904 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93d9d07a-b654-4f30-87b7-81a8233c32a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.782937 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.782962 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.782991 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783015 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783036 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783056 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783081 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783508 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783108 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkphp\" (UniqueName: \"kubernetes.io/projected/93d9d07a-b654-4f30-87b7-81a8233c32a8-kube-api-access-hkphp\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783508 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783153 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783508 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783184 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-config\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783508 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783209 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783508 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783244 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783508 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783273 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783508 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783300 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.783860 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.783803 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.784679 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.784497 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.786079 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.786055 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.786838 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.786686 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93d9d07a-b654-4f30-87b7-81a8233c32a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.786838 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.786704 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.787531 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.787506 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.787978 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.787953 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.788383 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.788310 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.788626 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.788589 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.788976 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.788953 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.789437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.789414 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.789520 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.789486 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.789520 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.789504 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93d9d07a-b654-4f30-87b7-81a8233c32a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.789959 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.789929 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.789959 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.789951 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-config\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.790328 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.790306 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/93d9d07a-b654-4f30-87b7-81a8233c32a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.790895 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.790874 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/93d9d07a-b654-4f30-87b7-81a8233c32a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.795818 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.795797 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkphp\" (UniqueName: \"kubernetes.io/projected/93d9d07a-b654-4f30-87b7-81a8233c32a8-kube-api-access-hkphp\") pod \"prometheus-k8s-0\" (UID: \"93d9d07a-b654-4f30-87b7-81a8233c32a8\") " pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:31.924266 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:31.924226 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:32:32.064586 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:32.064553 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 27 21:32:32.067359 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:32:32.067309 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d9d07a_b654_4f30_87b7_81a8233c32a8.slice/crio-5fef35c2a51cb0f51390435a9f1c1b32cb03cc059d4bcc6fe2aab8956934de90 WatchSource:0}: Error finding container 5fef35c2a51cb0f51390435a9f1c1b32cb03cc059d4bcc6fe2aab8956934de90: Status 404 returned error can't find the container with id 5fef35c2a51cb0f51390435a9f1c1b32cb03cc059d4bcc6fe2aab8956934de90 May 27 21:32:32.516269 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:32.516227 2549 generic.go:358] "Generic (PLEG): container finished" podID="93d9d07a-b654-4f30-87b7-81a8233c32a8" containerID="7c3c22e9c0ac7750ef703f4867b13daaf039ab330c8c114468c721371bf6c5cf" exitCode=0 May 27 21:32:32.516792 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:32.516299 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93d9d07a-b654-4f30-87b7-81a8233c32a8","Type":"ContainerDied","Data":"7c3c22e9c0ac7750ef703f4867b13daaf039ab330c8c114468c721371bf6c5cf"} May 27 21:32:32.516792 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:32.516324 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93d9d07a-b654-4f30-87b7-81a8233c32a8","Type":"ContainerStarted","Data":"5fef35c2a51cb0f51390435a9f1c1b32cb03cc059d4bcc6fe2aab8956934de90"} May 27 21:32:33.521605 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.521567 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" event={"ID":"a0d750b4-b615-43a9-80c8-8c5fb87851da","Type":"ContainerStarted","Data":"448e1691c590454546a21003ec740265469d2db6d1a092c667ba6161d5cf0454"} May 27 21:32:33.521605 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.521607 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" event={"ID":"a0d750b4-b615-43a9-80c8-8c5fb87851da","Type":"ContainerStarted","Data":"4118635efee92acb1f032199da771fd1f2a050fa11ee6fe597b739f7bbdf2054"} May 27 21:32:33.522105 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.521621 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" event={"ID":"a0d750b4-b615-43a9-80c8-8c5fb87851da","Type":"ContainerStarted","Data":"46573c232b238b7d5c0b053062e73a6778406bd2036d0cb9f2185631ecc48b52"} May 27 21:32:33.524255 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.524228 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93d9d07a-b654-4f30-87b7-81a8233c32a8","Type":"ContainerStarted","Data":"a4a39accaa50d854446c1c6a1a281b423d9cb88fc89f53967277d5cac0884b34"} May 27 21:32:33.524387 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.524257 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93d9d07a-b654-4f30-87b7-81a8233c32a8","Type":"ContainerStarted","Data":"2eb98a723623fb6ab2b2ea1601635fe97f7e936b11288ae8786116e5eb067832"} May 27 21:32:33.524387 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.524268 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93d9d07a-b654-4f30-87b7-81a8233c32a8","Type":"ContainerStarted","Data":"a04a5302cdd6722b294067f098b5618ff9f84bbaaaa7babafd84a7729395daf2"} May 27 21:32:33.524387 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.524277 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93d9d07a-b654-4f30-87b7-81a8233c32a8","Type":"ContainerStarted","Data":"5423ef5808181f28465d60382ce4a10212374df174466dbea320ef366f28b8b2"} May 27 21:32:33.524387 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.524285 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93d9d07a-b654-4f30-87b7-81a8233c32a8","Type":"ContainerStarted","Data":"31807a240765429b9f3ada8d391d3afdeb2b121fc0f030519626f6df256ea5fc"} May 27 21:32:33.524387 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.524293 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"93d9d07a-b654-4f30-87b7-81a8233c32a8","Type":"ContainerStarted","Data":"b8092acbddab903279a0704d95f1408bb8f91e30ce86b057a7fd38ecf781e2fa"} May 27 21:32:33.547964 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.547839 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f78cbf69b-8n6rl" podStartSLOduration=1.599417006 podStartE2EDuration="3.547821315s" podCreationTimestamp="2026-05-27 21:32:30 +0000 UTC" firstStartedPulling="2026-05-27 21:32:30.822194773 +0000 UTC m=+259.662041733" lastFinishedPulling="2026-05-27 21:32:32.770599093 +0000 UTC m=+261.610446042" observedRunningTime="2026-05-27 21:32:33.545463955 +0000 UTC m=+262.385310927" watchObservedRunningTime="2026-05-27 21:32:33.547821315 +0000 UTC m=+262.387668290" May 27 21:32:33.578510 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:33.578455 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.578437135 podStartE2EDuration="2.578437135s" podCreationTimestamp="2026-05-27 21:32:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:32:33.576142487 +0000 UTC m=+262.415989473" watchObservedRunningTime="2026-05-27 21:32:33.578437135 +0000 UTC m=+262.418284106" May 27 21:32:36.924748 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:32:36.924693 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:33:11.634387 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:33:11.634330 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:33:11.637468 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:33:11.637440 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:33:11.639377 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:33:11.639354 2549 kubelet.go:1628] "Image garbage collection succeeded" May 27 21:33:31.924562 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:33:31.924508 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:33:31.940466 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:33:31.940439 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:33:32.725402 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:33:32.725376 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 27 21:36:17.587352 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.587299 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xvv8s"] May 27 21:36:17.590886 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.590868 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:17.593463 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.593442 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 27 21:36:17.594234 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.594211 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 27 21:36:17.594293 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.594234 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-w5b2z\"" May 27 21:36:17.600106 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.600080 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xvv8s"] May 27 21:36:17.692183 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.692145 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb34ded5-68a9-4e05-8bc3-1f43237c88b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xvv8s\" (UID: \"cb34ded5-68a9-4e05-8bc3-1f43237c88b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:17.692373 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.692208 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djptt\" (UniqueName: \"kubernetes.io/projected/cb34ded5-68a9-4e05-8bc3-1f43237c88b4-kube-api-access-djptt\") pod \"cert-manager-webhook-587ccfb98-xvv8s\" (UID: \"cb34ded5-68a9-4e05-8bc3-1f43237c88b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:17.793535 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.793490 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb34ded5-68a9-4e05-8bc3-1f43237c88b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xvv8s\" (UID: \"cb34ded5-68a9-4e05-8bc3-1f43237c88b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:17.793729 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.793548 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djptt\" (UniqueName: \"kubernetes.io/projected/cb34ded5-68a9-4e05-8bc3-1f43237c88b4-kube-api-access-djptt\") pod \"cert-manager-webhook-587ccfb98-xvv8s\" (UID: \"cb34ded5-68a9-4e05-8bc3-1f43237c88b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:17.802880 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.802844 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djptt\" (UniqueName: \"kubernetes.io/projected/cb34ded5-68a9-4e05-8bc3-1f43237c88b4-kube-api-access-djptt\") pod \"cert-manager-webhook-587ccfb98-xvv8s\" (UID: \"cb34ded5-68a9-4e05-8bc3-1f43237c88b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:17.803007 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.802972 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb34ded5-68a9-4e05-8bc3-1f43237c88b4-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xvv8s\" (UID: \"cb34ded5-68a9-4e05-8bc3-1f43237c88b4\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:17.907168 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:17.907074 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:18.052088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:18.052055 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xvv8s"] May 27 21:36:18.054252 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:36:18.054204 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb34ded5_68a9_4e05_8bc3_1f43237c88b4.slice/crio-078c717c69f88420d1f3ce7d9bdace95f9e304aeaec857b7f8bf6d3c16d84d81 WatchSource:0}: Error finding container 078c717c69f88420d1f3ce7d9bdace95f9e304aeaec857b7f8bf6d3c16d84d81: Status 404 returned error can't find the container with id 078c717c69f88420d1f3ce7d9bdace95f9e304aeaec857b7f8bf6d3c16d84d81 May 27 21:36:18.056250 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:18.056234 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:36:18.209832 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:18.209736 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" event={"ID":"cb34ded5-68a9-4e05-8bc3-1f43237c88b4","Type":"ContainerStarted","Data":"078c717c69f88420d1f3ce7d9bdace95f9e304aeaec857b7f8bf6d3c16d84d81"} May 27 21:36:21.220593 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:21.220499 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" event={"ID":"cb34ded5-68a9-4e05-8bc3-1f43237c88b4","Type":"ContainerStarted","Data":"28c35b1ad8147834718c12bb4bc3c08c95b5e9b193c873b50c5228d2d0bf04b9"} May 27 21:36:21.220967 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:21.220630 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:21.239897 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:21.239849 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" podStartSLOduration=1.4611811160000001 podStartE2EDuration="4.239834484s" podCreationTimestamp="2026-05-27 21:36:17 +0000 UTC" firstStartedPulling="2026-05-27 21:36:18.056391766 +0000 UTC m=+486.896238716" lastFinishedPulling="2026-05-27 21:36:20.835045131 +0000 UTC m=+489.674892084" observedRunningTime="2026-05-27 21:36:21.238648632 +0000 UTC m=+490.078495604" watchObservedRunningTime="2026-05-27 21:36:21.239834484 +0000 UTC m=+490.079681455" May 27 21:36:27.226816 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:27.226784 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xvv8s" May 27 21:36:34.829143 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:34.829109 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8"] May 27 21:36:34.832486 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:34.832465 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" May 27 21:36:34.834906 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:34.834884 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 27 21:36:34.835699 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:34.835680 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 27 21:36:34.835788 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:34.835680 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mpgwp\"" May 27 21:36:34.841835 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:34.841815 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8"] May 27 21:36:34.944953 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:34.944914 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dab1bd3-51c5-476e-bb41-4145ba3c146a-tmp\") pod \"openshift-lws-operator-bfc7f696d-twkt8\" (UID: \"6dab1bd3-51c5-476e-bb41-4145ba3c146a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" May 27 21:36:34.945113 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:34.944969 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c676d\" (UniqueName: \"kubernetes.io/projected/6dab1bd3-51c5-476e-bb41-4145ba3c146a-kube-api-access-c676d\") pod \"openshift-lws-operator-bfc7f696d-twkt8\" (UID: \"6dab1bd3-51c5-476e-bb41-4145ba3c146a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" May 27 21:36:35.046187 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:35.046140 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dab1bd3-51c5-476e-bb41-4145ba3c146a-tmp\") pod \"openshift-lws-operator-bfc7f696d-twkt8\" (UID: \"6dab1bd3-51c5-476e-bb41-4145ba3c146a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" May 27 21:36:35.046328 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:35.046200 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c676d\" (UniqueName: \"kubernetes.io/projected/6dab1bd3-51c5-476e-bb41-4145ba3c146a-kube-api-access-c676d\") pod \"openshift-lws-operator-bfc7f696d-twkt8\" (UID: \"6dab1bd3-51c5-476e-bb41-4145ba3c146a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" May 27 21:36:35.046559 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:35.046538 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dab1bd3-51c5-476e-bb41-4145ba3c146a-tmp\") pod \"openshift-lws-operator-bfc7f696d-twkt8\" (UID: \"6dab1bd3-51c5-476e-bb41-4145ba3c146a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" May 27 21:36:35.064157 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:35.064130 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c676d\" (UniqueName: \"kubernetes.io/projected/6dab1bd3-51c5-476e-bb41-4145ba3c146a-kube-api-access-c676d\") pod \"openshift-lws-operator-bfc7f696d-twkt8\" (UID: \"6dab1bd3-51c5-476e-bb41-4145ba3c146a\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" May 27 21:36:35.141922 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:35.141867 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" May 27 21:36:35.269551 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:35.269519 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8"] May 27 21:36:35.272531 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:36:35.272496 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dab1bd3_51c5_476e_bb41_4145ba3c146a.slice/crio-abc6459a0b6d517b190262e70e9b04c9aeeaef2ae28b6cfd7dac554cde88b0a7 WatchSource:0}: Error finding container abc6459a0b6d517b190262e70e9b04c9aeeaef2ae28b6cfd7dac554cde88b0a7: Status 404 returned error can't find the container with id abc6459a0b6d517b190262e70e9b04c9aeeaef2ae28b6cfd7dac554cde88b0a7 May 27 21:36:36.270700 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:36.270641 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" event={"ID":"6dab1bd3-51c5-476e-bb41-4145ba3c146a","Type":"ContainerStarted","Data":"abc6459a0b6d517b190262e70e9b04c9aeeaef2ae28b6cfd7dac554cde88b0a7"} May 27 21:36:38.279164 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:38.279074 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" event={"ID":"6dab1bd3-51c5-476e-bb41-4145ba3c146a","Type":"ContainerStarted","Data":"22c7185d6039648b8368676b5415d6b2b5f6bf1d0e10655e12d9485ad5a1f649"} May 27 21:36:38.296174 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:38.296117 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-twkt8" podStartSLOduration=1.6553273069999999 podStartE2EDuration="4.296103849s" podCreationTimestamp="2026-05-27 21:36:34 +0000 UTC" firstStartedPulling="2026-05-27 21:36:35.274279541 +0000 UTC m=+504.114126494" lastFinishedPulling="2026-05-27 21:36:37.915056082 +0000 UTC m=+506.754903036" observedRunningTime="2026-05-27 21:36:38.295267882 +0000 UTC m=+507.135114854" watchObservedRunningTime="2026-05-27 21:36:38.296103849 +0000 UTC m=+507.135950820" May 27 21:36:53.484597 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.484560 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45"] May 27 21:36:53.491235 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.491210 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.493989 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.493954 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 27 21:36:53.494804 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.494784 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qw4lp\"" May 27 21:36:53.495430 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.495411 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 27 21:36:53.496126 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.496106 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 27 21:36:53.529789 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.529753 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45"] May 27 21:36:53.605224 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.605183 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe9d80f-2e38-4a09-944f-2d553d6f1407-cert\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.605416 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.605232 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fe9d80f-2e38-4a09-944f-2d553d6f1407-metrics-cert\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.605416 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.605261 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9fe9d80f-2e38-4a09-944f-2d553d6f1407-manager-config\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.605416 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.605293 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzh5r\" (UniqueName: \"kubernetes.io/projected/9fe9d80f-2e38-4a09-944f-2d553d6f1407-kube-api-access-jzh5r\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.706681 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.706644 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzh5r\" (UniqueName: \"kubernetes.io/projected/9fe9d80f-2e38-4a09-944f-2d553d6f1407-kube-api-access-jzh5r\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.706851 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.706707 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe9d80f-2e38-4a09-944f-2d553d6f1407-cert\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.706851 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.706737 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fe9d80f-2e38-4a09-944f-2d553d6f1407-metrics-cert\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.706851 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.706763 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9fe9d80f-2e38-4a09-944f-2d553d6f1407-manager-config\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.707391 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.707362 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9fe9d80f-2e38-4a09-944f-2d553d6f1407-manager-config\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.709235 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.709212 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fe9d80f-2e38-4a09-944f-2d553d6f1407-metrics-cert\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.709327 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.709219 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe9d80f-2e38-4a09-944f-2d553d6f1407-cert\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.718966 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.718938 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzh5r\" (UniqueName: \"kubernetes.io/projected/9fe9d80f-2e38-4a09-944f-2d553d6f1407-kube-api-access-jzh5r\") pod \"lws-controller-manager-7bff7fcbc9-gzw45\" (UID: \"9fe9d80f-2e38-4a09-944f-2d553d6f1407\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.801251 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.801156 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:53.982540 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:53.982512 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45"] May 27 21:36:53.985019 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:36:53.984990 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe9d80f_2e38_4a09_944f_2d553d6f1407.slice/crio-85db282aa95d944f3e2858aa720d4a4facbccfd541596222e72a812b48042943 WatchSource:0}: Error finding container 85db282aa95d944f3e2858aa720d4a4facbccfd541596222e72a812b48042943: Status 404 returned error can't find the container with id 85db282aa95d944f3e2858aa720d4a4facbccfd541596222e72a812b48042943 May 27 21:36:54.333828 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.333793 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" event={"ID":"9fe9d80f-2e38-4a09-944f-2d553d6f1407","Type":"ContainerStarted","Data":"85db282aa95d944f3e2858aa720d4a4facbccfd541596222e72a812b48042943"} May 27 21:36:54.794233 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.794145 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc"] May 27 21:36:54.852639 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.852597 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc"] May 27 21:36:54.852796 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.852721 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:54.856542 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.856519 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 27 21:36:54.856831 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.856803 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 27 21:36:54.856831 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.856822 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 27 21:36:54.856986 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.856943 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 27 21:36:54.856986 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:54.856949 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-898d8\"" May 27 21:36:55.017625 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.017582 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.017826 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.017653 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx7np\" (UniqueName: \"kubernetes.io/projected/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-kube-api-access-rx7np\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.017826 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.017742 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.118912 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.118872 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.119117 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.118969 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.119117 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.118999 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rx7np\" (UniqueName: \"kubernetes.io/projected/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-kube-api-access-rx7np\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.121701 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.121674 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.121848 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.121754 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.128828 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.128788 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx7np\" (UniqueName: \"kubernetes.io/projected/8dacb8f3-4675-4bdf-9075-7767d1ff5b56-kube-api-access-rx7np\") pod \"opendatahub-operator-controller-manager-7d799877b9-jsfdc\" (UID: \"8dacb8f3-4675-4bdf-9075-7767d1ff5b56\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.163598 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.163558 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:55.350075 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:55.350043 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc"] May 27 21:36:55.353470 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:36:55.353437 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dacb8f3_4675_4bdf_9075_7767d1ff5b56.slice/crio-20a1e84c0d1a78a834dfbad93f19bbe4e22e35926477b3a62513090a044e20d2 WatchSource:0}: Error finding container 20a1e84c0d1a78a834dfbad93f19bbe4e22e35926477b3a62513090a044e20d2: Status 404 returned error can't find the container with id 20a1e84c0d1a78a834dfbad93f19bbe4e22e35926477b3a62513090a044e20d2 May 27 21:36:56.342558 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:56.342516 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" event={"ID":"8dacb8f3-4675-4bdf-9075-7767d1ff5b56","Type":"ContainerStarted","Data":"20a1e84c0d1a78a834dfbad93f19bbe4e22e35926477b3a62513090a044e20d2"} May 27 21:36:57.347398 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:57.347365 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" event={"ID":"9fe9d80f-2e38-4a09-944f-2d553d6f1407","Type":"ContainerStarted","Data":"95344cd50f4399c91a8862cb705fd0683cbf1eb786b0a7539890d9fe77100881"} May 27 21:36:57.347837 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:57.347529 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:36:57.369381 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:57.369307 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" podStartSLOduration=2.117684525 podStartE2EDuration="4.369291314s" podCreationTimestamp="2026-05-27 21:36:53 +0000 UTC" firstStartedPulling="2026-05-27 21:36:53.986839449 +0000 UTC m=+522.826686400" lastFinishedPulling="2026-05-27 21:36:56.238446233 +0000 UTC m=+525.078293189" observedRunningTime="2026-05-27 21:36:57.366006264 +0000 UTC m=+526.205853248" watchObservedRunningTime="2026-05-27 21:36:57.369291314 +0000 UTC m=+526.209138285" May 27 21:36:58.351931 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:58.351887 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" event={"ID":"8dacb8f3-4675-4bdf-9075-7767d1ff5b56","Type":"ContainerStarted","Data":"640c51c9c2daf6a2bccef7e6057147200b3b570c3a4c175980ac07c2fde8300c"} May 27 21:36:58.352462 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:58.351963 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:36:58.384568 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:36:58.384464 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" podStartSLOduration=1.625987595 podStartE2EDuration="4.384444688s" podCreationTimestamp="2026-05-27 21:36:54 +0000 UTC" firstStartedPulling="2026-05-27 21:36:55.355361987 +0000 UTC m=+524.195208941" lastFinishedPulling="2026-05-27 21:36:58.113819083 +0000 UTC m=+526.953666034" observedRunningTime="2026-05-27 21:36:58.383246821 +0000 UTC m=+527.223093790" watchObservedRunningTime="2026-05-27 21:36:58.384444688 +0000 UTC m=+527.224291661" May 27 21:37:08.354520 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:08.354450 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-gzw45" May 27 21:37:09.358811 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:09.358778 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-jsfdc" May 27 21:37:14.335215 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.335180 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp"] May 27 21:37:14.338544 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.338527 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.342464 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.342439 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 27 21:37:14.342662 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.342645 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 27 21:37:14.343265 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.343246 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j6pnc\"" May 27 21:37:14.343350 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.343286 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 27 21:37:14.344082 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.344061 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 27 21:37:14.349273 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.349249 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp"] May 27 21:37:14.391317 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.391285 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99317501-9176-48e7-b62b-fa15638a9654-tls-certs\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.391515 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.391352 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99317501-9176-48e7-b62b-fa15638a9654-tmp\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.391515 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.391440 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2c9t\" (UniqueName: \"kubernetes.io/projected/99317501-9176-48e7-b62b-fa15638a9654-kube-api-access-j2c9t\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.492597 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.492554 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2c9t\" (UniqueName: \"kubernetes.io/projected/99317501-9176-48e7-b62b-fa15638a9654-kube-api-access-j2c9t\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.492789 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.492666 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99317501-9176-48e7-b62b-fa15638a9654-tls-certs\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.492789 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.492723 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99317501-9176-48e7-b62b-fa15638a9654-tmp\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.495059 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.495025 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99317501-9176-48e7-b62b-fa15638a9654-tmp\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.495278 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.495255 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99317501-9176-48e7-b62b-fa15638a9654-tls-certs\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.505981 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.505960 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2c9t\" (UniqueName: \"kubernetes.io/projected/99317501-9176-48e7-b62b-fa15638a9654-kube-api-access-j2c9t\") pod \"kube-auth-proxy-68b96d7ccc-44cgp\" (UID: \"99317501-9176-48e7-b62b-fa15638a9654\") " pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.650124 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.650041 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" May 27 21:37:14.781066 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:14.781039 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp"] May 27 21:37:14.783679 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:37:14.783652 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99317501_9176_48e7_b62b_fa15638a9654.slice/crio-ac261ed8345a057349ae046c23ddd4f8286c44a484c7cc95353f6bdcd9737ed9 WatchSource:0}: Error finding container ac261ed8345a057349ae046c23ddd4f8286c44a484c7cc95353f6bdcd9737ed9: Status 404 returned error can't find the container with id ac261ed8345a057349ae046c23ddd4f8286c44a484c7cc95353f6bdcd9737ed9 May 27 21:37:15.415975 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:15.415921 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" event={"ID":"99317501-9176-48e7-b62b-fa15638a9654","Type":"ContainerStarted","Data":"ac261ed8345a057349ae046c23ddd4f8286c44a484c7cc95353f6bdcd9737ed9"} May 27 21:37:18.429096 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:18.429061 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" event={"ID":"99317501-9176-48e7-b62b-fa15638a9654","Type":"ContainerStarted","Data":"e0f329b4511cac78fc42ce15ba8f0d0564466b36c231181cb075ff66849ecffa"} May 27 21:37:18.447118 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:37:18.447058 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68b96d7ccc-44cgp" podStartSLOduration=1.22615974 podStartE2EDuration="4.447041524s" podCreationTimestamp="2026-05-27 21:37:14 +0000 UTC" firstStartedPulling="2026-05-27 21:37:14.785465689 +0000 UTC m=+543.625312642" lastFinishedPulling="2026-05-27 21:37:18.006347461 +0000 UTC m=+546.846194426" observedRunningTime="2026-05-27 21:37:18.444821959 +0000 UTC m=+547.284668931" watchObservedRunningTime="2026-05-27 21:37:18.447041524 +0000 UTC m=+547.286888497" May 27 21:38:11.673155 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:38:11.673128 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:38:11.673662 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:38:11.673133 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:39:05.591135 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.591103 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8"] May 27 21:39:05.594461 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.594444 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:05.597001 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.596975 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 27 21:39:05.597563 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.597548 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 27 21:39:05.597631 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.597589 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 27 21:39:05.597993 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.597976 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 27 21:39:05.597993 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.597986 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zgkln\"" May 27 21:39:05.604569 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.604538 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8"] May 27 21:39:05.687535 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.687495 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:05.687535 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.687535 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf0134b5-cb52-4af9-b713-65f3ecef57fc-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:05.687752 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.687592 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qddxn\" (UniqueName: \"kubernetes.io/projected/cf0134b5-cb52-4af9-b713-65f3ecef57fc-kube-api-access-qddxn\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:05.788100 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.788057 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:05.788291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.788174 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf0134b5-cb52-4af9-b713-65f3ecef57fc-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:05.788291 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:39:05.788239 2549 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 27 21:39:05.788291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.788245 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qddxn\" (UniqueName: \"kubernetes.io/projected/cf0134b5-cb52-4af9-b713-65f3ecef57fc-kube-api-access-qddxn\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:05.788480 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:39:05.788304 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert podName:cf0134b5-cb52-4af9-b713-65f3ecef57fc nodeName:}" failed. No retries permitted until 2026-05-27 21:39:06.288281981 +0000 UTC m=+655.128128954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-bx6l8" (UID: "cf0134b5-cb52-4af9-b713-65f3ecef57fc") : secret "plugin-serving-cert" not found May 27 21:39:05.788905 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.788882 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf0134b5-cb52-4af9-b713-65f3ecef57fc-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:05.799399 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:05.799380 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qddxn\" (UniqueName: \"kubernetes.io/projected/cf0134b5-cb52-4af9-b713-65f3ecef57fc-kube-api-access-qddxn\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:06.292510 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:06.292470 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:06.292736 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:39:06.292634 2549 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 27 21:39:06.292736 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:39:06.292715 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert podName:cf0134b5-cb52-4af9-b713-65f3ecef57fc nodeName:}" failed. No retries permitted until 2026-05-27 21:39:07.292695052 +0000 UTC m=+656.132542003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-bx6l8" (UID: "cf0134b5-cb52-4af9-b713-65f3ecef57fc") : secret "plugin-serving-cert" not found May 27 21:39:07.302290 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:07.302236 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:07.304810 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:07.304785 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf0134b5-cb52-4af9-b713-65f3ecef57fc-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bx6l8\" (UID: \"cf0134b5-cb52-4af9-b713-65f3ecef57fc\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:07.403714 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:07.403668 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" May 27 21:39:07.531835 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:07.531807 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8"] May 27 21:39:07.534647 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:39:07.534622 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf0134b5_cb52_4af9_b713_65f3ecef57fc.slice/crio-cb99a854bbec51d1972b28ef7372ae1d060583187cd41228ad5d4caeff2b849c WatchSource:0}: Error finding container cb99a854bbec51d1972b28ef7372ae1d060583187cd41228ad5d4caeff2b849c: Status 404 returned error can't find the container with id cb99a854bbec51d1972b28ef7372ae1d060583187cd41228ad5d4caeff2b849c May 27 21:39:07.798147 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:07.798105 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" event={"ID":"cf0134b5-cb52-4af9-b713-65f3ecef57fc","Type":"ContainerStarted","Data":"cb99a854bbec51d1972b28ef7372ae1d060583187cd41228ad5d4caeff2b849c"} May 27 21:39:16.111095 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.111054 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk"] May 27 21:39:16.122251 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.122214 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" May 27 21:39:16.125038 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.125009 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk"] May 27 21:39:16.125170 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.125126 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wcbq\"" May 27 21:39:16.127375 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:39:16.127324 2549 reflector.go:200] "Failed to watch" err="secrets \"kuadrant-operator-controller-manager-dockercfg-6wcbq\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot watch resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wcbq\"" type="*v1.Secret" May 27 21:39:16.128868 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.128843 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk"] May 27 21:39:16.135450 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:39:16.135419 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-dxdl2], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-dxdl2]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" podUID="d186fb89-caa3-4d4e-8e00-81f6dfa4fbff" May 27 21:39:16.834325 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.834287 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" May 27 21:39:16.836876 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.836838 2549 status_manager.go:895] "Failed to get status for pod" podUID="d186fb89-caa3-4d4e-8e00-81f6dfa4fbff" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-96nrk\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" May 27 21:39:16.839815 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.839797 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" May 27 21:39:16.842289 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:16.842252 2549 status_manager.go:895] "Failed to get status for pod" podUID="d186fb89-caa3-4d4e-8e00-81f6dfa4fbff" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-96nrk\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" May 27 21:39:17.468323 ip-10-0-133-190 kubenswrapper[2549]: E0527 21:39:17.468285 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"kuadrant-operator-controller-manager-dockercfg-6wcbq\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wcbq\"" type="*v1.Secret" May 27 21:39:17.715146 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:17.715113 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d186fb89-caa3-4d4e-8e00-81f6dfa4fbff" path="/var/lib/kubelet/pods/d186fb89-caa3-4d4e-8e00-81f6dfa4fbff/volumes" May 27 21:39:17.838508 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:17.838473 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" May 27 21:39:17.841069 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:17.841034 2549 status_manager.go:895] "Failed to get status for pod" podUID="d186fb89-caa3-4d4e-8e00-81f6dfa4fbff" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-96nrk\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" May 27 21:39:17.843089 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:17.843059 2549 status_manager.go:895] "Failed to get status for pod" podUID="d186fb89-caa3-4d4e-8e00-81f6dfa4fbff" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-96nrk" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-96nrk\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" May 27 21:39:30.891315 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:30.891280 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" event={"ID":"cf0134b5-cb52-4af9-b713-65f3ecef57fc","Type":"ContainerStarted","Data":"d5211e49977f0c66141916e042960381e2041f00e516b1cb01bad302b75ba4b5"} May 27 21:39:30.913843 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:30.913794 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bx6l8" podStartSLOduration=3.317501399 podStartE2EDuration="25.913778393s" podCreationTimestamp="2026-05-27 21:39:05 +0000 UTC" firstStartedPulling="2026-05-27 21:39:07.536308034 +0000 UTC m=+656.376154984" lastFinishedPulling="2026-05-27 21:39:30.132585029 +0000 UTC m=+678.972431978" observedRunningTime="2026-05-27 21:39:30.912037065 +0000 UTC m=+679.751884037" watchObservedRunningTime="2026-05-27 21:39:30.913778393 +0000 UTC m=+679.753625365" May 27 21:39:49.396716 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.396677 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:39:49.412412 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.412380 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:49.412590 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.412552 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:39:49.415262 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.415242 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 27 21:39:49.455305 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.455273 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:39:49.490958 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.490924 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67-config-file\") pod \"limitador-limitador-78c99df468-xgpr7\" (UID: \"136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67\") " pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:49.491114 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.490991 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6h4d\" (UniqueName: \"kubernetes.io/projected/136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67-kube-api-access-w6h4d\") pod \"limitador-limitador-78c99df468-xgpr7\" (UID: \"136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67\") " pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:49.592413 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.592373 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67-config-file\") pod \"limitador-limitador-78c99df468-xgpr7\" (UID: \"136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67\") " pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:49.592569 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.592432 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6h4d\" (UniqueName: \"kubernetes.io/projected/136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67-kube-api-access-w6h4d\") pod \"limitador-limitador-78c99df468-xgpr7\" (UID: \"136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67\") " pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:49.592978 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.592959 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67-config-file\") pod \"limitador-limitador-78c99df468-xgpr7\" (UID: \"136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67\") " pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:49.602291 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.602259 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6h4d\" (UniqueName: \"kubernetes.io/projected/136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67-kube-api-access-w6h4d\") pod \"limitador-limitador-78c99df468-xgpr7\" (UID: \"136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67\") " pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:49.724071 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.723978 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:49.862049 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.862022 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:39:49.864189 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:39:49.864158 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136c5b73_4c4f_4cf8_b688_ac8fcc7f8e67.slice/crio-6356f1f2f5fd445b38d4a58df158cb37f1872ded21376ab5cc2709bbe6367c6d WatchSource:0}: Error finding container 6356f1f2f5fd445b38d4a58df158cb37f1872ded21376ab5cc2709bbe6367c6d: Status 404 returned error can't find the container with id 6356f1f2f5fd445b38d4a58df158cb37f1872ded21376ab5cc2709bbe6367c6d May 27 21:39:49.956126 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:49.956090 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" event={"ID":"136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67","Type":"ContainerStarted","Data":"6356f1f2f5fd445b38d4a58df158cb37f1872ded21376ab5cc2709bbe6367c6d"} May 27 21:39:53.971164 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:53.971124 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" event={"ID":"136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67","Type":"ContainerStarted","Data":"267a3d1c5d6ffac6b27e4c4a29380f282aa927e5764a5406bc0ee27d02532f97"} May 27 21:39:53.971576 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:53.971238 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:39:53.989650 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:39:53.989599 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" podStartSLOduration=1.661159313 podStartE2EDuration="4.989584309s" podCreationTimestamp="2026-05-27 21:39:49 +0000 UTC" firstStartedPulling="2026-05-27 21:39:49.865883376 +0000 UTC m=+698.705730327" lastFinishedPulling="2026-05-27 21:39:53.194308369 +0000 UTC m=+702.034155323" observedRunningTime="2026-05-27 21:39:53.988019268 +0000 UTC m=+702.827866231" watchObservedRunningTime="2026-05-27 21:39:53.989584309 +0000 UTC m=+702.829431280" May 27 21:40:04.976290 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:40:04.976204 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-xgpr7" May 27 21:41:03.334719 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:03.334681 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:41:36.695183 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:36.695096 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:41:50.891292 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:50.891251 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:41:51.589673 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.589635 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2"] May 27 21:41:51.593398 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.593381 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.595951 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.595925 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v28hb\"" May 27 21:41:51.596103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.596084 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 27 21:41:51.596772 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.596754 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 27 21:41:51.596904 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.596890 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 27 21:41:51.604821 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.604799 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2"] May 27 21:41:51.683708 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.683667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.683708 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.683714 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwbgp\" (UniqueName: \"kubernetes.io/projected/b7e5a3c7-cebb-4e1a-9658-681791b16a18-kube-api-access-lwbgp\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.683960 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.683812 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.683960 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.683849 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.683960 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.683926 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.683960 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.683957 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e5a3c7-cebb-4e1a-9658-681791b16a18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.784824 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.784791 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.785012 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.784829 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e5a3c7-cebb-4e1a-9658-681791b16a18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.785012 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.784876 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.785012 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.784898 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwbgp\" (UniqueName: \"kubernetes.io/projected/b7e5a3c7-cebb-4e1a-9658-681791b16a18-kube-api-access-lwbgp\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.785012 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.784930 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.785012 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.784946 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.785275 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.785226 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.785358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.785271 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.785358 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.785294 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.787463 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.787444 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e5a3c7-cebb-4e1a-9658-681791b16a18-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.787602 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.787580 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e5a3c7-cebb-4e1a-9658-681791b16a18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.794959 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.794934 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwbgp\" (UniqueName: \"kubernetes.io/projected/b7e5a3c7-cebb-4e1a-9658-681791b16a18-kube-api-access-lwbgp\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xktr2\" (UID: \"b7e5a3c7-cebb-4e1a-9658-681791b16a18\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:51.903688 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:51.903598 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:41:52.038025 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:52.037953 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2"] May 27 21:41:52.040293 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:41:52.040260 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e5a3c7_cebb_4e1a_9658_681791b16a18.slice/crio-e3d9dd10177f6050da87d8c8763113ccfc26d15cd5e6ce6cf7e9a3c672323c98 WatchSource:0}: Error finding container e3d9dd10177f6050da87d8c8763113ccfc26d15cd5e6ce6cf7e9a3c672323c98: Status 404 returned error can't find the container with id e3d9dd10177f6050da87d8c8763113ccfc26d15cd5e6ce6cf7e9a3c672323c98 May 27 21:41:52.042045 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:52.042023 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 21:41:52.385783 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:52.385747 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" event={"ID":"b7e5a3c7-cebb-4e1a-9658-681791b16a18","Type":"ContainerStarted","Data":"e3d9dd10177f6050da87d8c8763113ccfc26d15cd5e6ce6cf7e9a3c672323c98"} May 27 21:41:54.393674 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:54.393641 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:41:57.407746 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:41:57.407713 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" event={"ID":"b7e5a3c7-cebb-4e1a-9658-681791b16a18","Type":"ContainerStarted","Data":"494c4217b01df38e8b31717f90eecc2355cf5c103e54327821d866065169cdbf"} May 27 21:42:06.445110 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:06.445076 2549 generic.go:358] "Generic (PLEG): container finished" podID="b7e5a3c7-cebb-4e1a-9658-681791b16a18" containerID="494c4217b01df38e8b31717f90eecc2355cf5c103e54327821d866065169cdbf" exitCode=0 May 27 21:42:06.445554 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:06.445155 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" event={"ID":"b7e5a3c7-cebb-4e1a-9658-681791b16a18","Type":"ContainerDied","Data":"494c4217b01df38e8b31717f90eecc2355cf5c103e54327821d866065169cdbf"} May 27 21:42:08.453406 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:08.453371 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" event={"ID":"b7e5a3c7-cebb-4e1a-9658-681791b16a18","Type":"ContainerStarted","Data":"6709fdb423675fa2458df718f01f39bdc4c0db370cdedd46418b6b25ca9d7ed3"} May 27 21:42:08.453810 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:08.453609 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:42:08.477797 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:08.477750 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" podStartSLOduration=2.014140539 podStartE2EDuration="17.477736556s" podCreationTimestamp="2026-05-27 21:41:51 +0000 UTC" firstStartedPulling="2026-05-27 21:41:52.042149116 +0000 UTC m=+820.881996066" lastFinishedPulling="2026-05-27 21:42:07.505745122 +0000 UTC m=+836.345592083" observedRunningTime="2026-05-27 21:42:08.475492104 +0000 UTC m=+837.315339076" watchObservedRunningTime="2026-05-27 21:42:08.477736556 +0000 UTC m=+837.317583528" May 27 21:42:13.704162 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:13.704124 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:42:19.469741 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:19.469709 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xktr2" May 27 21:42:27.191082 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:27.191045 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:42:41.191798 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.191754 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn"] May 27 21:42:41.195552 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.195527 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.198234 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.198208 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 27 21:42:41.210615 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.210586 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn"] May 27 21:42:41.249612 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.249575 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.249612 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.249615 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.249858 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.249644 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.249858 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.249659 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btnkh\" (UniqueName: \"kubernetes.io/projected/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-kube-api-access-btnkh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.249858 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.249749 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.249858 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.249784 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.350700 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.350658 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.350700 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.350703 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.350946 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.350834 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.350946 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.350873 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btnkh\" (UniqueName: \"kubernetes.io/projected/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-kube-api-access-btnkh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.350946 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.350939 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.351103 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.351058 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.351162 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.351130 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.351208 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.351181 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.351246 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.351217 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.352984 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.352957 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.353522 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.353503 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.360372 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.360352 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btnkh\" (UniqueName: \"kubernetes.io/projected/b1c7c6aa-9a0c-455d-9681-f2a8f3303310-kube-api-access-btnkh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn\" (UID: \"b1c7c6aa-9a0c-455d-9681-f2a8f3303310\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.506253 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.506158 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:41.637788 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:41.637726 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn"] May 27 21:42:41.640001 ip-10-0-133-190 kubenswrapper[2549]: W0527 21:42:41.639967 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c7c6aa_9a0c_455d_9681_f2a8f3303310.slice/crio-800eb1ed2dfcea248e3183a6fc1ce8434b129c2e2c8ba87e4c5fcf82abe69f16 WatchSource:0}: Error finding container 800eb1ed2dfcea248e3183a6fc1ce8434b129c2e2c8ba87e4c5fcf82abe69f16: Status 404 returned error can't find the container with id 800eb1ed2dfcea248e3183a6fc1ce8434b129c2e2c8ba87e4c5fcf82abe69f16 May 27 21:42:42.573448 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:42.573408 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" event={"ID":"b1c7c6aa-9a0c-455d-9681-f2a8f3303310","Type":"ContainerStarted","Data":"f95dcbf660dd0a4f5d13a8aa94605a4eb08bd51aacb796123100df6a6de71dcc"} May 27 21:42:42.573448 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:42.573443 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" event={"ID":"b1c7c6aa-9a0c-455d-9681-f2a8f3303310","Type":"ContainerStarted","Data":"800eb1ed2dfcea248e3183a6fc1ce8434b129c2e2c8ba87e4c5fcf82abe69f16"} May 27 21:42:44.182739 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:44.182698 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:42:47.591326 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:47.591291 2549 generic.go:358] "Generic (PLEG): container finished" podID="b1c7c6aa-9a0c-455d-9681-f2a8f3303310" containerID="f95dcbf660dd0a4f5d13a8aa94605a4eb08bd51aacb796123100df6a6de71dcc" exitCode=0 May 27 21:42:47.591804 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:47.591371 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" event={"ID":"b1c7c6aa-9a0c-455d-9681-f2a8f3303310","Type":"ContainerDied","Data":"f95dcbf660dd0a4f5d13a8aa94605a4eb08bd51aacb796123100df6a6de71dcc"} May 27 21:42:48.596437 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:48.596402 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" event={"ID":"b1c7c6aa-9a0c-455d-9681-f2a8f3303310","Type":"ContainerStarted","Data":"9d789d5f5879adcc29b163978ac99884ecb7580fec31b6a9fe477e0e3002144f"} May 27 21:42:48.596805 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:48.596628 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:42:48.616134 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:48.616064 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" podStartSLOduration=7.426834267 podStartE2EDuration="7.616048048s" podCreationTimestamp="2026-05-27 21:42:41 +0000 UTC" firstStartedPulling="2026-05-27 21:42:47.592155567 +0000 UTC m=+876.432002518" lastFinishedPulling="2026-05-27 21:42:47.781369344 +0000 UTC m=+876.621216299" observedRunningTime="2026-05-27 21:42:48.615748928 +0000 UTC m=+877.455595897" watchObservedRunningTime="2026-05-27 21:42:48.616048048 +0000 UTC m=+877.455895023" May 27 21:42:59.612556 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:42:59.612524 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn" May 27 21:43:00.087396 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:00.087359 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:43:04.879492 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:04.879454 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:43:11.380059 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:11.380018 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:43:11.699382 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:11.699291 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:43:11.701645 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:11.701625 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:43:21.093618 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:21.093584 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:43:30.486490 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:30.486455 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:43:41.191325 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:41.191287 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:43:49.217395 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:43:49.217321 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:44:00.806491 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:44:00.806450 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:44:30.688844 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:44:30.688764 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:44:36.281595 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:44:36.281554 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:45:12.184852 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:45:12.184812 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:45:27.589276 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:45:27.589235 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:46:06.681487 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:46:06.681408 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:46:24.185179 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:46:24.185140 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:46:38.784734 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:46:38.784698 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:46:54.581311 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:46:54.581274 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:46:58.899560 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:46:58.899522 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:47:21.789964 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:47:21.789930 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:47:25.982849 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:47:25.982814 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:47:48.879813 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:47:48.879723 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:47:57.285235 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:47:57.285196 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:48:11.727027 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:48:11.726999 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:48:11.729926 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:48:11.729908 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:48:14.184155 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:48:14.184109 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:48:22.389159 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:48:22.389120 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:48:39.697198 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:48:39.697153 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:48:47.687222 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:48:47.687178 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:49:20.187909 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:49:20.187871 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:49:28.992197 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:49:28.992162 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:49:37.881655 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:49:37.881615 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:49:45.896564 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:49:45.896522 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:49:54.688623 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:49:54.688585 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:50:01.990088 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:50:01.990048 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:50:06.588112 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:50:06.588067 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:50:10.882255 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:50:10.882217 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:50:21.901563 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:50:21.901526 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:51:09.414081 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:51:09.414044 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:51:13.913472 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:51:13.913435 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:51:21.714614 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:51:21.714581 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:51:29.515111 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:51:29.515076 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:51:38.490705 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:51:38.490670 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:51:48.318524 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:51:48.318484 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:51:56.588469 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:51:56.588432 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:52:05.588146 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:52:05.588055 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:52:14.989155 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:52:14.989116 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:52:22.592665 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:52:22.592630 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:52:31.905419 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:52:31.905378 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:52:40.089654 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:52:40.089608 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:52:49.687945 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:52:49.687907 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:52:57.205073 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:52:57.205035 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:53:06.687198 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:53:06.687160 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:53:11.752359 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:53:11.752314 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:53:11.756474 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:53:11.756454 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:53:14.188223 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:53:14.188186 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:53:23.890347 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:53:23.890309 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:53:32.079319 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:53:32.079226 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:55:50.991110 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:55:50.991071 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:55:55.895916 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:55:55.895880 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:56:22.695391 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:56:22.695351 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:56:29.191786 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:56:29.191745 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:56:39.192435 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:56:39.192348 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:56:49.387671 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:56:49.387630 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:56:58.390887 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:56:58.390839 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:57:09.507080 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:57:09.507040 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:57:17.481057 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:57:17.481014 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:57:28.495863 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:57:28.495827 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:57:36.388494 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:57:36.388459 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:57:46.886493 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:57:46.886457 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:57:56.488415 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:57:56.488377 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:58:11.778854 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:58:11.778822 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:58:11.783234 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:58:11.783214 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 21:58:32.189112 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:58:32.189077 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:59:14.501086 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:59:14.501050 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:59:22.683576 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:59:22.683535 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:59:31.891257 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:59:31.891175 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:59:40.404051 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:59:40.404012 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 21:59:49.080506 ip-10-0-133-190 kubenswrapper[2549]: I0527 21:59:49.080468 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:00:02.685983 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:00:02.685946 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:00:10.596008 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:00:10.595964 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:00:18.888040 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:00:18.888003 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:00:26.788382 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:00:26.788329 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:00:34.883799 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:00:34.883758 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:00:44.483437 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:00:44.483401 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:00:56.588759 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:00:56.588723 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:01:14.786079 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:01:14.786001 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:01:22.585702 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:01:22.585665 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:01:31.686442 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:01:31.686397 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:01:39.190763 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:01:39.190725 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:01:56.282507 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:01:56.282467 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:02:04.396971 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:02:04.396930 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:02:14.387159 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:02:14.387121 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:02:22.688829 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:02:22.688787 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:02:30.476534 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:02:30.476500 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:02:39.883143 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:02:39.883106 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:02:49.110606 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:02:49.110568 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:03:02.401653 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:02.401618 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:03:10.591480 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:10.591440 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:03:11.809086 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:11.809054 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 22:03:11.814700 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:11.814679 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 22:03:22.391003 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:22.390963 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:03:31.727660 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:31.727616 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:03:39.884383 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:39.884327 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:03:48.490594 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:48.490550 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:03:54.380657 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:03:54.380612 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:04:12.087514 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:04:12.087428 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:04:20.581582 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:04:20.581547 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:04:29.588940 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:04:29.588903 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:04:37.488649 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:04:37.488613 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:05:00.793956 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:00.793918 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:05:13.492835 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:13.492795 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-xgpr7"] May 27 22:05:22.818741 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:22.818711 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d799877b9-jsfdc_8dacb8f3-4675-4bdf-9075-7767d1ff5b56/manager/0.log" May 27 22:05:24.609351 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:24.609314 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-bx6l8_cf0134b5-cb52-4af9-b713-65f3ecef57fc/kuadrant-console-plugin/0.log" May 27 22:05:24.958423 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:24.958321 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-xgpr7_136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67/limitador/0.log" May 27 22:05:25.644459 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:25.644426 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68b96d7ccc-44cgp_99317501-9176-48e7-b62b-fa15638a9654/kube-auth-proxy/0.log" May 27 22:05:26.540383 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:26.540353 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn_b1c7c6aa-9a0c-455d-9681-f2a8f3303310/storage-initializer/0.log" May 27 22:05:26.547488 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:26.547464 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-6cpxn_b1c7c6aa-9a0c-455d-9681-f2a8f3303310/main/0.log" May 27 22:05:27.013311 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:27.013282 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-xktr2_b7e5a3c7-cebb-4e1a-9658-681791b16a18/storage-initializer/0.log" May 27 22:05:27.020550 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:27.020529 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-xktr2_b7e5a3c7-cebb-4e1a-9658-681791b16a18/main/0.log" May 27 22:05:34.115272 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:34.115200 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-67xzr_2a36291c-83d8-4650-9659-dff5ac538053/global-pull-secret-syncer/0.log" May 27 22:05:34.335245 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:34.335214 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t9gld_8da5db53-913d-4cd1-939a-646114d832f0/konnectivity-agent/0.log" May 27 22:05:34.381672 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:34.381601 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-190.ec2.internal_0071387b81c31677807d5d21ba6390ac/haproxy/0.log" May 27 22:05:38.767316 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:38.767282 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-bx6l8_cf0134b5-cb52-4af9-b713-65f3ecef57fc/kuadrant-console-plugin/0.log" May 27 22:05:38.963959 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:38.963928 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-xgpr7_136c5b73-4c4f-4cf8-b688-ac8fcc7f8e67/limitador/0.log" May 27 22:05:40.565753 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.565728 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_711b343f-a15e-44be-b1bb-2366861c2833/alertmanager/0.log" May 27 22:05:40.599113 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.599080 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_711b343f-a15e-44be-b1bb-2366861c2833/config-reloader/0.log" May 27 22:05:40.624389 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.624359 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_711b343f-a15e-44be-b1bb-2366861c2833/kube-rbac-proxy-web/0.log" May 27 22:05:40.653506 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.653439 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_711b343f-a15e-44be-b1bb-2366861c2833/kube-rbac-proxy/0.log" May 27 22:05:40.675830 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.675797 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_711b343f-a15e-44be-b1bb-2366861c2833/kube-rbac-proxy-metric/0.log" May 27 22:05:40.700575 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.700548 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_711b343f-a15e-44be-b1bb-2366861c2833/prom-label-proxy/0.log" May 27 22:05:40.722416 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.722393 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_711b343f-a15e-44be-b1bb-2366861c2833/init-config-reloader/0.log" May 27 22:05:40.759316 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.759284 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-5t5mz_a238b30e-4eb3-4df6-968e-3718aba71c96/cluster-monitoring-operator/0.log" May 27 22:05:40.865039 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:40.865015 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d7769bd5b-t27vf_37d9957a-f8ac-482f-a4dc-663ff79e2a73/metrics-server/0.log" May 27 22:05:41.106351 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.106317 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvwwb_396390f7-8bf2-4884-95c6-ab68386f61f6/node-exporter/0.log" May 27 22:05:41.129503 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.129476 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvwwb_396390f7-8bf2-4884-95c6-ab68386f61f6/kube-rbac-proxy/0.log" May 27 22:05:41.158662 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.158641 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zvwwb_396390f7-8bf2-4884-95c6-ab68386f61f6/init-textfile/0.log" May 27 22:05:41.187825 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.187797 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bg2wm_719cb89e-4691-4b88-8a84-634c91319ced/kube-rbac-proxy-main/0.log" May 27 22:05:41.209010 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.208981 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bg2wm_719cb89e-4691-4b88-8a84-634c91319ced/kube-rbac-proxy-self/0.log" May 27 22:05:41.231931 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.231905 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-bg2wm_719cb89e-4691-4b88-8a84-634c91319ced/openshift-state-metrics/0.log" May 27 22:05:41.289450 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.289424 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93d9d07a-b654-4f30-87b7-81a8233c32a8/prometheus/0.log" May 27 22:05:41.316608 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.316554 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93d9d07a-b654-4f30-87b7-81a8233c32a8/config-reloader/0.log" May 27 22:05:41.344083 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.344057 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93d9d07a-b654-4f30-87b7-81a8233c32a8/thanos-sidecar/0.log" May 27 22:05:41.371432 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.371331 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93d9d07a-b654-4f30-87b7-81a8233c32a8/kube-rbac-proxy-web/0.log" May 27 22:05:41.395550 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.395528 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93d9d07a-b654-4f30-87b7-81a8233c32a8/kube-rbac-proxy/0.log" May 27 22:05:41.418836 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.418810 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93d9d07a-b654-4f30-87b7-81a8233c32a8/kube-rbac-proxy-thanos/0.log" May 27 22:05:41.442715 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.442692 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_93d9d07a-b654-4f30-87b7-81a8233c32a8/init-config-reloader/0.log" May 27 22:05:41.559081 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.559043 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f78cbf69b-8n6rl_a0d750b4-b615-43a9-80c8-8c5fb87851da/telemeter-client/0.log" May 27 22:05:41.592729 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.592704 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f78cbf69b-8n6rl_a0d750b4-b615-43a9-80c8-8c5fb87851da/reload/0.log" May 27 22:05:41.621509 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.621437 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f78cbf69b-8n6rl_a0d750b4-b615-43a9-80c8-8c5fb87851da/kube-rbac-proxy/0.log" May 27 22:05:41.657994 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.657968 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/thanos-query/0.log" May 27 22:05:41.680826 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.680803 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/kube-rbac-proxy-web/0.log" May 27 22:05:41.702850 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.702829 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/kube-rbac-proxy/0.log" May 27 22:05:41.728269 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.728242 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/prom-label-proxy/0.log" May 27 22:05:41.753672 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.753642 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/kube-rbac-proxy-rules/0.log" May 27 22:05:41.777166 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:41.777047 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f99d985d8-qclqq_a8d4df8f-9a42-4c3a-85d6-daf9795f6893/kube-rbac-proxy-metrics/0.log" May 27 22:05:43.122355 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.122297 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv"] May 27 22:05:43.125865 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.125844 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.128703 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.128678 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-77md2\"/\"openshift-service-ca.crt\"" May 27 22:05:43.128811 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.128687 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-77md2\"/\"default-dockercfg-84qd4\"" May 27 22:05:43.128811 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.128718 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-77md2\"/\"kube-root-ca.crt\"" May 27 22:05:43.134521 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.134496 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv"] May 27 22:05:43.271690 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.271650 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-lib-modules\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.271865 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.271712 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-podres\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.271865 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.271735 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-proc\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.271865 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.271753 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-sys\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.271865 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.271771 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gqfb\" (UniqueName: \"kubernetes.io/projected/4b695085-20bf-4798-a17e-5723966bd434-kube-api-access-5gqfb\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373133 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373045 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-lib-modules\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373133 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373105 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-podres\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373133 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373124 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-proc\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373384 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373144 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-sys\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373384 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373165 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gqfb\" (UniqueName: \"kubernetes.io/projected/4b695085-20bf-4798-a17e-5723966bd434-kube-api-access-5gqfb\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373384 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373238 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-lib-modules\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373384 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373268 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-sys\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373384 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373238 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-proc\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.373384 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.373297 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4b695085-20bf-4798-a17e-5723966bd434-podres\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.381263 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.381242 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gqfb\" (UniqueName: \"kubernetes.io/projected/4b695085-20bf-4798-a17e-5723966bd434-kube-api-access-5gqfb\") pod \"perf-node-gather-daemonset-fzkpv\" (UID: \"4b695085-20bf-4798-a17e-5723966bd434\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.436741 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.436704 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:43.577653 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.577617 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv"] May 27 22:05:43.581667 ip-10-0-133-190 kubenswrapper[2549]: W0527 22:05:43.581634 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4b695085_20bf_4798_a17e_5723966bd434.slice/crio-ce175f2c9f29f312b631f57eb351ad0bc95a14a01431b033fc934425280ffe1d WatchSource:0}: Error finding container ce175f2c9f29f312b631f57eb351ad0bc95a14a01431b033fc934425280ffe1d: Status 404 returned error can't find the container with id ce175f2c9f29f312b631f57eb351ad0bc95a14a01431b033fc934425280ffe1d May 27 22:05:43.583405 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:43.583388 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 27 22:05:44.448513 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:44.448474 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" event={"ID":"4b695085-20bf-4798-a17e-5723966bd434","Type":"ContainerStarted","Data":"622b7fe6541737c9f2229cfc2522bb55b27f3601cee95c51cba5ffdd0ace7be8"} May 27 22:05:44.448513 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:44.448511 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" event={"ID":"4b695085-20bf-4798-a17e-5723966bd434","Type":"ContainerStarted","Data":"ce175f2c9f29f312b631f57eb351ad0bc95a14a01431b033fc934425280ffe1d"} May 27 22:05:44.449039 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:44.448572 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:44.464664 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:44.464612 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" podStartSLOduration=1.464598868 podStartE2EDuration="1.464598868s" podCreationTimestamp="2026-05-27 22:05:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 22:05:44.463470266 +0000 UTC m=+2253.303317239" watchObservedRunningTime="2026-05-27 22:05:44.464598868 +0000 UTC m=+2253.304445839" May 27 22:05:45.319617 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:45.319592 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f56nx_3374966c-0179-4b59-8d58-b8e0292031f6/dns/0.log" May 27 22:05:45.340303 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:45.340278 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f56nx_3374966c-0179-4b59-8d58-b8e0292031f6/kube-rbac-proxy/0.log" May 27 22:05:45.437581 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:45.437552 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ls77t_37736595-f26f-4455-8d5c-b7cbad923ad0/dns-node-resolver/0.log" May 27 22:05:45.989844 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:45.989812 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cgdsd_d7a806a8-63c2-4eff-a538-ce53e1b14446/node-ca/0.log" May 27 22:05:46.974507 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:46.974480 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68b96d7ccc-44cgp_99317501-9176-48e7-b62b-fa15638a9654/kube-auth-proxy/0.log" May 27 22:05:47.735388 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:47.735357 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdqdc_ac73cbfc-b095-4c18-9076-f2f8bde69750/serve-healthcheck-canary/0.log" May 27 22:05:48.189024 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:48.188981 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-c5g7l_fd2d615e-5d8e-4e73-9e11-62024901986b/insights-operator/0.log" May 27 22:05:48.190737 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:48.190714 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-c5g7l_fd2d615e-5d8e-4e73-9e11-62024901986b/insights-operator/1.log" May 27 22:05:48.276305 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:48.276275 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f747x_ab62135e-1fa1-4254-80cd-b1a7fa8daa5c/kube-rbac-proxy/0.log" May 27 22:05:48.295328 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:48.295293 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f747x_ab62135e-1fa1-4254-80cd-b1a7fa8daa5c/exporter/0.log" May 27 22:05:48.316241 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:48.316196 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f747x_ab62135e-1fa1-4254-80cd-b1a7fa8daa5c/extractor/0.log" May 27 22:05:50.461763 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:50.461736 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-fzkpv" May 27 22:05:50.685315 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:50.685286 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d799877b9-jsfdc_8dacb8f3-4675-4bdf-9075-7767d1ff5b56/manager/0.log" May 27 22:05:51.978642 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:51.978558 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bff7fcbc9-gzw45_9fe9d80f-2e38-4a09-944f-2d553d6f1407/manager/0.log" May 27 22:05:52.025949 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:52.025919 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-twkt8_6dab1bd3-51c5-476e-bb41-4145ba3c146a/openshift-lws-operator/0.log" May 27 22:05:56.476359 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:56.476302 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-q4j7x_f424d97b-9184-4b48-8d90-2e0f040bd7c2/migrator/0.log" May 27 22:05:56.495709 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:56.495675 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-q4j7x_f424d97b-9184-4b48-8d90-2e0f040bd7c2/graceful-termination/0.log" May 27 22:05:58.195856 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.195825 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k5nf4_af21fafe-e0a8-44a6-b21a-52698d6cf989/kube-multus-additional-cni-plugins/0.log" May 27 22:05:58.215380 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.215328 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k5nf4_af21fafe-e0a8-44a6-b21a-52698d6cf989/egress-router-binary-copy/0.log" May 27 22:05:58.234317 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.234288 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k5nf4_af21fafe-e0a8-44a6-b21a-52698d6cf989/cni-plugins/0.log" May 27 22:05:58.257633 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.257609 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k5nf4_af21fafe-e0a8-44a6-b21a-52698d6cf989/bond-cni-plugin/0.log" May 27 22:05:58.276939 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.276921 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k5nf4_af21fafe-e0a8-44a6-b21a-52698d6cf989/routeoverride-cni/0.log" May 27 22:05:58.295943 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.295921 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k5nf4_af21fafe-e0a8-44a6-b21a-52698d6cf989/whereabouts-cni-bincopy/0.log" May 27 22:05:58.313954 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.313934 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k5nf4_af21fafe-e0a8-44a6-b21a-52698d6cf989/whereabouts-cni/0.log" May 27 22:05:58.346606 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.346575 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s7msk_a7b71697-67eb-43b0-80ef-c4773220cf8d/kube-multus/0.log" May 27 22:05:58.484808 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.484732 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l6qxd_71222d0a-e311-4912-bc4d-d822abd1c9af/network-metrics-daemon/0.log" May 27 22:05:58.506137 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:58.506113 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l6qxd_71222d0a-e311-4912-bc4d-d822abd1c9af/kube-rbac-proxy/0.log" May 27 22:05:59.326596 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.326561 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-controller/0.log" May 27 22:05:59.348976 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.348942 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/0.log" May 27 22:05:59.359579 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.359556 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovn-acl-logging/1.log" May 27 22:05:59.384674 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.384648 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/kube-rbac-proxy-node/0.log" May 27 22:05:59.410529 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.410502 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/kube-rbac-proxy-ovn-metrics/0.log" May 27 22:05:59.432378 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.432356 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/northd/0.log" May 27 22:05:59.456450 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.456426 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/nbdb/0.log" May 27 22:05:59.478395 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.478371 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/sbdb/0.log" May 27 22:05:59.569750 ip-10-0-133-190 kubenswrapper[2549]: I0527 22:05:59.569717 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tnmz_816d229e-fd1b-48a9-9a08-887e14e44e52/ovnkube-controller/0.log"