May 20 17:00:11.409008 ip-10-0-135-136 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 20 17:00:11.409023 ip-10-0-135-136 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 20 17:00:11.409032 ip-10-0-135-136 systemd[1]: kubelet.service: Failed with result 'resources'. May 20 17:00:11.409367 ip-10-0-135-136 systemd[1]: Failed to start Kubernetes Kubelet. May 20 17:00:21.640670 ip-10-0-135-136 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 20 17:00:21.640689 ip-10-0-135-136 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 748a4b30cabe44ffb0d5b10c01834f5b -- May 20 17:03:08.285835 ip-10-0-135-136 systemd[1]: Starting Kubernetes Kubelet... May 20 17:03:08.748416 ip-10-0-135-136 kubenswrapper[2545]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 17:03:08.748416 ip-10-0-135-136 kubenswrapper[2545]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 17:03:08.748416 ip-10-0-135-136 kubenswrapper[2545]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 17:03:08.748416 ip-10-0-135-136 kubenswrapper[2545]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 17:03:08.748416 ip-10-0-135-136 kubenswrapper[2545]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 17:03:08.749284 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.749191 2545 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 17:03:08.752185 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752169 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:08.752185 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752184 2545 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752188 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752191 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752194 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752198 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752200 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752203 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752206 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752209 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752212 2545 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752215 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752217 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752220 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752222 2545 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752226 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752229 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752231 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752234 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752236 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:08.752254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752242 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752247 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752251 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752254 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752257 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752260 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752263 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752266 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752270 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752274 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752276 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752280 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752282 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752285 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752287 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752290 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752292 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752296 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752298 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:08.752723 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752301 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752304 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752306 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752309 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752312 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752314 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752317 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752320 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752323 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752325 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752328 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752330 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752332 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752335 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752337 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752341 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752344 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752347 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752350 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752353 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:08.753211 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752355 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752358 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752361 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752363 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752366 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752368 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752370 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752373 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752376 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752380 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752383 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752385 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752388 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752390 2545 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752393 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752396 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752398 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752401 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752403 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752406 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:08.753731 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752409 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752411 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752414 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752416 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752419 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752421 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752424 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752824 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752829 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752832 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752835 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752838 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752841 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752844 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752847 2545 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752849 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752852 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752855 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752858 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752860 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:08.754207 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752863 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752866 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752868 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752871 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752874 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752877 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752879 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752882 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752885 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752888 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752891 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752893 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752896 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752899 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752902 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752905 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752907 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752910 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752912 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:08.754716 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752916 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752918 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752921 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752923 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752927 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752931 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752934 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752937 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752939 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752942 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752944 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752948 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752950 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752953 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752955 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752958 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752960 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752963 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752965 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:08.755218 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752968 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752971 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752974 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752977 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752980 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752982 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752985 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752987 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752990 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752992 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752995 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752997 2545 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.752999 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753002 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753005 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753007 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753010 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753012 2545 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753015 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753017 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:08.755748 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753020 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753022 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753025 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753027 2545 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753030 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753032 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753035 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753037 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753040 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753042 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753045 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753047 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753050 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753052 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753055 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753128 2545 flags.go:64] FLAG: --address="0.0.0.0" May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753135 2545 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753142 2545 flags.go:64] FLAG: --anonymous-auth="true" May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753146 2545 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753150 2545 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753154 2545 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 17:03:08.756247 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753158 2545 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753162 2545 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753166 2545 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753169 2545 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753173 2545 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753177 2545 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753180 2545 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753183 2545 flags.go:64] FLAG: --cgroup-root="" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753186 2545 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753189 2545 flags.go:64] FLAG: --client-ca-file="" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753192 2545 flags.go:64] FLAG: --cloud-config="" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753195 2545 flags.go:64] FLAG: --cloud-provider="external" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753198 2545 flags.go:64] FLAG: --cluster-dns="[]" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753202 2545 flags.go:64] FLAG: --cluster-domain="" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753205 2545 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753208 2545 flags.go:64] FLAG: --config-dir="" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753211 2545 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753215 2545 flags.go:64] FLAG: --container-log-max-files="5" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753219 2545 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753222 2545 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753228 2545 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753231 2545 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753234 2545 flags.go:64] FLAG: --contention-profiling="false" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753237 2545 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 17:03:08.756789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753240 2545 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753243 2545 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753246 2545 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753252 2545 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753255 2545 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753259 2545 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753261 2545 flags.go:64] FLAG: --enable-load-reader="false" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753264 2545 flags.go:64] FLAG: --enable-server="true" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753267 2545 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753272 2545 flags.go:64] FLAG: --event-burst="100" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753275 2545 flags.go:64] FLAG: --event-qps="50" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753278 2545 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753281 2545 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753284 2545 flags.go:64] FLAG: --eviction-hard="" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753288 2545 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753291 2545 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753294 2545 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753297 2545 flags.go:64] FLAG: --eviction-soft="" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753300 2545 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753303 2545 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753306 2545 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753309 2545 flags.go:64] FLAG: --experimental-mounter-path="" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753312 2545 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753315 2545 flags.go:64] FLAG: --fail-swap-on="true" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753317 2545 flags.go:64] FLAG: --feature-gates="" May 20 17:03:08.757371 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753321 2545 flags.go:64] FLAG: --file-check-frequency="20s" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753324 2545 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753327 2545 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753332 2545 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753335 2545 flags.go:64] FLAG: --healthz-port="10248" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753338 2545 flags.go:64] FLAG: --help="false" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753341 2545 flags.go:64] FLAG: --hostname-override="ip-10-0-135-136.ec2.internal" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753344 2545 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753347 2545 flags.go:64] FLAG: --http-check-frequency="20s" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753373 2545 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753378 2545 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753382 2545 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753386 2545 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753389 2545 flags.go:64] FLAG: --image-service-endpoint="" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753392 2545 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753395 2545 flags.go:64] FLAG: --kube-api-burst="100" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753398 2545 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753401 2545 flags.go:64] FLAG: --kube-api-qps="50" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753404 2545 flags.go:64] FLAG: --kube-reserved="" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753407 2545 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753410 2545 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753413 2545 flags.go:64] FLAG: --kubelet-cgroups="" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753416 2545 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753419 2545 flags.go:64] FLAG: --lock-file="" May 20 17:03:08.757979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753422 2545 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753425 2545 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753428 2545 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753433 2545 flags.go:64] FLAG: --log-json-split-stream="false" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753436 2545 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753439 2545 flags.go:64] FLAG: --log-text-split-stream="false" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753442 2545 flags.go:64] FLAG: --logging-format="text" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753445 2545 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753448 2545 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753451 2545 flags.go:64] FLAG: --manifest-url="" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753454 2545 flags.go:64] FLAG: --manifest-url-header="" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753461 2545 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753464 2545 flags.go:64] FLAG: --max-open-files="1000000" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753468 2545 flags.go:64] FLAG: --max-pods="110" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753474 2545 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753477 2545 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753480 2545 flags.go:64] FLAG: --memory-manager-policy="None" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753483 2545 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753486 2545 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753489 2545 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753492 2545 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753500 2545 flags.go:64] FLAG: --node-status-max-images="50" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753503 2545 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753506 2545 flags.go:64] FLAG: --oom-score-adj="-999" May 20 17:03:08.758592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753509 2545 flags.go:64] FLAG: --pod-cidr="" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753512 2545 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753518 2545 flags.go:64] FLAG: --pod-manifest-path="" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753521 2545 flags.go:64] FLAG: --pod-max-pids="-1" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753524 2545 flags.go:64] FLAG: --pods-per-core="0" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753526 2545 flags.go:64] FLAG: --port="10250" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753529 2545 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753533 2545 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f3c845d362bb5057" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753551 2545 flags.go:64] FLAG: --qos-reserved="" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753554 2545 flags.go:64] FLAG: --read-only-port="10255" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753557 2545 flags.go:64] FLAG: --register-node="true" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753560 2545 flags.go:64] FLAG: --register-schedulable="true" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753563 2545 flags.go:64] FLAG: --register-with-taints="" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753566 2545 flags.go:64] FLAG: --registry-burst="10" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753569 2545 flags.go:64] FLAG: --registry-qps="5" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753572 2545 flags.go:64] FLAG: --reserved-cpus="" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753575 2545 flags.go:64] FLAG: --reserved-memory="" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753578 2545 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753581 2545 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753586 2545 flags.go:64] FLAG: --rotate-certificates="false" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753589 2545 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753592 2545 flags.go:64] FLAG: --runonce="false" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753595 2545 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753599 2545 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753602 2545 flags.go:64] FLAG: --seccomp-default="false" May 20 17:03:08.759177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753605 2545 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753608 2545 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753611 2545 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753614 2545 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753618 2545 flags.go:64] FLAG: --storage-driver-password="root" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753621 2545 flags.go:64] FLAG: --storage-driver-secure="false" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753624 2545 flags.go:64] FLAG: --storage-driver-table="stats" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753627 2545 flags.go:64] FLAG: --storage-driver-user="root" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753630 2545 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753633 2545 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753635 2545 flags.go:64] FLAG: --system-cgroups="" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753638 2545 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753644 2545 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753647 2545 flags.go:64] FLAG: --tls-cert-file="" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753649 2545 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753653 2545 flags.go:64] FLAG: --tls-min-version="" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753656 2545 flags.go:64] FLAG: --tls-private-key-file="" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753659 2545 flags.go:64] FLAG: --topology-manager-policy="none" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753662 2545 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753664 2545 flags.go:64] FLAG: --topology-manager-scope="container" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753667 2545 flags.go:64] FLAG: --v="2" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753671 2545 flags.go:64] FLAG: --version="false" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753675 2545 flags.go:64] FLAG: --vmodule="" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753679 2545 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.753682 2545 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 17:03:08.759799 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753774 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753780 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753783 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753787 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753790 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753793 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753797 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753802 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753805 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753807 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753810 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753812 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753815 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753818 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753821 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753823 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753826 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753828 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753831 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:08.760428 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753833 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753836 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753838 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753841 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753844 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753846 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753849 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753851 2545 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753854 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753856 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753859 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753861 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753864 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753866 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753870 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753873 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753875 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753878 2545 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753882 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753884 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:08.760911 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753887 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753890 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753892 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753895 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753897 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753900 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753903 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753905 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753908 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753910 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753913 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753916 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753919 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753921 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753924 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753926 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753929 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753931 2545 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753934 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753936 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:08.761422 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753939 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753941 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753944 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753946 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753949 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753951 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753955 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753957 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753961 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753963 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753967 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753970 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753973 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753975 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753978 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753980 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753983 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753986 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753988 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:08.761944 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753993 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753996 2545 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.753999 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.754002 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.754005 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.754008 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.754011 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.754014 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.754771 2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.761446 2545 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.761462 2545 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761514 2545 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761520 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761523 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761527 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:08.762417 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761531 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761548 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761552 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761555 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761558 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761561 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761564 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761567 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761570 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761573 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761575 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761578 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761581 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761583 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761586 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761589 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761592 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761594 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761597 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761599 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:08.762864 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761602 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761605 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761607 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761610 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761612 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761615 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761618 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761622 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761625 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761629 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761634 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761637 2545 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761640 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761643 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761646 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761649 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761651 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761654 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761657 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:08.763383 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761660 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761662 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761665 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761667 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761670 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761672 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761675 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761677 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761680 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761683 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761686 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761688 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761691 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761693 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761696 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761699 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761701 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761704 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761706 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761709 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:08.763874 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761712 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761716 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761718 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761721 2545 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761724 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761726 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761729 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761731 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761734 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761736 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761739 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761741 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761744 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761746 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761749 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761751 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761754 2545 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761756 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761759 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761762 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:08.764359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761765 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761768 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761771 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.761776 2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761906 2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761912 2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761915 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761918 2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761921 2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761924 2545 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761926 2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761929 2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761933 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761936 2545 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761939 2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761942 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 17:03:08.764882 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761945 2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761947 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761950 2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761953 2545 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761957 2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761961 2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761964 2545 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761967 2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761970 2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761973 2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761975 2545 feature_gate.go:328] unrecognized feature gate: Example May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761978 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761981 2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761984 2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761987 2545 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761990 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761993 2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761995 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.761998 2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762001 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 17:03:08.765276 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762003 2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762006 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762009 2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762011 2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762014 2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762017 2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762019 2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762021 2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762025 2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762027 2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762030 2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762033 2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762036 2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762038 2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762041 2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762043 2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762046 2545 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762049 2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762051 2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 17:03:08.765779 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762054 2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762056 2545 feature_gate.go:328] unrecognized feature gate: Example2 May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762059 2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762061 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762063 2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762066 2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762069 2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762071 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762074 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762077 2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762079 2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762082 2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762084 2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762087 2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762089 2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762092 2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762094 2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762097 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762099 2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762102 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 17:03:08.766254 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762104 2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762107 2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762110 2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762113 2545 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762116 2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762121 2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762124 2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762127 2545 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762129 2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762132 2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762134 2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762137 2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762139 2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762142 2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.762144 2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 17:03:08.766843 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.762149 2545 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 17:03:08.767208 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.762275 2545 server.go:962] "Client rotation is on, will bootstrap in background" May 20 17:03:08.770693 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.770676 2545 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 17:03:08.771948 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.771933 2545 server.go:1019] "Starting client certificate rotation" May 20 17:03:08.772043 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.772031 2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 17:03:08.772079 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.772068 2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 17:03:08.801086 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.801048 2545 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 17:03:08.808526 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.808470 2545 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 17:03:08.821056 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.821034 2545 log.go:25] "Validated CRI v1 runtime API" May 20 17:03:08.825928 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.825909 2545 log.go:25] "Validated CRI v1 image API" May 20 17:03:08.827152 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.827135 2545 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 17:03:08.830118 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.830100 2545 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 17:03:08.831455 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.831436 2545 fs.go:135] Filesystem UUIDs: map[5d693b80-b2d8-4bcd-91b7-5d97fdca24ab:/dev/nvme0n1p4 5e02a204-a348-4ab9-889c-4a34b9b58903:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 20 17:03:08.831503 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.831456 2545 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 17:03:08.835848 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.835741 2545 manager.go:217] Machine: {Timestamp:2026-05-20 17:03:08.835211644 +0000 UTC m=+0.422805776 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099291 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2874bb181595e938dbbc4656876c4a SystemUUID:ec2874bb-1815-95e9-38db-bc4656876c4a BootID:748a4b30-cabe-44ff-b0d5-b10c01834f5b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:86:5e:cd:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:86:5e:cd:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:23:a4:c3:36:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 17:03:08.837100 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.837089 2545 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 17:03:08.837229 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.837217 2545 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 17:03:08.838840 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.838810 2545 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 17:03:08.838979 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.838844 2545 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-136.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 17:03:08.839025 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.838990 2545 topology_manager.go:138] "Creating topology manager with none policy" May 20 17:03:08.839025 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.838998 2545 container_manager_linux.go:306] "Creating device plugin manager" May 20 17:03:08.839025 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.839005 2545 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 17:03:08.839808 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.839798 2545 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 17:03:08.842546 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.842523 2545 state_mem.go:36] "Initialized new in-memory state store" May 20 17:03:08.842668 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.842658 2545 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 17:03:08.844870 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.844859 2545 kubelet.go:491] "Attempting to sync node with API server" May 20 17:03:08.844908 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.844873 2545 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 17:03:08.844908 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.844886 2545 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 17:03:08.844908 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.844895 2545 kubelet.go:397] "Adding apiserver pod source" May 20 17:03:08.844908 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.844904 2545 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 17:03:08.845971 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.845958 2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 17:03:08.846029 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.845983 2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 17:03:08.847621 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.847593 2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p95tg" May 20 17:03:08.848853 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.848837 2545 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 17:03:08.850734 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.850718 2545 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 17:03:08.851526 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851511 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 17:03:08.851612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851550 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 17:03:08.851612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851562 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 17:03:08.851612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851570 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 17:03:08.851612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851582 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 17:03:08.851612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851590 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 17:03:08.851612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851599 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 17:03:08.851612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851608 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 17:03:08.851827 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851619 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 17:03:08.851827 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851637 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 17:03:08.851827 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851655 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 17:03:08.851947 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.851937 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 17:03:08.852688 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.852677 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 17:03:08.852746 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.852690 2545 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 17:03:08.854831 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.854811 2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p95tg" May 20 17:03:08.857303 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.857271 2545 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 17:03:08.857381 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.857334 2545 server.go:1295] "Started kubelet" May 20 17:03:08.857862 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.857833 2545 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 17:03:08.858414 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.857787 2545 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 17:03:08.858462 ip-10-0-135-136 systemd[1]: Started Kubernetes Kubelet. May 20 17:03:08.858849 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.858706 2545 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 17:03:08.859119 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.858887 2545 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 17:03:08.859119 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.858987 2545 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 17:03:08.860652 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.860633 2545 server.go:317] "Adding debug handlers to kubelet server" May 20 17:03:08.862662 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.862502 2545 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 17:03:08.867392 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.867372 2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 17:03:08.867847 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.867827 2545 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 17:03:08.867982 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.867965 2545 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 17:03:08.867982 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.867984 2545 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 17:03:08.868099 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.868067 2545 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 17:03:08.868146 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.868113 2545 reconstruct.go:97] "Volume reconstruction finished" May 20 17:03:08.868146 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.868121 2545 reconciler.go:26] "Reconciler: start to sync state" May 20 17:03:08.869006 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.868988 2545 factory.go:55] Registering systemd factory May 20 17:03:08.869006 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.869010 2545 factory.go:223] Registration of the systemd container factory successfully May 20 17:03:08.869239 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.869222 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:08.870316 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.870298 2545 factory.go:153] Registering CRI-O factory May 20 17:03:08.870316 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.870318 2545 factory.go:223] Registration of the crio container factory successfully May 20 17:03:08.870449 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.870406 2545 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 17:03:08.870449 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.870422 2545 factory.go:103] Registering Raw factory May 20 17:03:08.870449 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.870442 2545 manager.go:1196] Started watching for new ooms in manager May 20 17:03:08.870629 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.870612 2545 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 17:03:08.870848 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.870832 2545 manager.go:319] Starting recovery of all containers May 20 17:03:08.872509 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.872486 2545 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:08.878299 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:08.878263 2545 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.swap.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.swap.max: no such device May 20 17:03:08.881151 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.881132 2545 manager.go:324] Recovery completed May 20 17:03:08.884990 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.884965 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:08.887529 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.887512 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:08.887632 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.887584 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:08.887632 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.887603 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:08.888088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.888074 2545 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 17:03:08.888088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.888086 2545 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 17:03:08.888171 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.888102 2545 state_mem.go:36] "Initialized new in-memory state store" May 20 17:03:08.890467 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.890455 2545 policy_none.go:49] "None policy: Start" May 20 17:03:08.890510 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.890471 2545 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 17:03:08.890510 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.890481 2545 state_mem.go:35] "Initializing new in-memory state store" May 20 17:03:08.893716 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.893702 2545 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-136.ec2.internal" not found May 20 17:03:08.893771 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.893713 2545 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-136.ec2.internal\" not found" node="ip-10-0-135-136.ec2.internal" May 20 17:03:08.912694 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.912674 2545 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-136.ec2.internal" not found May 20 17:03:08.931109 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.931090 2545 manager.go:341] "Starting Device Plugin manager" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.931164 2545 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.931178 2545 server.go:85] "Starting device plugin registration server" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.931403 2545 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.931413 2545 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.931496 2545 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.931592 2545 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.931600 2545 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.932071 2545 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 17:03:08.940580 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.932113 2545 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:08.971320 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.971299 2545 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-135-136.ec2.internal" not found May 20 17:03:08.996353 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.996326 2545 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 17:03:08.997574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.997554 2545 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 17:03:08.997657 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.997580 2545 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 17:03:08.997657 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.997598 2545 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 17:03:08.997657 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:08.997604 2545 kubelet.go:2451] "Starting kubelet main sync loop" May 20 17:03:08.997657 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:08.997642 2545 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 17:03:09.001700 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.001649 2545 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:09.031666 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.031645 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:09.032532 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.032511 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:09.032630 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.032555 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:09.032630 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.032572 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:09.032630 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.032598 2545 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-136.ec2.internal" May 20 17:03:09.041675 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.041662 2545 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-136.ec2.internal" May 20 17:03:09.041716 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.041682 2545 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-136.ec2.internal\": node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.062013 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.061987 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.098260 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.098220 2545 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal"] May 20 17:03:09.098345 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.098321 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:09.099290 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.099271 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:09.099383 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.099301 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:09.099383 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.099314 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:09.100495 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.100483 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:09.101218 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.101202 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:09.101294 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.101231 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:09.101294 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.101241 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:09.101374 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.101309 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:09.101374 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.101334 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:09.101967 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.101954 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:09.102026 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.101979 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:09.102026 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.101993 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:09.102343 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.102330 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" May 20 17:03:09.102400 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.102354 2545 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 17:03:09.102991 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.102973 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientMemory" May 20 17:03:09.103062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.103007 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasNoDiskPressure" May 20 17:03:09.103062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.103022 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeHasSufficientPID" May 20 17:03:09.126164 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.126136 2545 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-136.ec2.internal\" not found" node="ip-10-0-135-136.ec2.internal" May 20 17:03:09.130515 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.130500 2545 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-136.ec2.internal\" not found" node="ip-10-0-135-136.ec2.internal" May 20 17:03:09.162726 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.162705 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.170036 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.170018 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe065db39fc05837d31788eaa3d4c63-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal\" (UID: \"ebe065db39fc05837d31788eaa3d4c63\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:09.170113 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.170047 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/035f728b1f1c4c1d83fcee14f6626c93-config\") pod \"kube-apiserver-proxy-ip-10-0-135-136.ec2.internal\" (UID: \"035f728b1f1c4c1d83fcee14f6626c93\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" May 20 17:03:09.170113 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.170068 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebe065db39fc05837d31788eaa3d4c63-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal\" (UID: \"ebe065db39fc05837d31788eaa3d4c63\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:09.263129 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.263046 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.270357 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.270339 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebe065db39fc05837d31788eaa3d4c63-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal\" (UID: \"ebe065db39fc05837d31788eaa3d4c63\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:09.270414 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.270363 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe065db39fc05837d31788eaa3d4c63-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal\" (UID: \"ebe065db39fc05837d31788eaa3d4c63\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:09.270414 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.270383 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/035f728b1f1c4c1d83fcee14f6626c93-config\") pod \"kube-apiserver-proxy-ip-10-0-135-136.ec2.internal\" (UID: \"035f728b1f1c4c1d83fcee14f6626c93\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" May 20 17:03:09.270475 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.270434 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe065db39fc05837d31788eaa3d4c63-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal\" (UID: \"ebe065db39fc05837d31788eaa3d4c63\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:09.270475 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.270444 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebe065db39fc05837d31788eaa3d4c63-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal\" (UID: \"ebe065db39fc05837d31788eaa3d4c63\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:09.270533 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.270477 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/035f728b1f1c4c1d83fcee14f6626c93-config\") pod \"kube-apiserver-proxy-ip-10-0-135-136.ec2.internal\" (UID: \"035f728b1f1c4c1d83fcee14f6626c93\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" May 20 17:03:09.363828 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.363784 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.429253 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.429222 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:09.434051 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.434030 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" May 20 17:03:09.464399 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.464371 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.564967 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.564878 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.665377 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.665346 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.765857 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.765830 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.771096 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.771076 2545 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 17:03:09.771229 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.771210 2545 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 17:03:09.771268 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.771221 2545 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 17:03:09.857909 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.857822 2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 16:58:08 +0000 UTC" deadline="2027-11-18 15:59:48.856619639 +0000 UTC" May 20 17:03:09.857909 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.857856 2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13126h56m38.998767171s" May 20 17:03:09.865929 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.865905 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.868073 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.868052 2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 17:03:09.885288 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.885265 2545 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 17:03:09.904679 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.904655 2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rktvf" May 20 17:03:09.912058 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:09.912031 2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rktvf" May 20 17:03:09.966394 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:09.966363 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:09.999825 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:09.999789 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe065db39fc05837d31788eaa3d4c63.slice/crio-06f3c104cecbce2dad3499c9498b5042f6a4f40ce63a92e02bea1995ecf1bf3d WatchSource:0}: Error finding container 06f3c104cecbce2dad3499c9498b5042f6a4f40ce63a92e02bea1995ecf1bf3d: Status 404 returned error can't find the container with id 06f3c104cecbce2dad3499c9498b5042f6a4f40ce63a92e02bea1995ecf1bf3d May 20 17:03:10.000161 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:10.000142 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035f728b1f1c4c1d83fcee14f6626c93.slice/crio-81e8da490246b2e147500f67daf1c20c4b55888c8350d9b470fced4341785fc5 WatchSource:0}: Error finding container 81e8da490246b2e147500f67daf1c20c4b55888c8350d9b470fced4341785fc5: Status 404 returned error can't find the container with id 81e8da490246b2e147500f67daf1c20c4b55888c8350d9b470fced4341785fc5 May 20 17:03:10.005596 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.005577 2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:03:10.009679 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.009662 2545 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:10.066460 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.066432 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:10.166946 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.166876 2545 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-136.ec2.internal\" not found" May 20 17:03:10.230763 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.230729 2545 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:10.268391 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.268370 2545 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" May 20 17:03:10.282491 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.282471 2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 17:03:10.283389 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.283378 2545 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" May 20 17:03:10.290503 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.290491 2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 17:03:10.672001 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.671973 2545 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:10.846425 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.846394 2545 apiserver.go:52] "Watching apiserver" May 20 17:03:10.854369 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.854340 2545 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 17:03:10.854933 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.854902 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ch42w","kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal","openshift-cluster-node-tuning-operator/tuned-k42s9","openshift-image-registry/node-ca-h62bc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal","openshift-multus/multus-w6sll","openshift-multus/network-metrics-daemon-vlk94","openshift-network-diagnostics/network-check-target-xs58h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd","openshift-dns/node-resolver-tg8m9","openshift-multus/multus-additional-cni-plugins-msd8z","openshift-network-operator/iptables-alerter-6mljc","openshift-ovn-kubernetes/ovnkube-node-kqnwd"] May 20 17:03:10.856446 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.856425 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:10.856557 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.856512 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:10.858548 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.858518 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.858631 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.858520 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.859697 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.859667 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w6sll" May 20 17:03:10.860652 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.860620 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-svncz\"" May 20 17:03:10.860765 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.860709 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 17:03:10.861402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.861039 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 17:03:10.861402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.861118 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 17:03:10.861402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.861163 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 17:03:10.861402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.861351 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wb6jg\"" May 20 17:03:10.861402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.861378 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 17:03:10.861812 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.861740 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 17:03:10.862663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.862002 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 17:03:10.862663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.862186 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 17:03:10.862663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.862269 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 17:03:10.862663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.862289 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:10.862663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.862426 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lc7wt\"" May 20 17:03:10.863640 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.863611 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:10.863727 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.863697 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:10.863788 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.863724 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.864326 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.864310 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 17:03:10.864416 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.864317 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 17:03:10.864817 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.864749 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sp787\"" May 20 17:03:10.865450 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.865118 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.865558 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.865460 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 17:03:10.865796 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.865777 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 17:03:10.865889 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.865843 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bvbgl\"" May 20 17:03:10.866071 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.866050 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 17:03:10.867244 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.866850 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 17:03:10.867244 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.867017 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 17:03:10.867244 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.867095 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g2sbp\"" May 20 17:03:10.868495 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.868418 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.870080 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.870061 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.870394 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.870381 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.871367 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.871346 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-87m2k\"" May 20 17:03:10.872834 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.872602 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 17:03:10.872834 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.872680 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 17:03:10.873097 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.873039 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 17:03:10.873404 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.873331 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 17:03:10.874440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.874113 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s6czm\"" May 20 17:03:10.874440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.874123 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 17:03:10.874440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.874307 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 17:03:10.874440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.874346 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 17:03:10.874440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.874361 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 17:03:10.875708 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.874975 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 17:03:10.875708 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.875106 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 17:03:10.875708 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.875310 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 17:03:10.875708 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.875516 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wxzqs\"" May 20 17:03:10.878061 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878013 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-run-netns\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.878061 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878047 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-etc-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.878211 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878091 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-socket-dir-parent\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.878211 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878156 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-599qn\" (UniqueName: \"kubernetes.io/projected/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-kube-api-access-599qn\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.878310 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878183 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.878310 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878236 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-env-overrides\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.878310 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878260 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-modprobe-d\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.878310 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878304 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f5be0ce-186e-4792-a6d3-fe8b1f49789f-konnectivity-ca\") pod \"konnectivity-agent-ch42w\" (UID: \"8f5be0ce-186e-4792-a6d3-fe8b1f49789f\") " pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:10.878499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878338 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:10.878499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878362 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f664acff-5fc0-45b9-ac7e-e9cc03511eda-hosts-file\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.878499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878384 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-slash\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.878499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878406 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-kubelet\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.878499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878432 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-tuning-conf-dir\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.878499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878469 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovn-node-metrics-cert\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.878499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878493 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bce41ae5-70cb-40d1-8452-344447620c00-host-slash\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878515 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-host\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878555 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v869w\" (UniqueName: \"kubernetes.io/projected/94bd6556-64ba-4f32-9512-69f0b4fe607c-kube-api-access-v869w\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878580 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878605 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-system-cni-dir\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878630 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-cni-binary-copy\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878678 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-socket-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878701 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-ovn\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878723 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-k8s-cni-cncf-io\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878748 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-etc-kubernetes\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878771 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-registration-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878794 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878819 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94bd6556-64ba-4f32-9512-69f0b4fe607c-host\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.878844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878842 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-tuned\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878871 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878910 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bce41ae5-70cb-40d1-8452-344447620c00-iptables-alerter-script\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878933 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-kubelet\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878957 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-cni-netd\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.878980 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-hostroot\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879001 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879036 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-systemd\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879066 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f5be0ce-186e-4792-a6d3-fe8b1f49789f-agent-certs\") pod \"konnectivity-agent-ch42w\" (UID: \"8f5be0ce-186e-4792-a6d3-fe8b1f49789f\") " pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879087 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-var-lib-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879108 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-device-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879127 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovnkube-config\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879189 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-kubernetes\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879215 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-sys\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879245 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mlwp\" (UniqueName: \"kubernetes.io/projected/f664acff-5fc0-45b9-ac7e-e9cc03511eda-kube-api-access-6mlwp\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879269 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-node-log\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.879642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879292 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-cni-bin\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879315 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-sys-fs\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879338 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-cnibin\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879362 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovnkube-script-lib\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879388 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx9gg\" (UniqueName: \"kubernetes.io/projected/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-kube-api-access-lx9gg\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879417 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-system-cni-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879442 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh5kk\" (UniqueName: \"kubernetes.io/projected/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-kube-api-access-rh5kk\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879464 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879487 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-conf-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879510 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-tmp\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879550 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879575 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-os-release\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879602 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879657 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-run\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879682 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysctl-d\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879707 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94bd6556-64ba-4f32-9512-69f0b4fe607c-serviceca\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.880368 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879730 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-daemon-config\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879770 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8r4d\" (UniqueName: \"kubernetes.io/projected/c24478cd-e524-4473-9f0d-efdc5e87179d-kube-api-access-r8r4d\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879816 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-systemd\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879844 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-os-release\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879869 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-multus-certs\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879895 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwnh\" (UniqueName: \"kubernetes.io/projected/21556815-5e21-466a-b843-8f508e891694-kube-api-access-9zwnh\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879920 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f664acff-5fc0-45b9-ac7e-e9cc03511eda-tmp-dir\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879944 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwp92\" (UniqueName: \"kubernetes.io/projected/bce41ae5-70cb-40d1-8452-344447620c00-kube-api-access-hwp92\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879968 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-var-lib-kubelet\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.879991 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-systemd-units\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880014 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-log-socket\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880037 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zws8v\" (UniqueName: \"kubernetes.io/projected/064653ee-ac31-45f8-9a7b-1cd046e1799d-kube-api-access-zws8v\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880061 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-cni-binary-copy\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880084 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-cni-multus\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880116 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysconfig\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880144 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-lib-modules\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.881066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880167 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-cni-bin\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.881567 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880205 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-cnibin\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.881567 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880228 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-netns\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.881567 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880276 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-cni-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.881567 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.880302 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysctl-conf\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.882134 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.882119 2545 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 17:03:10.913294 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.913259 2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 16:58:09 +0000 UTC" deadline="2028-02-02 11:13:50.152276804 +0000 UTC" May 20 17:03:10.913294 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.913292 2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14946h10m39.238988381s" May 20 17:03:10.969383 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.969311 2545 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 17:03:10.981118 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981088 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-system-cni-dir\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.981284 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981129 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-cni-binary-copy\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.981284 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981153 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-socket-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.981284 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981210 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-system-cni-dir\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.981440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981348 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-socket-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.981440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981386 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-ovn\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.981440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981414 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-k8s-cni-cncf-io\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.981440 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981431 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-etc-kubernetes\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981445 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-registration-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981460 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981475 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94bd6556-64ba-4f32-9512-69f0b4fe607c-host\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981488 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-tuned\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981510 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981533 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bce41ae5-70cb-40d1-8452-344447620c00-iptables-alerter-script\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981568 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-kubelet\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981584 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-cni-netd\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981599 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-hostroot\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981613 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981628 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-systemd\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.981656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981642 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f5be0ce-186e-4792-a6d3-fe8b1f49789f-agent-certs\") pod \"konnectivity-agent-ch42w\" (UID: \"8f5be0ce-186e-4792-a6d3-fe8b1f49789f\") " pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981673 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-var-lib-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981717 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-ovn\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981765 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-device-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981786 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-cni-binary-copy\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981802 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovnkube-config\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981826 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-kubernetes\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981823 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-k8s-cni-cncf-io\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981853 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-sys\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981859 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-device-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981888 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mlwp\" (UniqueName: \"kubernetes.io/projected/f664acff-5fc0-45b9-ac7e-e9cc03511eda-kube-api-access-6mlwp\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981890 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-hostroot\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981910 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-sys\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981915 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-node-log\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981932 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-kubelet\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981943 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-cni-bin\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981967 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-sys-fs\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981977 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-cni-netd\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981976 2545 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.981992 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-cnibin\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982016 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovnkube-script-lib\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982029 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-kubernetes\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982040 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx9gg\" (UniqueName: \"kubernetes.io/projected/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-kube-api-access-lx9gg\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982067 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-system-cni-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982071 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-systemd\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982094 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rh5kk\" (UniqueName: \"kubernetes.io/projected/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-kube-api-access-rh5kk\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982105 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982118 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982141 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-conf-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982161 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bce41ae5-70cb-40d1-8452-344447620c00-iptables-alerter-script\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982165 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-tmp\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982183 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982190 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-registration-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982213 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982242 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-os-release\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.982806 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982258 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94bd6556-64ba-4f32-9512-69f0b4fe607c-host\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982268 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982294 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-run\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982319 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysctl-d\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982343 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94bd6556-64ba-4f32-9512-69f0b4fe607c-serviceca\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982392 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-daemon-config\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982416 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8r4d\" (UniqueName: \"kubernetes.io/projected/c24478cd-e524-4473-9f0d-efdc5e87179d-kube-api-access-r8r4d\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982438 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-systemd\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982440 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovnkube-config\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982466 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-os-release\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982492 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-multus-certs\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982501 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-cni-bin\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982516 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwnh\" (UniqueName: \"kubernetes.io/projected/21556815-5e21-466a-b843-8f508e891694-kube-api-access-9zwnh\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982558 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-node-log\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982566 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f664acff-5fc0-45b9-ac7e-e9cc03511eda-tmp-dir\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982586 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-sys-fs\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982604 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwp92\" (UniqueName: \"kubernetes.io/projected/bce41ae5-70cb-40d1-8452-344447620c00-kube-api-access-hwp92\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.983519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982628 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-cnibin\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982632 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-var-lib-kubelet\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982654 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-systemd-units\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982680 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-log-socket\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982707 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-os-release\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982707 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zws8v\" (UniqueName: \"kubernetes.io/projected/064653ee-ac31-45f8-9a7b-1cd046e1799d-kube-api-access-zws8v\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982745 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-cni-binary-copy\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982770 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-cni-multus\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982795 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysconfig\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982819 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-lib-modules\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982845 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-cni-bin\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982869 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-cnibin\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982894 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-netns\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982920 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-cni-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982947 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysctl-conf\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982971 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-run-netns\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982995 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-etc-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983019 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-socket-dir-parent\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.984283 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983045 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-599qn\" (UniqueName: \"kubernetes.io/projected/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-kube-api-access-599qn\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983050 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983071 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983096 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-env-overrides\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983119 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-log-socket\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983126 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-modprobe-d\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983156 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f5be0ce-186e-4792-a6d3-fe8b1f49789f-konnectivity-ca\") pod \"konnectivity-agent-ch42w\" (UID: \"8f5be0ce-186e-4792-a6d3-fe8b1f49789f\") " pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983181 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983202 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f664acff-5fc0-45b9-ac7e-e9cc03511eda-hosts-file\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983228 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-slash\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983230 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-modprobe-d\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983253 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-kubelet\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.982682 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysctl-d\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983116 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94bd6556-64ba-4f32-9512-69f0b4fe607c-serviceca\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.983298 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983357 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-run-systemd\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983436 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-os-release\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983480 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-multus-certs\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983503 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovnkube-script-lib\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983550 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f664acff-5fc0-45b9-ac7e-e9cc03511eda-hosts-file\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983573 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-var-lib-kubelet\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983600 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-slash\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983609 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-var-lib-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983651 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-conf-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983698 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-system-cni-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983770 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/21556815-5e21-466a-b843-8f508e891694-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983823 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-cni-multus\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983825 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-etc-openvswitch\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983872 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-socket-dir-parent\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983879 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysconfig\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983929 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c24478cd-e524-4473-9f0d-efdc5e87179d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983959 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-lib-modules\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.983963 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-systemd-units\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984141 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-cni-binary-copy\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984196 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984198 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-run\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.985769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984236 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-cni-bin\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984239 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-run-netns\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984267 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-run-netns\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984553 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f664acff-5fc0-45b9-ac7e-e9cc03511eda-tmp-dir\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984632 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-env-overrides\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984661 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-daemon-config\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984691 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-sysctl-conf\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984710 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-host-var-lib-kubelet\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984713 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-tuning-conf-dir\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984741 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-multus-cni-dir\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984771 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovn-node-metrics-cert\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984802 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bce41ae5-70cb-40d1-8452-344447620c00-host-slash\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984818 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21556815-5e21-466a-b843-8f508e891694-tuning-conf-dir\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.984844 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:03:11.484804895 +0000 UTC m=+3.072399033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984871 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bce41ae5-70cb-40d1-8452-344447620c00-host-slash\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984875 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-cnibin\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.984878 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f5be0ce-186e-4792-a6d3-fe8b1f49789f-konnectivity-ca\") pod \"konnectivity-agent-ch42w\" (UID: \"8f5be0ce-186e-4792-a6d3-fe8b1f49789f\") " pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:10.986530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985000 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-host\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.987312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985032 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v869w\" (UniqueName: \"kubernetes.io/projected/94bd6556-64ba-4f32-9512-69f0b4fe607c-kube-api-access-v869w\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.987312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985072 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.987312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985153 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.987312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985209 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-host\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.987312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985232 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-etc-kubernetes\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.987312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985526 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-tmp\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.987312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985662 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-etc-tuned\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.987312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.985765 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f5be0ce-186e-4792-a6d3-fe8b1f49789f-agent-certs\") pod \"konnectivity-agent-ch42w\" (UID: \"8f5be0ce-186e-4792-a6d3-fe8b1f49789f\") " pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:10.987793 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.987462 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-ovn-node-metrics-cert\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.992421 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.992399 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:03:10.992603 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.992425 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:03:10.992603 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.992439 2545 projected.go:194] Error preparing data for projected volume kube-api-access-zbk2l for pod openshift-network-diagnostics/network-check-target-xs58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:10.992603 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:10.992509 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l podName:6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:11.492492565 +0000 UTC m=+3.080086683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zbk2l" (UniqueName: "kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l") pod "network-check-target-xs58h" (UID: "6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:10.994137 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.993965 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zws8v\" (UniqueName: \"kubernetes.io/projected/064653ee-ac31-45f8-9a7b-1cd046e1799d-kube-api-access-zws8v\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:10.994240 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.994219 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mlwp\" (UniqueName: \"kubernetes.io/projected/f664acff-5fc0-45b9-ac7e-e9cc03511eda-kube-api-access-6mlwp\") pod \"node-resolver-tg8m9\" (UID: \"f664acff-5fc0-45b9-ac7e-e9cc03511eda\") " pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:10.995435 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.995381 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx9gg\" (UniqueName: \"kubernetes.io/projected/c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff-kube-api-access-lx9gg\") pod \"ovnkube-node-kqnwd\" (UID: \"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:10.995784 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.995749 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwnh\" (UniqueName: \"kubernetes.io/projected/21556815-5e21-466a-b843-8f508e891694-kube-api-access-9zwnh\") pod \"multus-additional-cni-plugins-msd8z\" (UID: \"21556815-5e21-466a-b843-8f508e891694\") " pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:10.995883 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.995863 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-599qn\" (UniqueName: \"kubernetes.io/projected/c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4-kube-api-access-599qn\") pod \"multus-w6sll\" (UID: \"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4\") " pod="openshift-multus/multus-w6sll" May 20 17:03:10.996120 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.996093 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh5kk\" (UniqueName: \"kubernetes.io/projected/fbeda25a-ba37-491d-bbe4-2920c5fe75e0-kube-api-access-rh5kk\") pod \"tuned-k42s9\" (UID: \"fbeda25a-ba37-491d-bbe4-2920c5fe75e0\") " pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:10.996840 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.996822 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8r4d\" (UniqueName: \"kubernetes.io/projected/c24478cd-e524-4473-9f0d-efdc5e87179d-kube-api-access-r8r4d\") pod \"aws-ebs-csi-driver-node-fd2qd\" (UID: \"c24478cd-e524-4473-9f0d-efdc5e87179d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:10.997707 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.997687 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v869w\" (UniqueName: \"kubernetes.io/projected/94bd6556-64ba-4f32-9512-69f0b4fe607c-kube-api-access-v869w\") pod \"node-ca-h62bc\" (UID: \"94bd6556-64ba-4f32-9512-69f0b4fe607c\") " pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:10.997878 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:10.997850 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwp92\" (UniqueName: \"kubernetes.io/projected/bce41ae5-70cb-40d1-8452-344447620c00-kube-api-access-hwp92\") pod \"iptables-alerter-6mljc\" (UID: \"bce41ae5-70cb-40d1-8452-344447620c00\") " pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:11.001805 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.001761 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" event={"ID":"ebe065db39fc05837d31788eaa3d4c63","Type":"ContainerStarted","Data":"06f3c104cecbce2dad3499c9498b5042f6a4f40ce63a92e02bea1995ecf1bf3d"} May 20 17:03:11.002758 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.002733 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" event={"ID":"035f728b1f1c4c1d83fcee14f6626c93","Type":"ContainerStarted","Data":"81e8da490246b2e147500f67daf1c20c4b55888c8350d9b470fced4341785fc5"} May 20 17:03:11.175384 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.175350 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k42s9" May 20 17:03:11.183152 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.183119 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h62bc" May 20 17:03:11.189844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.189819 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w6sll" May 20 17:03:11.194434 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.194409 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:11.199970 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.199947 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" May 20 17:03:11.207515 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.207496 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tg8m9" May 20 17:03:11.213024 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.212998 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-msd8z" May 20 17:03:11.219696 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.219637 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:11.225266 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.225245 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6mljc" May 20 17:03:11.488164 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.488085 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:11.488344 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:11.488210 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:11.488344 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:11.488262 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:03:12.488249433 +0000 UTC m=+4.075843550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:11.588975 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.588931 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:11.589149 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:11.589127 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:03:11.589149 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:11.589149 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:03:11.589262 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:11.589163 2545 projected.go:194] Error preparing data for projected volume kube-api-access-zbk2l for pod openshift-network-diagnostics/network-check-target-xs58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:11.589262 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:11.589235 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l podName:6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:12.589215756 +0000 UTC m=+4.176809875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbk2l" (UniqueName: "kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l") pod "network-check-target-xs58h" (UID: "6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:11.640715 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:11.640416 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06ebdbb_4f39_40a4_9d0b_e26a377b4cf4.slice/crio-f23a70a164ae270b774737f339b16a8a9748615bdb419975b26574b1609d5b11 WatchSource:0}: Error finding container f23a70a164ae270b774737f339b16a8a9748615bdb419975b26574b1609d5b11: Status 404 returned error can't find the container with id f23a70a164ae270b774737f339b16a8a9748615bdb419975b26574b1609d5b11 May 20 17:03:11.643624 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:11.643594 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce41ae5_70cb_40d1_8452_344447620c00.slice/crio-5a92b0c6b0092785413a02740e6acd2f67598b431062d8d28cc25ececc96435f WatchSource:0}: Error finding container 5a92b0c6b0092785413a02740e6acd2f67598b431062d8d28cc25ececc96435f: Status 404 returned error can't find the container with id 5a92b0c6b0092785413a02740e6acd2f67598b431062d8d28cc25ececc96435f May 20 17:03:11.644451 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:11.644425 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5be0ce_186e_4792_a6d3_fe8b1f49789f.slice/crio-61c6bdb5fdbc241427a48da532ea876b1887d87729e2974571e3ebcd441acf6a WatchSource:0}: Error finding container 61c6bdb5fdbc241427a48da532ea876b1887d87729e2974571e3ebcd441acf6a: Status 404 returned error can't find the container with id 61c6bdb5fdbc241427a48da532ea876b1887d87729e2974571e3ebcd441acf6a May 20 17:03:11.646265 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:11.646239 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf664acff_5fc0_45b9_ac7e_e9cc03511eda.slice/crio-1be1014f518102365f7a1f053a52f4a05fba23848cec392116368038b84da4e0 WatchSource:0}: Error finding container 1be1014f518102365f7a1f053a52f4a05fba23848cec392116368038b84da4e0: Status 404 returned error can't find the container with id 1be1014f518102365f7a1f053a52f4a05fba23848cec392116368038b84da4e0 May 20 17:03:11.646987 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:11.646969 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bd6556_64ba_4f32_9512_69f0b4fe607c.slice/crio-3c6e968db00e469905547b2b0a153c4b1f07d178d882eaa3100910ca1a370acb WatchSource:0}: Error finding container 3c6e968db00e469905547b2b0a153c4b1f07d178d882eaa3100910ca1a370acb: Status 404 returned error can't find the container with id 3c6e968db00e469905547b2b0a153c4b1f07d178d882eaa3100910ca1a370acb May 20 17:03:11.647989 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:11.647965 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24478cd_e524_4473_9f0d_efdc5e87179d.slice/crio-fced45d6b37f53bd8efc5df2bc1495f7c9cedd341d36801dcf959b653dcd00ed WatchSource:0}: Error finding container fced45d6b37f53bd8efc5df2bc1495f7c9cedd341d36801dcf959b653dcd00ed: Status 404 returned error can't find the container with id fced45d6b37f53bd8efc5df2bc1495f7c9cedd341d36801dcf959b653dcd00ed May 20 17:03:11.649025 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:11.649005 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7173ba0_3ad2_4b0b_84c0_1d5d726dd4ff.slice/crio-b64a01758294e20d729fb41b89f3042ca12d214b82cf032336397b961a5390b1 WatchSource:0}: Error finding container b64a01758294e20d729fb41b89f3042ca12d214b82cf032336397b961a5390b1: Status 404 returned error can't find the container with id b64a01758294e20d729fb41b89f3042ca12d214b82cf032336397b961a5390b1 May 20 17:03:11.650359 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:03:11.650338 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbeda25a_ba37_491d_bbe4_2920c5fe75e0.slice/crio-dff76c5977837cdd854ca3baae1eaf61db163f544f82509a0e2b7046274c944b WatchSource:0}: Error finding container dff76c5977837cdd854ca3baae1eaf61db163f544f82509a0e2b7046274c944b: Status 404 returned error can't find the container with id dff76c5977837cdd854ca3baae1eaf61db163f544f82509a0e2b7046274c944b May 20 17:03:11.913900 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.913871 2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 16:58:09 +0000 UTC" deadline="2027-11-12 10:08:16.484206541 +0000 UTC" May 20 17:03:11.913900 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.913897 2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12977h5m4.570312364s" May 20 17:03:11.997930 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.997898 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:11.997930 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:11.997926 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:11.998153 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:11.998011 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:11.998153 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:11.998136 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:12.005659 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.005632 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k42s9" event={"ID":"fbeda25a-ba37-491d-bbe4-2920c5fe75e0","Type":"ContainerStarted","Data":"dff76c5977837cdd854ca3baae1eaf61db163f544f82509a0e2b7046274c944b"} May 20 17:03:12.006715 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.006691 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ch42w" event={"ID":"8f5be0ce-186e-4792-a6d3-fe8b1f49789f","Type":"ContainerStarted","Data":"61c6bdb5fdbc241427a48da532ea876b1887d87729e2974571e3ebcd441acf6a"} May 20 17:03:12.007738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.007719 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"b64a01758294e20d729fb41b89f3042ca12d214b82cf032336397b961a5390b1"} May 20 17:03:12.008637 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.008610 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h62bc" event={"ID":"94bd6556-64ba-4f32-9512-69f0b4fe607c","Type":"ContainerStarted","Data":"3c6e968db00e469905547b2b0a153c4b1f07d178d882eaa3100910ca1a370acb"} May 20 17:03:12.009372 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.009347 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" event={"ID":"c24478cd-e524-4473-9f0d-efdc5e87179d","Type":"ContainerStarted","Data":"fced45d6b37f53bd8efc5df2bc1495f7c9cedd341d36801dcf959b653dcd00ed"} May 20 17:03:12.010177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.010158 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tg8m9" event={"ID":"f664acff-5fc0-45b9-ac7e-e9cc03511eda","Type":"ContainerStarted","Data":"1be1014f518102365f7a1f053a52f4a05fba23848cec392116368038b84da4e0"} May 20 17:03:12.011049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.011022 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6mljc" event={"ID":"bce41ae5-70cb-40d1-8452-344447620c00","Type":"ContainerStarted","Data":"5a92b0c6b0092785413a02740e6acd2f67598b431062d8d28cc25ececc96435f"} May 20 17:03:12.012613 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.012593 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" event={"ID":"035f728b1f1c4c1d83fcee14f6626c93","Type":"ContainerStarted","Data":"595d0b7d964946172b3f3c3a4641062f8fcf1c83275bc215aaffb7f8def0f142"} May 20 17:03:12.013557 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.013511 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msd8z" event={"ID":"21556815-5e21-466a-b843-8f508e891694","Type":"ContainerStarted","Data":"8d46f867562605d65ef60681dbc5f17ba7a00414ac56d3d9c82048b5c7b0bf46"} May 20 17:03:12.014308 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.014289 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w6sll" event={"ID":"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4","Type":"ContainerStarted","Data":"f23a70a164ae270b774737f339b16a8a9748615bdb419975b26574b1609d5b11"} May 20 17:03:12.015732 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.015711 2545 generic.go:358] "Generic (PLEG): container finished" podID="ebe065db39fc05837d31788eaa3d4c63" containerID="50d05c921440f1af5a8c39383512ed7b4d8170a38bcc3778b78adb419bff7005" exitCode=0 May 20 17:03:12.015817 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.015739 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" event={"ID":"ebe065db39fc05837d31788eaa3d4c63","Type":"ContainerDied","Data":"50d05c921440f1af5a8c39383512ed7b4d8170a38bcc3778b78adb419bff7005"} May 20 17:03:12.025604 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.025558 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-136.ec2.internal" podStartSLOduration=2.025526526 podStartE2EDuration="2.025526526s" podCreationTimestamp="2026-05-20 17:03:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:03:12.025095546 +0000 UTC m=+3.612689687" watchObservedRunningTime="2026-05-20 17:03:12.025526526 +0000 UTC m=+3.613120667" May 20 17:03:12.495829 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.495739 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:12.496003 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:12.495880 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:12.496003 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:12.495943 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:03:14.495923728 +0000 UTC m=+6.083517852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:12.596903 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:12.596864 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:12.597084 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:12.597016 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:03:12.597084 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:12.597039 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:03:12.597084 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:12.597052 2545 projected.go:194] Error preparing data for projected volume kube-api-access-zbk2l for pod openshift-network-diagnostics/network-check-target-xs58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:12.597282 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:12.597111 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l podName:6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:14.597090754 +0000 UTC m=+6.184684878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbk2l" (UniqueName: "kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l") pod "network-check-target-xs58h" (UID: "6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:13.042468 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:13.042097 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" event={"ID":"ebe065db39fc05837d31788eaa3d4c63","Type":"ContainerStarted","Data":"513a3a756a6cd8fbbe68b95711f2b41f30fd51dbf0b8bf811b93985eebe48c23"} May 20 17:03:13.057092 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:13.057040 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-136.ec2.internal" podStartSLOduration=3.0570210270000002 podStartE2EDuration="3.057021027s" podCreationTimestamp="2026-05-20 17:03:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:03:13.056934092 +0000 UTC m=+4.644528231" watchObservedRunningTime="2026-05-20 17:03:13.057021027 +0000 UTC m=+4.644615169" May 20 17:03:13.998423 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:13.998386 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:13.998638 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:13.998523 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:13.999049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:13.999030 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:13.999211 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:13.999140 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:14.518585 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:14.517971 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:14.518585 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:14.518147 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:14.518585 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:14.518214 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:03:18.518196506 +0000 UTC m=+10.105790626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:14.619259 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:14.618529 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:14.619259 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:14.618747 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:03:14.619259 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:14.618766 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:03:14.619259 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:14.618790 2545 projected.go:194] Error preparing data for projected volume kube-api-access-zbk2l for pod openshift-network-diagnostics/network-check-target-xs58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:14.619259 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:14.618849 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l podName:6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:18.618831147 +0000 UTC m=+10.206425268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbk2l" (UniqueName: "kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l") pod "network-check-target-xs58h" (UID: "6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:15.998338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:15.998250 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:15.998797 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:15.998392 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:15.998797 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:15.998583 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:15.998797 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:15.998682 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:17.998234 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:17.998193 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:17.998716 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:17.998193 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:17.998716 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:17.998352 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:17.998716 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:17.998401 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:18.553255 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:18.553219 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:18.553442 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:18.553400 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:18.553498 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:18.553468 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:03:26.553450173 +0000 UTC m=+18.141044302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:18.654273 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:18.654237 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:18.654459 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:18.654393 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:03:18.654459 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:18.654414 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:03:18.654459 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:18.654427 2545 projected.go:194] Error preparing data for projected volume kube-api-access-zbk2l for pod openshift-network-diagnostics/network-check-target-xs58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:18.654638 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:18.654481 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l podName:6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:26.654463223 +0000 UTC m=+18.242057353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbk2l" (UniqueName: "kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l") pod "network-check-target-xs58h" (UID: "6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:19.998010 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:19.997974 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:19.998452 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:19.998119 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:19.998452 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:19.998150 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:19.998452 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:19.998254 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:21.998656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:21.998616 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:21.999081 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:21.998616 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:21.999081 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:21.998732 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:21.999081 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:21.998870 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:23.998610 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:23.998566 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:23.999121 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:23.998579 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:23.999121 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:23.998691 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:23.999121 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:23.998763 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:25.998117 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:25.998082 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:25.998562 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:25.998083 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:25.998562 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:25.998196 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:25.998562 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:25.998300 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:26.618857 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:26.618820 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:26.619043 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:26.618992 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:26.619096 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:26.619063 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:03:42.619044052 +0000 UTC m=+34.206638188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:26.719385 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:26.719350 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:26.719572 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:26.719549 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:03:26.719615 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:26.719578 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:03:26.719615 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:26.719593 2545 projected.go:194] Error preparing data for projected volume kube-api-access-zbk2l for pod openshift-network-diagnostics/network-check-target-xs58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:26.719694 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:26.719655 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l podName:6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:42.719638143 +0000 UTC m=+34.307232261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbk2l" (UniqueName: "kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l") pod "network-check-target-xs58h" (UID: "6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:27.998038 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:27.998009 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:27.998448 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:27.998011 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:27.998448 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:27.998123 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:27.998448 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:27.998227 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:29.998654 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:29.998493 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:29.999206 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:29.998505 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:29.999206 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:29.998736 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:29.999206 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:29.998814 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:30.079173 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.079145 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k42s9" event={"ID":"fbeda25a-ba37-491d-bbe4-2920c5fe75e0","Type":"ContainerStarted","Data":"202bcbd0687ab7ff08dd30bc253bcb6b456c4320dae0de88c24a1eac3a4901a5"} May 20 17:03:30.080344 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.080316 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ch42w" event={"ID":"8f5be0ce-186e-4792-a6d3-fe8b1f49789f","Type":"ContainerStarted","Data":"cee95b02053235f27ced3711c2b5d06b5ef12380015e41cc16ea3277d8548b27"} May 20 17:03:30.082107 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.082091 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:03:30.082407 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.082344 2545 generic.go:358] "Generic (PLEG): container finished" podID="c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff" containerID="1966be3dfd43c09b64b925a0b7f8354c0c7d1ac2ee28beb30cf94e03e8ff937a" exitCode=1 May 20 17:03:30.082455 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.082403 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"1242ff079f62b7f31b5aa21dc847d0f4046cf6b7dd2fbd0d41baffa8359fa435"} May 20 17:03:30.082455 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.082422 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"16d5baebe989e50f4091eeab80135a73f66b8545f626326430278bc58dfa18f1"} May 20 17:03:30.082455 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.082431 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"00423065a2fd471ac9ab58b0a0a2fe06f5bf4b8acdbd27f1f0b301ea581a50dc"} May 20 17:03:30.082455 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.082439 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerDied","Data":"1966be3dfd43c09b64b925a0b7f8354c0c7d1ac2ee28beb30cf94e03e8ff937a"} May 20 17:03:30.082455 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.082450 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"9a62bf2b2d9b75235d4c687b111097ba967dd7872e359354e21ab802ba3ac1f9"} May 20 17:03:30.083641 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.083621 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h62bc" event={"ID":"94bd6556-64ba-4f32-9512-69f0b4fe607c","Type":"ContainerStarted","Data":"d0da539d057ae2b20168702439b3d2710ccaf773b1d9aa3ec5d608f39b28c41c"} May 20 17:03:30.084752 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.084722 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" event={"ID":"c24478cd-e524-4473-9f0d-efdc5e87179d","Type":"ContainerStarted","Data":"7ec360d0ec0bde0f06439445c07b601043ff53eb4f0542d222df201f0eccede7"} May 20 17:03:30.085720 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.085703 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tg8m9" event={"ID":"f664acff-5fc0-45b9-ac7e-e9cc03511eda","Type":"ContainerStarted","Data":"69b470776e5ed488cd5dbc11a75f37dd75c9cc96807a0118fb4dc934d3550667"} May 20 17:03:30.086908 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.086884 2545 generic.go:358] "Generic (PLEG): container finished" podID="21556815-5e21-466a-b843-8f508e891694" containerID="560c31caca4540c3cefe4634c4c35c256d8e0ea7fec48503c2a2a3a10a3d95d9" exitCode=0 May 20 17:03:30.086988 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.086957 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msd8z" event={"ID":"21556815-5e21-466a-b843-8f508e891694","Type":"ContainerDied","Data":"560c31caca4540c3cefe4634c4c35c256d8e0ea7fec48503c2a2a3a10a3d95d9"} May 20 17:03:30.088111 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.088088 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w6sll" event={"ID":"c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4","Type":"ContainerStarted","Data":"55352743d8c625eec0a9dc20035e5bfa44de472a3ea85e842ae2aad60f93a043"} May 20 17:03:30.097377 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.097333 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k42s9" podStartSLOduration=3.52587318 podStartE2EDuration="21.097319586s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.65697043 +0000 UTC m=+3.244564562" lastFinishedPulling="2026-05-20 17:03:29.228416833 +0000 UTC m=+20.816010968" observedRunningTime="2026-05-20 17:03:30.097153089 +0000 UTC m=+21.684747241" watchObservedRunningTime="2026-05-20 17:03:30.097319586 +0000 UTC m=+21.684913742" May 20 17:03:30.124711 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.124663 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h62bc" podStartSLOduration=3.596006304 podStartE2EDuration="21.124647947s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.649274213 +0000 UTC m=+3.236868333" lastFinishedPulling="2026-05-20 17:03:29.177915854 +0000 UTC m=+20.765509976" observedRunningTime="2026-05-20 17:03:30.109235913 +0000 UTC m=+21.696830067" watchObservedRunningTime="2026-05-20 17:03:30.124647947 +0000 UTC m=+21.712242088" May 20 17:03:30.124830 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.124802 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-w6sll" podStartSLOduration=3.5029239519999997 podStartE2EDuration="21.124793647s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.642366798 +0000 UTC m=+3.229960930" lastFinishedPulling="2026-05-20 17:03:29.264236504 +0000 UTC m=+20.851830625" observedRunningTime="2026-05-20 17:03:30.124268344 +0000 UTC m=+21.711862485" watchObservedRunningTime="2026-05-20 17:03:30.124793647 +0000 UTC m=+21.712387789" May 20 17:03:30.154225 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.154179 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-tg8m9" podStartSLOduration=3.574349732 podStartE2EDuration="21.154163063s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.648604562 +0000 UTC m=+3.236198691" lastFinishedPulling="2026-05-20 17:03:29.228417898 +0000 UTC m=+20.816012022" observedRunningTime="2026-05-20 17:03:30.153782112 +0000 UTC m=+21.741376255" watchObservedRunningTime="2026-05-20 17:03:30.154163063 +0000 UTC m=+21.741757204" May 20 17:03:30.154552 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.154507 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ch42w" podStartSLOduration=3.6226454329999997 podStartE2EDuration="21.154502013s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.646266242 +0000 UTC m=+3.233860360" lastFinishedPulling="2026-05-20 17:03:29.178122809 +0000 UTC m=+20.765716940" observedRunningTime="2026-05-20 17:03:30.13950389 +0000 UTC m=+21.727098032" watchObservedRunningTime="2026-05-20 17:03:30.154502013 +0000 UTC m=+21.742096153" May 20 17:03:30.848581 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.848382 2545 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 17:03:30.940730 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.940624 2545 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T17:03:30.848576116Z","UUID":"8d46a26f-034f-4514-a90e-e27d824aa154","Handler":null,"Name":"","Endpoint":""} May 20 17:03:30.943087 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.943059 2545 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 17:03:30.943222 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:30.943103 2545 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 17:03:31.091976 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:31.091916 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:03:31.092452 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:31.092225 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"288a38f058c09ae4e7667f24ad563998f4c1ae6bc30147d1e65707ba37a79702"} May 20 17:03:31.093683 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:31.093645 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" event={"ID":"c24478cd-e524-4473-9f0d-efdc5e87179d","Type":"ContainerStarted","Data":"5a80d9a086939c2225fd9d9d2ba3c979c3acea63c7f8a49949700ecddacf0a7f"} May 20 17:03:31.094899 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:31.094871 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6mljc" event={"ID":"bce41ae5-70cb-40d1-8452-344447620c00","Type":"ContainerStarted","Data":"bb9d97bce60d69529d707ad2d804960a1d027c53dd6dc805f26295cf37a3a620"} May 20 17:03:31.998307 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:31.998278 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:31.998459 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:31.998374 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:31.998459 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:31.998433 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:31.998663 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:31.998532 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:32.098804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:32.098684 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" event={"ID":"c24478cd-e524-4473-9f0d-efdc5e87179d","Type":"ContainerStarted","Data":"60f9103522b3507d0dc758500adb08b3bb6845cad354ea58732dc4706105ddf2"} May 20 17:03:32.116980 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:32.116935 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd2qd" podStartSLOduration=2.919147042 podStartE2EDuration="23.116920822s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.64990449 +0000 UTC m=+3.237498609" lastFinishedPulling="2026-05-20 17:03:31.84767827 +0000 UTC m=+23.435272389" observedRunningTime="2026-05-20 17:03:32.116414304 +0000 UTC m=+23.704008446" watchObservedRunningTime="2026-05-20 17:03:32.116920822 +0000 UTC m=+23.704514998" May 20 17:03:32.117147 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:32.117122 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6mljc" podStartSLOduration=5.527393615 podStartE2EDuration="23.117116211s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.645835087 +0000 UTC m=+3.233429219" lastFinishedPulling="2026-05-20 17:03:29.235557683 +0000 UTC m=+20.823151815" observedRunningTime="2026-05-20 17:03:31.108737579 +0000 UTC m=+22.696331730" watchObservedRunningTime="2026-05-20 17:03:32.117116211 +0000 UTC m=+23.704710406" May 20 17:03:33.103314 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:33.103289 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:03:33.103800 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:33.103641 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"cf46738be1e2967e217b461744262468b4eb84a31e54e1e44edbf4becff27e58"} May 20 17:03:33.998514 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:33.998478 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:33.998723 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:33.998481 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:33.998723 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:33.998629 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:33.998837 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:33.998766 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:34.553038 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:34.552996 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:34.553957 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:34.553938 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:35.107606 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:35.107574 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:35.108131 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:35.108107 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ch42w" May 20 17:03:35.998013 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:35.997772 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:35.998564 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:35.997831 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:35.998564 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:35.998060 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:35.998564 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:35.998144 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:36.111782 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.111758 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:03:36.112128 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.112103 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"e71620fb5d52f3a1b27c747dd5bb50b2bd01b07338f047a01d0f4a48fef30fa5"} May 20 17:03:36.112400 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.112368 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:36.112497 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.112410 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:36.112497 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.112423 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:36.112619 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.112585 2545 scope.go:117] "RemoveContainer" containerID="1966be3dfd43c09b64b925a0b7f8354c0c7d1ac2ee28beb30cf94e03e8ff937a" May 20 17:03:36.113734 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.113694 2545 generic.go:358] "Generic (PLEG): container finished" podID="21556815-5e21-466a-b843-8f508e891694" containerID="8471f3305b4380909be80c6a51c33e633f501ae17400286214f22fc03d92bb79" exitCode=0 May 20 17:03:36.113851 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.113725 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msd8z" event={"ID":"21556815-5e21-466a-b843-8f508e891694","Type":"ContainerDied","Data":"8471f3305b4380909be80c6a51c33e633f501ae17400286214f22fc03d92bb79"} May 20 17:03:36.129422 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.129400 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:36.129643 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:36.129631 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:03:37.117817 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:37.117794 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:03:37.118228 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:37.118077 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" event={"ID":"c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff","Type":"ContainerStarted","Data":"85ef966a399ee895b39eae03cd35ba075293ff5ed7350e76d5780adb608fd827"} May 20 17:03:37.147189 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:37.147145 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" podStartSLOduration=10.230735118 podStartE2EDuration="28.147131578s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.653031513 +0000 UTC m=+3.240625637" lastFinishedPulling="2026-05-20 17:03:29.569427977 +0000 UTC m=+21.157022097" observedRunningTime="2026-05-20 17:03:37.146631779 +0000 UTC m=+28.734225919" watchObservedRunningTime="2026-05-20 17:03:37.147131578 +0000 UTC m=+28.734725718" May 20 17:03:37.446735 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:37.446703 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vlk94"] May 20 17:03:37.446899 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:37.446847 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:37.446988 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:37.446967 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:37.449429 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:37.449403 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xs58h"] May 20 17:03:37.449575 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:37.449513 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:37.449647 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:37.449621 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:38.121309 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:38.121276 2545 generic.go:358] "Generic (PLEG): container finished" podID="21556815-5e21-466a-b843-8f508e891694" containerID="90609e39764c607e35d95b0b008f60fc46dcd07bc003aef413a3f1aa56a2b9ba" exitCode=0 May 20 17:03:38.121683 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:38.121350 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msd8z" event={"ID":"21556815-5e21-466a-b843-8f508e891694","Type":"ContainerDied","Data":"90609e39764c607e35d95b0b008f60fc46dcd07bc003aef413a3f1aa56a2b9ba"} May 20 17:03:38.998784 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:38.998749 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:38.998928 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:38.998832 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:38.998928 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:38.998915 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:38.999032 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:38.999005 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:40.126650 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:40.126613 2545 generic.go:358] "Generic (PLEG): container finished" podID="21556815-5e21-466a-b843-8f508e891694" containerID="67d92a96a22e03e9b63a12ddf5da07dfcb8a3299621797ffaf436572d2e2e13a" exitCode=0 May 20 17:03:40.127324 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:40.126686 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msd8z" event={"ID":"21556815-5e21-466a-b843-8f508e891694","Type":"ContainerDied","Data":"67d92a96a22e03e9b63a12ddf5da07dfcb8a3299621797ffaf436572d2e2e13a"} May 20 17:03:40.998348 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:40.998320 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:40.998497 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:40.998458 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:40.998578 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:40.998510 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:40.998658 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:40.998633 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:42.637952 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:42.637916 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:42.638497 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:42.638064 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:42.638497 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:42.638130 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:04:14.638113549 +0000 UTC m=+66.225707667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 17:03:42.738870 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:42.738835 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:42.739029 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:42.738963 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 17:03:42.739029 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:42.738977 2545 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 17:03:42.739029 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:42.738986 2545 projected.go:194] Error preparing data for projected volume kube-api-access-zbk2l for pod openshift-network-diagnostics/network-check-target-xs58h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:42.739134 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:42.739038 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l podName:6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:14.739022253 +0000 UTC m=+66.326616387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbk2l" (UniqueName: "kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l") pod "network-check-target-xs58h" (UID: "6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 17:03:42.998794 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:42.998768 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:42.998923 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:42.998898 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xs58h" podUID="6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1" May 20 17:03:42.998989 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:42.998961 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:42.999112 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:42.999087 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:03:43.207121 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.207091 2545 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-136.ec2.internal" event="NodeReady" May 20 17:03:43.207293 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.207238 2545 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 17:03:43.243424 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.243327 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c6686985-r522f"] May 20 17:03:43.261798 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.261752 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g4lvm"] May 20 17:03:43.279431 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.279389 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qzhh4"] May 20 17:03:43.279605 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.279451 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.279605 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.279508 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.281843 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.281810 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 17:03:43.281843 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.281811 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 20 17:03:43.281843 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.282027 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qmxjm\"" May 20 17:03:43.281843 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.282027 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 20 17:03:43.282389 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.282163 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 17:03:43.282389 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.282260 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 20 17:03:43.282389 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.282344 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vxf4h\"" May 20 17:03:43.287164 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.287147 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 20 17:03:43.294509 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.294479 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c6686985-r522f"] May 20 17:03:43.294509 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.294508 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g4lvm"] May 20 17:03:43.294688 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.294519 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzhh4"] May 20 17:03:43.294688 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.294638 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:43.297704 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.297681 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4kg2\"" May 20 17:03:43.297704 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.297697 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 17:03:43.297855 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.297720 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 17:03:43.297855 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.297799 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 17:03:43.346837 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.346802 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-bound-sa-token\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.347003 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.346852 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-image-registry-private-configuration\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.347003 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.346873 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-certificates\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.347003 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.346891 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-installation-pull-secrets\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.347003 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.346910 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.347003 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.346953 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-trusted-ca\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.347261 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.347041 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntghn\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-kube-api-access-ntghn\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.347261 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.347073 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6265870-d5cd-431f-b9c4-360a64f6102a-ca-trust-extracted\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.448228 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448190 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-image-registry-private-configuration\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.448399 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448236 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-certificates\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.448399 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448374 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-config-volume\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.448487 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448422 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc7cb\" (UniqueName: \"kubernetes.io/projected/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-kube-api-access-fc7cb\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.448487 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448460 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-installation-pull-secrets\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.448593 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448487 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-tmp-dir\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.448593 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448511 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:43.448593 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448555 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmgg\" (UniqueName: \"kubernetes.io/projected/ca9f9425-4e00-4c84-b300-986da4c1af18-kube-api-access-6gmgg\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:43.448593 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448591 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.448788 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448616 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-trusted-ca\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.448788 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448740 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntghn\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-kube-api-access-ntghn\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.448880 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448794 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6265870-d5cd-431f-b9c4-360a64f6102a-ca-trust-extracted\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.448880 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448830 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.448880 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.448858 2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 17:03:43.448880 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.448875 2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6686985-r522f: secret "image-registry-tls" not found May 20 17:03:43.449062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448901 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-bound-sa-token\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.449062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.448925 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-certificates\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.449062 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.448933 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls podName:b6265870-d5cd-431f-b9c4-360a64f6102a nodeName:}" failed. No retries permitted until 2026-05-20 17:03:43.948912203 +0000 UTC m=+35.536506341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls") pod "image-registry-75c6686985-r522f" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a") : secret "image-registry-tls" not found May 20 17:03:43.449306 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.449267 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6265870-d5cd-431f-b9c4-360a64f6102a-ca-trust-extracted\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.449808 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.449603 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-trusted-ca\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.452912 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.452894 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-installation-pull-secrets\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.452912 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.452899 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-image-registry-private-configuration\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.457661 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.457635 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-bound-sa-token\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.457784 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.457684 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntghn\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-kube-api-access-ntghn\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.549961 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.549853 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-tmp-dir\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.549961 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.549889 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:43.549961 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.549906 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmgg\" (UniqueName: \"kubernetes.io/projected/ca9f9425-4e00-4c84-b300-986da4c1af18-kube-api-access-6gmgg\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:43.550198 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.549989 2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:03:43.550198 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.550067 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert podName:ca9f9425-4e00-4c84-b300-986da4c1af18 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:44.050046492 +0000 UTC m=+35.637640627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert") pod "ingress-canary-qzhh4" (UID: "ca9f9425-4e00-4c84-b300-986da4c1af18") : secret "canary-serving-cert" not found May 20 17:03:43.550198 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.550105 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.550198 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.550170 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-config-volume\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.550198 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.550184 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-tmp-dir\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.550198 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.550194 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7cb\" (UniqueName: \"kubernetes.io/projected/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-kube-api-access-fc7cb\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.550439 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.550313 2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:03:43.550439 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.550402 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls podName:0db386cd-2c26-442f-9aa1-2cf0dad4dff1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:44.050390005 +0000 UTC m=+35.637984123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls") pod "dns-default-g4lvm" (UID: "0db386cd-2c26-442f-9aa1-2cf0dad4dff1") : secret "dns-default-metrics-tls" not found May 20 17:03:43.550647 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.550630 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-config-volume\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.558587 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.558560 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmgg\" (UniqueName: \"kubernetes.io/projected/ca9f9425-4e00-4c84-b300-986da4c1af18-kube-api-access-6gmgg\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:43.558587 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.558578 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc7cb\" (UniqueName: \"kubernetes.io/projected/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-kube-api-access-fc7cb\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:43.954304 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:43.954268 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:43.954784 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.954418 2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 17:03:43.954784 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.954432 2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6686985-r522f: secret "image-registry-tls" not found May 20 17:03:43.954784 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:43.954488 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls podName:b6265870-d5cd-431f-b9c4-360a64f6102a nodeName:}" failed. No retries permitted until 2026-05-20 17:03:44.954470299 +0000 UTC m=+36.542064425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls") pod "image-registry-75c6686985-r522f" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a") : secret "image-registry-tls" not found May 20 17:03:44.055378 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:44.055334 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:44.055692 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:44.055442 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:44.055692 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:44.055509 2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:03:44.055692 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:44.055588 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls podName:0db386cd-2c26-442f-9aa1-2cf0dad4dff1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:45.055570497 +0000 UTC m=+36.643164614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls") pod "dns-default-g4lvm" (UID: "0db386cd-2c26-442f-9aa1-2cf0dad4dff1") : secret "dns-default-metrics-tls" not found May 20 17:03:44.055692 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:44.055595 2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:03:44.055692 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:44.055657 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert podName:ca9f9425-4e00-4c84-b300-986da4c1af18 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:45.055640662 +0000 UTC m=+36.643234783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert") pod "ingress-canary-qzhh4" (UID: "ca9f9425-4e00-4c84-b300-986da4c1af18") : secret "canary-serving-cert" not found May 20 17:03:44.963795 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:44.963746 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:44.964194 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:44.963906 2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 17:03:44.964194 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:44.963928 2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6686985-r522f: secret "image-registry-tls" not found May 20 17:03:44.964194 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:44.964007 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls podName:b6265870-d5cd-431f-b9c4-360a64f6102a nodeName:}" failed. No retries permitted until 2026-05-20 17:03:46.963985008 +0000 UTC m=+38.551579126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls") pod "image-registry-75c6686985-r522f" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a") : secret "image-registry-tls" not found May 20 17:03:44.998323 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:44.998285 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:03:44.998481 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:44.998324 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:03:45.000880 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:45.000853 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhsxl\"" May 20 17:03:45.001635 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:45.001610 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 17:03:45.001755 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:45.001641 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phplh\"" May 20 17:03:45.001755 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:45.001647 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 17:03:45.001755 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:45.001678 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 17:03:45.064697 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:45.064665 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:45.064891 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:45.064752 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:45.064891 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:45.064837 2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:03:45.064891 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:45.064854 2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:03:45.065052 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:45.064914 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert podName:ca9f9425-4e00-4c84-b300-986da4c1af18 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:47.064892729 +0000 UTC m=+38.652486854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert") pod "ingress-canary-qzhh4" (UID: "ca9f9425-4e00-4c84-b300-986da4c1af18") : secret "canary-serving-cert" not found May 20 17:03:45.065052 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:45.064936 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls podName:0db386cd-2c26-442f-9aa1-2cf0dad4dff1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:47.064925728 +0000 UTC m=+38.652519845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls") pod "dns-default-g4lvm" (UID: "0db386cd-2c26-442f-9aa1-2cf0dad4dff1") : secret "dns-default-metrics-tls" not found May 20 17:03:46.979794 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:46.979756 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:46.980245 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:46.979892 2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 17:03:46.980245 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:46.979905 2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6686985-r522f: secret "image-registry-tls" not found May 20 17:03:46.980245 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:46.979954 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls podName:b6265870-d5cd-431f-b9c4-360a64f6102a nodeName:}" failed. No retries permitted until 2026-05-20 17:03:50.979940159 +0000 UTC m=+42.567534276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls") pod "image-registry-75c6686985-r522f" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a") : secret "image-registry-tls" not found May 20 17:03:47.080771 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:47.080735 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:47.080880 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:47.080814 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:47.080913 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:47.080893 2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:03:47.080981 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:47.080962 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert podName:ca9f9425-4e00-4c84-b300-986da4c1af18 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:51.080946254 +0000 UTC m=+42.668540372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert") pod "ingress-canary-qzhh4" (UID: "ca9f9425-4e00-4c84-b300-986da4c1af18") : secret "canary-serving-cert" not found May 20 17:03:47.081030 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:47.080895 2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:03:47.081030 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:47.081026 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls podName:0db386cd-2c26-442f-9aa1-2cf0dad4dff1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:51.081014414 +0000 UTC m=+42.668608533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls") pod "dns-default-g4lvm" (UID: "0db386cd-2c26-442f-9aa1-2cf0dad4dff1") : secret "dns-default-metrics-tls" not found May 20 17:03:47.141253 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:47.141219 2545 generic.go:358] "Generic (PLEG): container finished" podID="21556815-5e21-466a-b843-8f508e891694" containerID="c5a14ded21332e18c584abd9e5e53145daeeaa982bb83291b851488025ce045d" exitCode=0 May 20 17:03:47.141402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:47.141265 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msd8z" event={"ID":"21556815-5e21-466a-b843-8f508e891694","Type":"ContainerDied","Data":"c5a14ded21332e18c584abd9e5e53145daeeaa982bb83291b851488025ce045d"} May 20 17:03:48.145153 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:48.145115 2545 generic.go:358] "Generic (PLEG): container finished" podID="21556815-5e21-466a-b843-8f508e891694" containerID="6f898ce85181daaadba999280c0bb5be3de95c30faf6cfc8f6a99119192a7da4" exitCode=0 May 20 17:03:48.145499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:48.145167 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msd8z" event={"ID":"21556815-5e21-466a-b843-8f508e891694","Type":"ContainerDied","Data":"6f898ce85181daaadba999280c0bb5be3de95c30faf6cfc8f6a99119192a7da4"} May 20 17:03:49.150208 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:49.150167 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msd8z" event={"ID":"21556815-5e21-466a-b843-8f508e891694","Type":"ContainerStarted","Data":"1f9b6309cdd1cff005ab66242ad9305b49e931e22bdb8829f3e2c5c574d510d1"} May 20 17:03:49.172161 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:49.172114 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-msd8z" podStartSLOduration=5.752609887 podStartE2EDuration="40.172101502s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:03:11.655451864 +0000 UTC m=+3.243045987" lastFinishedPulling="2026-05-20 17:03:46.07494348 +0000 UTC m=+37.662537602" observedRunningTime="2026-05-20 17:03:49.171855375 +0000 UTC m=+40.759449514" watchObservedRunningTime="2026-05-20 17:03:49.172101502 +0000 UTC m=+40.759695662" May 20 17:03:51.005025 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:51.004992 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:51.005404 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:51.005088 2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 17:03:51.005404 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:51.005099 2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6686985-r522f: secret "image-registry-tls" not found May 20 17:03:51.005404 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:51.005146 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls podName:b6265870-d5cd-431f-b9c4-360a64f6102a nodeName:}" failed. No retries permitted until 2026-05-20 17:03:59.005132139 +0000 UTC m=+50.592726256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls") pod "image-registry-75c6686985-r522f" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a") : secret "image-registry-tls" not found May 20 17:03:51.105791 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:51.105745 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:51.105923 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:51.105816 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:51.105923 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:51.105884 2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:03:51.105923 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:51.105907 2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:03:51.106038 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:51.105952 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls podName:0db386cd-2c26-442f-9aa1-2cf0dad4dff1 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:59.105934928 +0000 UTC m=+50.693529051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls") pod "dns-default-g4lvm" (UID: "0db386cd-2c26-442f-9aa1-2cf0dad4dff1") : secret "dns-default-metrics-tls" not found May 20 17:03:51.106038 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:51.105966 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert podName:ca9f9425-4e00-4c84-b300-986da4c1af18 nodeName:}" failed. No retries permitted until 2026-05-20 17:03:59.105960865 +0000 UTC m=+50.693554982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert") pod "ingress-canary-qzhh4" (UID: "ca9f9425-4e00-4c84-b300-986da4c1af18") : secret "canary-serving-cert" not found May 20 17:03:59.061858 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.061818 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:03:59.062332 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:59.061932 2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 17:03:59.062332 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:59.061943 2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6686985-r522f: secret "image-registry-tls" not found May 20 17:03:59.062332 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:59.061994 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls podName:b6265870-d5cd-431f-b9c4-360a64f6102a nodeName:}" failed. No retries permitted until 2026-05-20 17:04:15.061980001 +0000 UTC m=+66.649574119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls") pod "image-registry-75c6686985-r522f" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a") : secret "image-registry-tls" not found May 20 17:03:59.162916 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.162882 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:03:59.163109 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.162936 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:03:59.163109 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:59.163021 2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:03:59.163109 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:59.163024 2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:03:59.163109 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:59.163088 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert podName:ca9f9425-4e00-4c84-b300-986da4c1af18 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:15.163068692 +0000 UTC m=+66.750662823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert") pod "ingress-canary-qzhh4" (UID: "ca9f9425-4e00-4c84-b300-986da4c1af18") : secret "canary-serving-cert" not found May 20 17:03:59.163245 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:03:59.163140 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls podName:0db386cd-2c26-442f-9aa1-2cf0dad4dff1 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:15.163116311 +0000 UTC m=+66.750710428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls") pod "dns-default-g4lvm" (UID: "0db386cd-2c26-442f-9aa1-2cf0dad4dff1") : secret "dns-default-metrics-tls" not found May 20 17:03:59.257494 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.257460 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q2qdw"] May 20 17:03:59.295780 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.295735 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q2qdw"] May 20 17:03:59.295942 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.295900 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.298276 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.298259 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 17:03:59.365023 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.364940 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c1c8045-0277-4491-8fa4-8b74fe969a25-kubelet-config\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.365023 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.364980 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1c8045-0277-4491-8fa4-8b74fe969a25-original-pull-secret\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.365198 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.365046 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c1c8045-0277-4491-8fa4-8b74fe969a25-dbus\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.465604 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.465567 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c1c8045-0277-4491-8fa4-8b74fe969a25-dbus\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.465766 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.465631 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c1c8045-0277-4491-8fa4-8b74fe969a25-kubelet-config\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.465766 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.465666 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1c8045-0277-4491-8fa4-8b74fe969a25-original-pull-secret\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.465844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.465774 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c1c8045-0277-4491-8fa4-8b74fe969a25-kubelet-config\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.465878 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.465847 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c1c8045-0277-4491-8fa4-8b74fe969a25-dbus\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.468216 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.468189 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c1c8045-0277-4491-8fa4-8b74fe969a25-original-pull-secret\") pod \"global-pull-secret-syncer-q2qdw\" (UID: \"9c1c8045-0277-4491-8fa4-8b74fe969a25\") " pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.604953 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.604916 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2qdw" May 20 17:03:59.782014 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:03:59.781979 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q2qdw"] May 20 17:04:00.170821 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:00.170785 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q2qdw" event={"ID":"9c1c8045-0277-4491-8fa4-8b74fe969a25","Type":"ContainerStarted","Data":"77d1c5406f0da499247938cb013a0925abd8917f88dfbc2ad6d15548ca4da914"} May 20 17:04:05.181065 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:05.181015 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q2qdw" event={"ID":"9c1c8045-0277-4491-8fa4-8b74fe969a25","Type":"ContainerStarted","Data":"488f3fe930624d88d73a440a51ae7a095ddf3eeadabab693ba42a8b288e28f25"} May 20 17:04:05.194670 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:05.194621 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q2qdw" podStartSLOduration=1.199657141 podStartE2EDuration="6.194605099s" podCreationTimestamp="2026-05-20 17:03:59 +0000 UTC" firstStartedPulling="2026-05-20 17:03:59.787767039 +0000 UTC m=+51.375361172" lastFinishedPulling="2026-05-20 17:04:04.782714985 +0000 UTC m=+56.370309130" observedRunningTime="2026-05-20 17:04:05.194430649 +0000 UTC m=+56.782024792" watchObservedRunningTime="2026-05-20 17:04:05.194605099 +0000 UTC m=+56.782199238" May 20 17:04:08.138675 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:08.138645 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqnwd" May 20 17:04:14.681496 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:14.681444 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:04:14.683686 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:14.683665 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 17:04:14.692462 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:14.692443 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 17:04:14.692575 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:14.692529 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:05:18.692505392 +0000 UTC m=+130.280099510 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : secret "metrics-daemon-secret" not found May 20 17:04:14.781978 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:14.781943 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:04:14.784574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:14.784556 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 17:04:14.794188 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:14.794173 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 17:04:14.805592 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:14.805570 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbk2l\" (UniqueName: \"kubernetes.io/projected/6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1-kube-api-access-zbk2l\") pod \"network-check-target-xs58h\" (UID: \"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1\") " pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:04:15.012522 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:15.012427 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhsxl\"" May 20 17:04:15.020338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:15.020312 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:04:15.084320 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:15.084292 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:04:15.084480 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:15.084444 2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 17:04:15.084480 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:15.084462 2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6686985-r522f: secret "image-registry-tls" not found May 20 17:04:15.084631 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:15.084524 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls podName:b6265870-d5cd-431f-b9c4-360a64f6102a nodeName:}" failed. No retries permitted until 2026-05-20 17:04:47.084508473 +0000 UTC m=+98.672102591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls") pod "image-registry-75c6686985-r522f" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a") : secret "image-registry-tls" not found May 20 17:04:15.154617 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:15.154588 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xs58h"] May 20 17:04:15.158190 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:04:15.158157 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d42a9e7_fc4d_4ac5_9af4_816d9a68c0a1.slice/crio-23391924e3a0bd8984413816d5c9ee0a6e62d9c6055ca65ecb5ba012098c0e5f WatchSource:0}: Error finding container 23391924e3a0bd8984413816d5c9ee0a6e62d9c6055ca65ecb5ba012098c0e5f: Status 404 returned error can't find the container with id 23391924e3a0bd8984413816d5c9ee0a6e62d9c6055ca65ecb5ba012098c0e5f May 20 17:04:15.184795 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:15.184767 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:04:15.184894 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:15.184827 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:04:15.184936 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:15.184906 2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:04:15.184936 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:15.184927 2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:04:15.185005 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:15.184965 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert podName:ca9f9425-4e00-4c84-b300-986da4c1af18 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:47.184949912 +0000 UTC m=+98.772544030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert") pod "ingress-canary-qzhh4" (UID: "ca9f9425-4e00-4c84-b300-986da4c1af18") : secret "canary-serving-cert" not found May 20 17:04:15.185005 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:15.184978 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls podName:0db386cd-2c26-442f-9aa1-2cf0dad4dff1 nodeName:}" failed. No retries permitted until 2026-05-20 17:04:47.184972153 +0000 UTC m=+98.772566270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls") pod "dns-default-g4lvm" (UID: "0db386cd-2c26-442f-9aa1-2cf0dad4dff1") : secret "dns-default-metrics-tls" not found May 20 17:04:15.200309 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:15.200284 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xs58h" event={"ID":"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1","Type":"ContainerStarted","Data":"23391924e3a0bd8984413816d5c9ee0a6e62d9c6055ca65ecb5ba012098c0e5f"} May 20 17:04:18.207638 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:18.207601 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xs58h" event={"ID":"6d42a9e7-fc4d-4ac5-9af4-816d9a68c0a1","Type":"ContainerStarted","Data":"4464b7320c0b8be939d2895fd4b89edbd746b72c67aeb17f6cb8958e607d323e"} May 20 17:04:18.208063 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:18.207727 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:04:18.222202 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:18.222155 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xs58h" podStartSLOduration=66.509123603 podStartE2EDuration="1m9.222140986s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:04:15.160058793 +0000 UTC m=+66.747652926" lastFinishedPulling="2026-05-20 17:04:17.873076192 +0000 UTC m=+69.460670309" observedRunningTime="2026-05-20 17:04:18.221258527 +0000 UTC m=+69.808852658" watchObservedRunningTime="2026-05-20 17:04:18.222140986 +0000 UTC m=+69.809735116" May 20 17:04:47.122745 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:47.122713 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") pod \"image-registry-75c6686985-r522f\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:04:47.123121 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:47.122823 2545 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 17:04:47.123121 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:47.122835 2545 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6686985-r522f: secret "image-registry-tls" not found May 20 17:04:47.123121 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:47.122883 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls podName:b6265870-d5cd-431f-b9c4-360a64f6102a nodeName:}" failed. No retries permitted until 2026-05-20 17:05:51.12286945 +0000 UTC m=+162.710463568 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls") pod "image-registry-75c6686985-r522f" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a") : secret "image-registry-tls" not found May 20 17:04:47.223763 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:47.223728 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:04:47.223909 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:47.223787 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:04:47.223909 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:47.223874 2545 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 17:04:47.223979 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:47.223941 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert podName:ca9f9425-4e00-4c84-b300-986da4c1af18 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:51.223926365 +0000 UTC m=+162.811520483 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert") pod "ingress-canary-qzhh4" (UID: "ca9f9425-4e00-4c84-b300-986da4c1af18") : secret "canary-serving-cert" not found May 20 17:04:47.223979 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:47.223880 2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 17:04:47.224047 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:04:47.224020 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls podName:0db386cd-2c26-442f-9aa1-2cf0dad4dff1 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:51.224009195 +0000 UTC m=+162.811603312 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls") pod "dns-default-g4lvm" (UID: "0db386cd-2c26-442f-9aa1-2cf0dad4dff1") : secret "dns-default-metrics-tls" not found May 20 17:04:49.212871 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:04:49.212844 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xs58h" May 20 17:05:18.741356 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:18.741317 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:05:18.741878 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:18.741428 2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 17:05:18.741878 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:18.741494 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs podName:064653ee-ac31-45f8-9a7b-1cd046e1799d nodeName:}" failed. No retries permitted until 2026-05-20 17:07:20.741479836 +0000 UTC m=+252.329073954 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs") pod "network-metrics-daemon-vlk94" (UID: "064653ee-ac31-45f8-9a7b-1cd046e1799d") : secret "metrics-daemon-secret" not found May 20 17:05:19.724574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.724524 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9bd656cc6-7rtjg"] May 20 17:05:19.727172 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.727157 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.729089 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.729065 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 20 17:05:19.729207 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.729140 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 20 17:05:19.729522 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.729503 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t9c5g\"" May 20 17:05:19.729971 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.729958 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 20 17:05:19.730022 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.729992 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 20 17:05:19.730080 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.730064 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 20 17:05:19.731473 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.731456 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 20 17:05:19.738014 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.737994 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9bd656cc6-7rtjg"] May 20 17:05:19.749484 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.749464 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-stats-auth\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.749786 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.749506 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.749786 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.749523 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.749786 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.749575 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljbzr\" (UniqueName: \"kubernetes.io/projected/dd0e91cd-ff0f-457c-b590-0cfd20195080-kube-api-access-ljbzr\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.749786 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.749614 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-default-certificate\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.831011 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.830978 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l"] May 20 17:05:19.832718 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.832704 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l" May 20 17:05:19.835483 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.835468 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7fbrm\"" May 20 17:05:19.845407 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.845378 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l"] May 20 17:05:19.850335 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.850315 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.850423 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.850340 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.850423 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.850359 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljbzr\" (UniqueName: \"kubernetes.io/projected/dd0e91cd-ff0f-457c-b590-0cfd20195080-kube-api-access-ljbzr\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.850423 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.850383 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55h8x\" (UniqueName: \"kubernetes.io/projected/2c76e38a-0b44-4463-bb10-ebfb806fa9b4-kube-api-access-55h8x\") pod \"network-check-source-7f44b6dd87-q284l\" (UID: \"2c76e38a-0b44-4463-bb10-ebfb806fa9b4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l" May 20 17:05:19.850423 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.850410 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-default-certificate\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.850578 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:19.850467 2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 17:05:19.850578 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:19.850495 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:20.350475632 +0000 UTC m=+131.938069769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : configmap references non-existent config key: service-ca.crt May 20 17:05:19.850578 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:19.850523 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:20.350512399 +0000 UTC m=+131.938106525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : secret "router-metrics-certs-default" not found May 20 17:05:19.850679 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.850616 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-stats-auth\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.852722 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.852697 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-default-certificate\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.852842 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.852821 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-stats-auth\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.871172 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.871141 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljbzr\" (UniqueName: \"kubernetes.io/projected/dd0e91cd-ff0f-457c-b590-0cfd20195080-kube-api-access-ljbzr\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:19.951633 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.951602 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55h8x\" (UniqueName: \"kubernetes.io/projected/2c76e38a-0b44-4463-bb10-ebfb806fa9b4-kube-api-access-55h8x\") pod \"network-check-source-7f44b6dd87-q284l\" (UID: \"2c76e38a-0b44-4463-bb10-ebfb806fa9b4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l" May 20 17:05:19.961454 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:19.961434 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55h8x\" (UniqueName: \"kubernetes.io/projected/2c76e38a-0b44-4463-bb10-ebfb806fa9b4-kube-api-access-55h8x\") pod \"network-check-source-7f44b6dd87-q284l\" (UID: \"2c76e38a-0b44-4463-bb10-ebfb806fa9b4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l" May 20 17:05:20.141401 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:20.141365 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l" May 20 17:05:20.259113 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:20.259081 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l"] May 20 17:05:20.262262 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:05:20.262240 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c76e38a_0b44_4463_bb10_ebfb806fa9b4.slice/crio-d2616443037ed066454c208a59cf6c47304e1047021f066ff194cf0dbfed81db WatchSource:0}: Error finding container d2616443037ed066454c208a59cf6c47304e1047021f066ff194cf0dbfed81db: Status 404 returned error can't find the container with id d2616443037ed066454c208a59cf6c47304e1047021f066ff194cf0dbfed81db May 20 17:05:20.324392 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:20.324357 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l" event={"ID":"2c76e38a-0b44-4463-bb10-ebfb806fa9b4","Type":"ContainerStarted","Data":"e6ee266eda279d2cb9c43a8a9f283f56c43b3e045475a711e824597ae8dfe2ed"} May 20 17:05:20.324520 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:20.324402 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l" event={"ID":"2c76e38a-0b44-4463-bb10-ebfb806fa9b4","Type":"ContainerStarted","Data":"d2616443037ed066454c208a59cf6c47304e1047021f066ff194cf0dbfed81db"} May 20 17:05:20.338856 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:20.338808 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q284l" podStartSLOduration=1.33878923 podStartE2EDuration="1.33878923s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:05:20.337633559 +0000 UTC m=+131.925227701" watchObservedRunningTime="2026-05-20 17:05:20.33878923 +0000 UTC m=+131.926383374" May 20 17:05:20.355013 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:20.354989 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:20.355115 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:20.355021 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:20.355176 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:20.355132 2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 17:05:20.355176 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:20.355168 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:21.355146589 +0000 UTC m=+132.942740719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : configmap references non-existent config key: service-ca.crt May 20 17:05:20.355292 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:20.355278 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:21.35526623 +0000 UTC m=+132.942860354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : secret "router-metrics-certs-default" not found May 20 17:05:21.363664 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:21.363629 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:21.363664 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:21.363668 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:21.364101 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:21.363792 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:23.36377422 +0000 UTC m=+134.951368339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : configmap references non-existent config key: service-ca.crt May 20 17:05:21.364101 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:21.363801 2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 17:05:21.364101 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:21.363865 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:23.36384864 +0000 UTC m=+134.951442761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : secret "router-metrics-certs-default" not found May 20 17:05:23.378581 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:23.378526 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:23.378965 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:23.378590 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:23.378965 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:23.378707 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:27.37869082 +0000 UTC m=+138.966284939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : configmap references non-existent config key: service-ca.crt May 20 17:05:23.378965 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:23.378723 2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 17:05:23.378965 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:23.378779 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:27.378763834 +0000 UTC m=+138.966357957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : secret "router-metrics-certs-default" not found May 20 17:05:27.408312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.408251 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:27.408312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.408316 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:27.408847 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:27.408416 2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 17:05:27.408847 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:27.408422 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:35.408403928 +0000 UTC m=+146.995998058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : configmap references non-existent config key: service-ca.crt May 20 17:05:27.408847 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:27.408487 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:35.408473417 +0000 UTC m=+146.996067535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : secret "router-metrics-certs-default" not found May 20 17:05:27.512410 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.512377 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2h5md"] May 20 17:05:27.515516 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.515489 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.518005 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.517974 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 20 17:05:27.518114 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.518034 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 20 17:05:27.518114 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.517982 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 20 17:05:27.518814 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.518798 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 20 17:05:27.518814 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.518806 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xj64r\"" May 20 17:05:27.523842 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.523822 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2h5md"] May 20 17:05:27.609982 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.609943 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7e513589-f650-4193-b889-0ca4466b50e7-signing-key\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.610153 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.609992 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7e513589-f650-4193-b889-0ca4466b50e7-signing-cabundle\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.610153 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.610018 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8n8d\" (UniqueName: \"kubernetes.io/projected/7e513589-f650-4193-b889-0ca4466b50e7-kube-api-access-l8n8d\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.711417 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.711343 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7e513589-f650-4193-b889-0ca4466b50e7-signing-key\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.711417 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.711391 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7e513589-f650-4193-b889-0ca4466b50e7-signing-cabundle\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.711417 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.711410 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8n8d\" (UniqueName: \"kubernetes.io/projected/7e513589-f650-4193-b889-0ca4466b50e7-kube-api-access-l8n8d\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.712008 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.711987 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7e513589-f650-4193-b889-0ca4466b50e7-signing-cabundle\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.713800 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.713779 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7e513589-f650-4193-b889-0ca4466b50e7-signing-key\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.727319 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.727292 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8n8d\" (UniqueName: \"kubernetes.io/projected/7e513589-f650-4193-b889-0ca4466b50e7-kube-api-access-l8n8d\") pod \"service-ca-67d667c7d-2h5md\" (UID: \"7e513589-f650-4193-b889-0ca4466b50e7\") " pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.824665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.824618 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-2h5md" May 20 17:05:27.943472 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.943434 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2h5md"] May 20 17:05:27.947274 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:05:27.947244 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e513589_f650_4193_b889_0ca4466b50e7.slice/crio-db13ce4969b3b0492f8020460243e2224422f09c38f9a989edce92079d4b09a7 WatchSource:0}: Error finding container db13ce4969b3b0492f8020460243e2224422f09c38f9a989edce92079d4b09a7: Status 404 returned error can't find the container with id db13ce4969b3b0492f8020460243e2224422f09c38f9a989edce92079d4b09a7 May 20 17:05:27.964667 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:27.964605 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tg8m9_f664acff-5fc0-45b9-ac7e-e9cc03511eda/dns-node-resolver/0.log" May 20 17:05:28.343217 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:28.343130 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-2h5md" event={"ID":"7e513589-f650-4193-b889-0ca4466b50e7","Type":"ContainerStarted","Data":"db13ce4969b3b0492f8020460243e2224422f09c38f9a989edce92079d4b09a7"} May 20 17:05:28.763194 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:28.763166 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h62bc_94bd6556-64ba-4f32-9512-69f0b4fe607c/node-ca/0.log" May 20 17:05:30.347809 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:30.347773 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-2h5md" event={"ID":"7e513589-f650-4193-b889-0ca4466b50e7","Type":"ContainerStarted","Data":"64d30a777808e1f04ae2b773c117291a322dc5d59f70c9e6c95dd9ddba00b270"} May 20 17:05:30.363705 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:30.363659 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-2h5md" podStartSLOduration=1.505363469 podStartE2EDuration="3.363645525s" podCreationTimestamp="2026-05-20 17:05:27 +0000 UTC" firstStartedPulling="2026-05-20 17:05:27.948939268 +0000 UTC m=+139.536533386" lastFinishedPulling="2026-05-20 17:05:29.807221324 +0000 UTC m=+141.394815442" observedRunningTime="2026-05-20 17:05:30.36263633 +0000 UTC m=+141.950230486" watchObservedRunningTime="2026-05-20 17:05:30.363645525 +0000 UTC m=+141.951239658" May 20 17:05:35.470312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:35.470272 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:35.470772 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:35.470328 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:35.470772 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:35.470428 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:51.470409053 +0000 UTC m=+163.058003172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : configmap references non-existent config key: service-ca.crt May 20 17:05:35.470772 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:35.470479 2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 20 17:05:35.470772 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:35.470566 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs podName:dd0e91cd-ff0f-457c-b590-0cfd20195080 nodeName:}" failed. No retries permitted until 2026-05-20 17:05:51.470528556 +0000 UTC m=+163.058122677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs") pod "router-default-9bd656cc6-7rtjg" (UID: "dd0e91cd-ff0f-457c-b590-0cfd20195080") : secret "router-metrics-certs-default" not found May 20 17:05:46.292718 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:46.292677 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g4lvm" podUID="0db386cd-2c26-442f-9aa1-2cf0dad4dff1" May 20 17:05:46.299853 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:46.299816 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-75c6686985-r522f" podUID="b6265870-d5cd-431f-b9c4-360a64f6102a" May 20 17:05:46.307184 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:46.307164 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-qzhh4" podUID="ca9f9425-4e00-4c84-b300-986da4c1af18" May 20 17:05:46.378908 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:46.378880 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4lvm" May 20 17:05:46.379031 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:46.378880 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:05:48.014822 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:48.014786 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vlk94" podUID="064653ee-ac31-45f8-9a7b-1cd046e1799d" May 20 17:05:49.348245 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.348210 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hhm9b"] May 20 17:05:49.354417 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.354396 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.362769 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.362745 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 17:05:49.362904 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.362789 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmjr5\"" May 20 17:05:49.362904 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.362754 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 17:05:49.362904 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.362843 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 17:05:49.363114 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.363098 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 17:05:49.367086 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.367064 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c6686985-r522f"] May 20 17:05:49.367277 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:05:49.367256 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75c6686985-r522f" podUID="b6265870-d5cd-431f-b9c4-360a64f6102a" May 20 17:05:49.381678 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.381646 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hhm9b"] May 20 17:05:49.384309 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.384289 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:05:49.388381 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.388357 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:05:49.450213 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.450172 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-599f8769dc-tgx8b"] May 20 17:05:49.454087 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.454071 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.463212 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.463187 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-599f8769dc-tgx8b"] May 20 17:05:49.482415 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482387 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-trusted-ca\") pod \"b6265870-d5cd-431f-b9c4-360a64f6102a\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " May 20 17:05:49.482565 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482434 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-certificates\") pod \"b6265870-d5cd-431f-b9c4-360a64f6102a\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " May 20 17:05:49.482565 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482469 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-installation-pull-secrets\") pod \"b6265870-d5cd-431f-b9c4-360a64f6102a\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " May 20 17:05:49.482565 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482490 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntghn\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-kube-api-access-ntghn\") pod \"b6265870-d5cd-431f-b9c4-360a64f6102a\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " May 20 17:05:49.482565 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482511 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-bound-sa-token\") pod \"b6265870-d5cd-431f-b9c4-360a64f6102a\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " May 20 17:05:49.482565 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482533 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6265870-d5cd-431f-b9c4-360a64f6102a-ca-trust-extracted\") pod \"b6265870-d5cd-431f-b9c4-360a64f6102a\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " May 20 17:05:49.482801 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482581 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-image-registry-private-configuration\") pod \"b6265870-d5cd-431f-b9c4-360a64f6102a\" (UID: \"b6265870-d5cd-431f-b9c4-360a64f6102a\") " May 20 17:05:49.482801 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482679 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3225f96-c165-4e94-a04e-c240136029e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.482801 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482709 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2sbd\" (UniqueName: \"kubernetes.io/projected/b3225f96-c165-4e94-a04e-c240136029e5-kube-api-access-m2sbd\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.482801 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482745 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3225f96-c165-4e94-a04e-c240136029e5-data-volume\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.483001 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482825 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3225f96-c165-4e94-a04e-c240136029e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.483001 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482893 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3225f96-c165-4e94-a04e-c240136029e5-crio-socket\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.483001 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.482928 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b6265870-d5cd-431f-b9c4-360a64f6102a" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:05:49.483158 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.483131 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b6265870-d5cd-431f-b9c4-360a64f6102a" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:05:49.483158 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.483149 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6265870-d5cd-431f-b9c4-360a64f6102a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b6265870-d5cd-431f-b9c4-360a64f6102a" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 17:05:49.484826 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.484801 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b6265870-d5cd-431f-b9c4-360a64f6102a" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:05:49.484960 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.484910 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b6265870-d5cd-431f-b9c4-360a64f6102a" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:05:49.484960 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.484910 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b6265870-d5cd-431f-b9c4-360a64f6102a" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:05:49.485054 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.484967 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-kube-api-access-ntghn" (OuterVolumeSpecName: "kube-api-access-ntghn") pod "b6265870-d5cd-431f-b9c4-360a64f6102a" (UID: "b6265870-d5cd-431f-b9c4-360a64f6102a"). InnerVolumeSpecName "kube-api-access-ntghn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:05:49.583512 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583469 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65511292-ed53-470e-b6d8-1f63298f72b1-registry-certificates\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.583512 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583517 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3225f96-c165-4e94-a04e-c240136029e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.583766 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583562 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2sbd\" (UniqueName: \"kubernetes.io/projected/b3225f96-c165-4e94-a04e-c240136029e5-kube-api-access-m2sbd\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.583766 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583592 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3225f96-c165-4e94-a04e-c240136029e5-data-volume\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.583766 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583630 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65511292-ed53-470e-b6d8-1f63298f72b1-ca-trust-extracted\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.583919 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583757 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65511292-ed53-470e-b6d8-1f63298f72b1-image-registry-private-configuration\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.583919 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583821 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3225f96-c165-4e94-a04e-c240136029e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.583919 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583863 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8kjg\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-kube-api-access-c8kjg\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.584028 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.583946 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3225f96-c165-4e94-a04e-c240136029e5-data-volume\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.584028 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584007 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3225f96-c165-4e94-a04e-c240136029e5-crio-socket\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.584099 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584035 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-registry-tls\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.584099 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584052 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65511292-ed53-470e-b6d8-1f63298f72b1-trusted-ca\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.584099 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584071 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65511292-ed53-470e-b6d8-1f63298f72b1-installation-pull-secrets\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.584099 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584091 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-bound-sa-token\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.584232 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584099 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3225f96-c165-4e94-a04e-c240136029e5-crio-socket\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.584232 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584155 2545 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-certificates\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:05:49.584232 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584171 2545 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-bound-sa-token\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:05:49.584232 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584181 2545 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b6265870-d5cd-431f-b9c4-360a64f6102a-ca-trust-extracted\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:05:49.584232 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584190 2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b6265870-d5cd-431f-b9c4-360a64f6102a-trusted-ca\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:05:49.584232 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584200 2545 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-installation-pull-secrets\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:05:49.584232 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584210 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntghn\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-kube-api-access-ntghn\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:05:49.584232 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584220 2545 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b6265870-d5cd-431f-b9c4-360a64f6102a-image-registry-private-configuration\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:05:49.584453 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.584302 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3225f96-c165-4e94-a04e-c240136029e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.586034 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.586015 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3225f96-c165-4e94-a04e-c240136029e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.591635 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.591614 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2sbd\" (UniqueName: \"kubernetes.io/projected/b3225f96-c165-4e94-a04e-c240136029e5-kube-api-access-m2sbd\") pod \"insights-runtime-extractor-hhm9b\" (UID: \"b3225f96-c165-4e94-a04e-c240136029e5\") " pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.663637 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.663599 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hhm9b" May 20 17:05:49.685680 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.685648 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65511292-ed53-470e-b6d8-1f63298f72b1-ca-trust-extracted\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.685805 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.685711 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65511292-ed53-470e-b6d8-1f63298f72b1-image-registry-private-configuration\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.685805 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.685762 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8kjg\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-kube-api-access-c8kjg\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.685961 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.685938 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-registry-tls\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.686013 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.685978 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65511292-ed53-470e-b6d8-1f63298f72b1-trusted-ca\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.686065 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.686007 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65511292-ed53-470e-b6d8-1f63298f72b1-installation-pull-secrets\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.686065 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.686035 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-bound-sa-token\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.686065 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.686060 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65511292-ed53-470e-b6d8-1f63298f72b1-ca-trust-extracted\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.686215 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.686111 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65511292-ed53-470e-b6d8-1f63298f72b1-registry-certificates\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.686914 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.686887 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65511292-ed53-470e-b6d8-1f63298f72b1-registry-certificates\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.687077 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.687043 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65511292-ed53-470e-b6d8-1f63298f72b1-trusted-ca\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.688356 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.688323 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65511292-ed53-470e-b6d8-1f63298f72b1-image-registry-private-configuration\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.688447 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.688358 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65511292-ed53-470e-b6d8-1f63298f72b1-installation-pull-secrets\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.688496 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.688447 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-registry-tls\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.694732 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.694706 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8kjg\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-kube-api-access-c8kjg\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.694884 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.694868 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65511292-ed53-470e-b6d8-1f63298f72b1-bound-sa-token\") pod \"image-registry-599f8769dc-tgx8b\" (UID: \"65511292-ed53-470e-b6d8-1f63298f72b1\") " pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.764948 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.764916 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vxf4h\"" May 20 17:05:49.773778 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.773738 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:49.787130 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.787101 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hhm9b"] May 20 17:05:49.790230 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:05:49.790204 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3225f96_c165_4e94_a04e_c240136029e5.slice/crio-750f87b272230d5c8a8919ca0fab01ffe6bc76557ce67c17f8aae3591389df0d WatchSource:0}: Error finding container 750f87b272230d5c8a8919ca0fab01ffe6bc76557ce67c17f8aae3591389df0d: Status 404 returned error can't find the container with id 750f87b272230d5c8a8919ca0fab01ffe6bc76557ce67c17f8aae3591389df0d May 20 17:05:49.915011 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:49.914938 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-599f8769dc-tgx8b"] May 20 17:05:49.917888 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:05:49.917859 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65511292_ed53_470e_b6d8_1f63298f72b1.slice/crio-dfe42ecb070bc558f080834fa8c41d8d1aad715a4822a1e9946f858ec8636957 WatchSource:0}: Error finding container dfe42ecb070bc558f080834fa8c41d8d1aad715a4822a1e9946f858ec8636957: Status 404 returned error can't find the container with id dfe42ecb070bc558f080834fa8c41d8d1aad715a4822a1e9946f858ec8636957 May 20 17:05:50.388189 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.388152 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" event={"ID":"65511292-ed53-470e-b6d8-1f63298f72b1","Type":"ContainerStarted","Data":"4cf8ab2f4d0d98f92281707fe46c81ea5c70cbcf0bb2169067e33f133d3543e3"} May 20 17:05:50.388648 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.388195 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" event={"ID":"65511292-ed53-470e-b6d8-1f63298f72b1","Type":"ContainerStarted","Data":"dfe42ecb070bc558f080834fa8c41d8d1aad715a4822a1e9946f858ec8636957"} May 20 17:05:50.388648 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.388422 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:05:50.389367 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.389349 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6686985-r522f" May 20 17:05:50.389415 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.389360 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hhm9b" event={"ID":"b3225f96-c165-4e94-a04e-c240136029e5","Type":"ContainerStarted","Data":"a5d1780cc2d635deab68c6d271995f0a2b305b82b3557e9d67f1e8beea938a28"} May 20 17:05:50.389415 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.389382 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hhm9b" event={"ID":"b3225f96-c165-4e94-a04e-c240136029e5","Type":"ContainerStarted","Data":"750f87b272230d5c8a8919ca0fab01ffe6bc76557ce67c17f8aae3591389df0d"} May 20 17:05:50.407467 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.407421 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" podStartSLOduration=1.407403189 podStartE2EDuration="1.407403189s" podCreationTimestamp="2026-05-20 17:05:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:05:50.406205734 +0000 UTC m=+161.993799876" watchObservedRunningTime="2026-05-20 17:05:50.407403189 +0000 UTC m=+161.994997350" May 20 17:05:50.435206 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.435177 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c6686985-r522f"] May 20 17:05:50.439065 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.439040 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75c6686985-r522f"] May 20 17:05:50.594652 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:50.594627 2545 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b6265870-d5cd-431f-b9c4-360a64f6102a-registry-tls\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:05:51.000949 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.000875 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6265870-d5cd-431f-b9c4-360a64f6102a" path="/var/lib/kubelet/pods/b6265870-d5cd-431f-b9c4-360a64f6102a/volumes" May 20 17:05:51.301412 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.301305 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:05:51.301412 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.301375 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:05:51.303792 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.303767 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca9f9425-4e00-4c84-b300-986da4c1af18-cert\") pod \"ingress-canary-qzhh4\" (UID: \"ca9f9425-4e00-4c84-b300-986da4c1af18\") " pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:05:51.303892 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.303793 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db386cd-2c26-442f-9aa1-2cf0dad4dff1-metrics-tls\") pod \"dns-default-g4lvm\" (UID: \"0db386cd-2c26-442f-9aa1-2cf0dad4dff1\") " pod="openshift-dns/dns-default-g4lvm" May 20 17:05:51.393494 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.393460 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hhm9b" event={"ID":"b3225f96-c165-4e94-a04e-c240136029e5","Type":"ContainerStarted","Data":"f48c5c3354cc29671577dceefbe83364252ccf6d58c614535e34b35fde0278e1"} May 20 17:05:51.481948 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.481912 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qmxjm\"" May 20 17:05:51.490804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.490769 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4lvm" May 20 17:05:51.503066 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.503024 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:51.503213 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.503168 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:51.503983 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.503940 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0e91cd-ff0f-457c-b590-0cfd20195080-service-ca-bundle\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:51.506059 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.506037 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd0e91cd-ff0f-457c-b590-0cfd20195080-metrics-certs\") pod \"router-default-9bd656cc6-7rtjg\" (UID: \"dd0e91cd-ff0f-457c-b590-0cfd20195080\") " pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:51.536144 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.536093 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:51.628373 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.628343 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g4lvm"] May 20 17:05:51.633476 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:05:51.633268 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db386cd_2c26_442f_9aa1_2cf0dad4dff1.slice/crio-397b450429799a4f0b460db816de3081e28599b84e05dda643ec693181ca8049 WatchSource:0}: Error finding container 397b450429799a4f0b460db816de3081e28599b84e05dda643ec693181ca8049: Status 404 returned error can't find the container with id 397b450429799a4f0b460db816de3081e28599b84e05dda643ec693181ca8049 May 20 17:05:51.683396 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:51.683369 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9bd656cc6-7rtjg"] May 20 17:05:51.686762 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:05:51.686733 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0e91cd_ff0f_457c_b590_0cfd20195080.slice/crio-4fcb3bda0730aca4746d1954f3aaaabb7cc9f4758ffdf69d514d2793582753bd WatchSource:0}: Error finding container 4fcb3bda0730aca4746d1954f3aaaabb7cc9f4758ffdf69d514d2793582753bd: Status 404 returned error can't find the container with id 4fcb3bda0730aca4746d1954f3aaaabb7cc9f4758ffdf69d514d2793582753bd May 20 17:05:52.398273 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:52.398223 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hhm9b" event={"ID":"b3225f96-c165-4e94-a04e-c240136029e5","Type":"ContainerStarted","Data":"33727ba2508e6eb4dcc09f1bd5b5cbe29235662506682bfe9b2fe4b7612e67d8"} May 20 17:05:52.399825 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:52.399791 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" event={"ID":"dd0e91cd-ff0f-457c-b590-0cfd20195080","Type":"ContainerStarted","Data":"4f1278f97ef35c19ff2274305cf52a9874630ce8551292b0e96d0aa271c9c747"} May 20 17:05:52.399825 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:52.399827 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" event={"ID":"dd0e91cd-ff0f-457c-b590-0cfd20195080","Type":"ContainerStarted","Data":"4fcb3bda0730aca4746d1954f3aaaabb7cc9f4758ffdf69d514d2793582753bd"} May 20 17:05:52.400851 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:52.400825 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4lvm" event={"ID":"0db386cd-2c26-442f-9aa1-2cf0dad4dff1","Type":"ContainerStarted","Data":"397b450429799a4f0b460db816de3081e28599b84e05dda643ec693181ca8049"} May 20 17:05:52.417031 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:52.416991 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hhm9b" podStartSLOduration=1.097979168 podStartE2EDuration="3.416981555s" podCreationTimestamp="2026-05-20 17:05:49 +0000 UTC" firstStartedPulling="2026-05-20 17:05:49.869740841 +0000 UTC m=+161.457334958" lastFinishedPulling="2026-05-20 17:05:52.188743223 +0000 UTC m=+163.776337345" observedRunningTime="2026-05-20 17:05:52.415817216 +0000 UTC m=+164.003411369" watchObservedRunningTime="2026-05-20 17:05:52.416981555 +0000 UTC m=+164.004575694" May 20 17:05:52.442268 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:52.440365 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" podStartSLOduration=33.440348962 podStartE2EDuration="33.440348962s" podCreationTimestamp="2026-05-20 17:05:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:05:52.439717814 +0000 UTC m=+164.027311948" watchObservedRunningTime="2026-05-20 17:05:52.440348962 +0000 UTC m=+164.027943103" May 20 17:05:52.536737 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:52.536695 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:52.539445 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:52.539419 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:53.405733 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:53.405640 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4lvm" event={"ID":"0db386cd-2c26-442f-9aa1-2cf0dad4dff1","Type":"ContainerStarted","Data":"c1cc7b73a7315f7ecc681dc127804b8d75e6555752b8b72bf2b70664411e3917"} May 20 17:05:53.405733 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:53.405687 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4lvm" event={"ID":"0db386cd-2c26-442f-9aa1-2cf0dad4dff1","Type":"ContainerStarted","Data":"7ec3589179c6931bb4de0460bd4b03ff9c144814651f5fca6c76d12e8e2178c2"} May 20 17:05:53.406167 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:53.405896 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g4lvm" May 20 17:05:53.406167 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:53.406104 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:53.407372 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:53.407353 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9bd656cc6-7rtjg" May 20 17:05:53.421002 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:53.420963 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-g4lvm" podStartSLOduration=128.91186898 podStartE2EDuration="2m10.42095024s" podCreationTimestamp="2026-05-20 17:03:43 +0000 UTC" firstStartedPulling="2026-05-20 17:05:51.635823045 +0000 UTC m=+163.223417167" lastFinishedPulling="2026-05-20 17:05:53.144904286 +0000 UTC m=+164.732498427" observedRunningTime="2026-05-20 17:05:53.420840493 +0000 UTC m=+165.008434634" watchObservedRunningTime="2026-05-20 17:05:53.42095024 +0000 UTC m=+165.008544380" May 20 17:05:56.998874 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:56.998840 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:05:57.001526 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:57.001501 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4kg2\"" May 20 17:05:57.009482 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:57.009465 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzhh4" May 20 17:05:57.139354 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:57.139321 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzhh4"] May 20 17:05:57.142774 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:05:57.142750 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9f9425_4e00_4c84_b300_986da4c1af18.slice/crio-672bd5fd53266a66bf3f54a3fa8111d352cba37f38fe72f54374226228895407 WatchSource:0}: Error finding container 672bd5fd53266a66bf3f54a3fa8111d352cba37f38fe72f54374226228895407: Status 404 returned error can't find the container with id 672bd5fd53266a66bf3f54a3fa8111d352cba37f38fe72f54374226228895407 May 20 17:05:57.417768 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:57.417734 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzhh4" event={"ID":"ca9f9425-4e00-4c84-b300-986da4c1af18","Type":"ContainerStarted","Data":"672bd5fd53266a66bf3f54a3fa8111d352cba37f38fe72f54374226228895407"} May 20 17:05:59.423671 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:59.423634 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzhh4" event={"ID":"ca9f9425-4e00-4c84-b300-986da4c1af18","Type":"ContainerStarted","Data":"1fa16c6b4d13ccfc7d6cd7a44f3ad1c607343d097eb2ce0af4c97d6649fe7a93"} May 20 17:05:59.439619 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:05:59.439577 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qzhh4" podStartSLOduration=134.494862933 podStartE2EDuration="2m16.439564962s" podCreationTimestamp="2026-05-20 17:03:43 +0000 UTC" firstStartedPulling="2026-05-20 17:05:57.144732631 +0000 UTC m=+168.732326749" lastFinishedPulling="2026-05-20 17:05:59.089434656 +0000 UTC m=+170.677028778" observedRunningTime="2026-05-20 17:05:59.438059537 +0000 UTC m=+171.025653689" watchObservedRunningTime="2026-05-20 17:05:59.439564962 +0000 UTC m=+171.027159102" May 20 17:06:01.998854 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:01.998818 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:06:03.114157 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.114123 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x925f"] May 20 17:06:03.117369 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.117347 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.122776 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.122750 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 20 17:06:03.123624 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.123604 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 17:06:03.124574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.124010 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ljg92\"" May 20 17:06:03.124574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.124023 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 17:06:03.124574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.124402 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 20 17:06:03.124574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.124064 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 17:06:03.127934 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.127914 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x925f"] May 20 17:06:03.135669 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.135649 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj"] May 20 17:06:03.138451 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.138434 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.141961 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.141378 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xvtcp\"" May 20 17:06:03.141961 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.141415 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 20 17:06:03.142304 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.142279 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 20 17:06:03.142601 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.142581 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 20 17:06:03.143221 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.143195 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rgx98"] May 20 17:06:03.146716 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.146697 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.148482 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.148464 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9wj78\"" May 20 17:06:03.148951 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.148935 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 17:06:03.149057 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.149038 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 17:06:03.149057 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.148991 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 17:06:03.151731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.151700 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj"] May 20 17:06:03.289846 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.289813 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.289846 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.289857 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c24d8a59-7bac-4a6c-b551-16d2797363c4-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.290082 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.289889 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.290082 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.289917 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-tls\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290082 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.289960 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.290082 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290008 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162e8871-064e-4c8d-ac88-8e9f05004281-metrics-client-ca\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290082 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290068 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-465hd\" (UniqueName: \"kubernetes.io/projected/c24d8a59-7bac-4a6c-b551-16d2797363c4-kube-api-access-465hd\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.290296 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290092 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-sys\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290296 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290115 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f28fd914-3db3-4f97-971c-9aeebda65314-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.290296 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290138 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.290296 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290222 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-root\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290448 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290286 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tnqj\" (UniqueName: \"kubernetes.io/projected/f28fd914-3db3-4f97-971c-9aeebda65314-kube-api-access-4tnqj\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.290448 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290334 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290448 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290365 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc2tq\" (UniqueName: \"kubernetes.io/projected/162e8871-064e-4c8d-ac88-8e9f05004281-kube-api-access-lc2tq\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290448 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290391 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-wtmp\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290448 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290419 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290478 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f28fd914-3db3-4f97-971c-9aeebda65314-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.290642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290567 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-textfile\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.290642 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.290595 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.391050 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391013 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.391229 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391062 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-tls\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391240 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.391347 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391310 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162e8871-064e-4c8d-ac88-8e9f05004281-metrics-client-ca\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391410 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391361 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-465hd\" (UniqueName: \"kubernetes.io/projected/c24d8a59-7bac-4a6c-b551-16d2797363c4-kube-api-access-465hd\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.391410 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391390 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-sys\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391514 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391417 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f28fd914-3db3-4f97-971c-9aeebda65314-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.391514 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391444 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.391514 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391476 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-root\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391514 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391507 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tnqj\" (UniqueName: \"kubernetes.io/projected/f28fd914-3db3-4f97-971c-9aeebda65314-kube-api-access-4tnqj\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.391738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391523 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-sys\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391564 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391593 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lc2tq\" (UniqueName: \"kubernetes.io/projected/162e8871-064e-4c8d-ac88-8e9f05004281-kube-api-access-lc2tq\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391619 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-wtmp\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391647 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.391738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391689 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f28fd914-3db3-4f97-971c-9aeebda65314-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.392026 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391754 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-textfile\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.392026 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391779 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.392026 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391809 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.392026 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391832 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c24d8a59-7bac-4a6c-b551-16d2797363c4-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.392026 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.391839 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.392268 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.392060 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162e8871-064e-4c8d-ac88-8e9f05004281-metrics-client-ca\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.392268 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.392199 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-root\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.392519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.392495 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c24d8a59-7bac-4a6c-b551-16d2797363c4-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.392616 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.392517 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f28fd914-3db3-4f97-971c-9aeebda65314-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.392686 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.392666 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-wtmp\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.392912 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:06:03.392893 2545 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 20 17:06:03.392978 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:06:03.392964 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-tls podName:f28fd914-3db3-4f97-971c-9aeebda65314 nodeName:}" failed. No retries permitted until 2026-05-20 17:06:03.892944897 +0000 UTC m=+175.480539029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-rrslj" (UID: "f28fd914-3db3-4f97-971c-9aeebda65314") : secret "kube-state-metrics-tls" not found May 20 17:06:03.393045 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.392974 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.393235 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:06:03.393214 2545 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 20 17:06:03.393290 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:06:03.393270 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-tls podName:c24d8a59-7bac-4a6c-b551-16d2797363c4 nodeName:}" failed. No retries permitted until 2026-05-20 17:06:03.893256269 +0000 UTC m=+175.480850395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-x925f" (UID: "c24d8a59-7bac-4a6c-b551-16d2797363c4") : secret "openshift-state-metrics-tls" not found May 20 17:06:03.393424 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.393404 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-textfile\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.393865 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.393846 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f28fd914-3db3-4f97-971c-9aeebda65314-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.395056 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.394819 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-tls\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.395056 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.394991 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.395351 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.395300 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/162e8871-064e-4c8d-ac88-8e9f05004281-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.395746 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.395724 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.401040 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.401009 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc2tq\" (UniqueName: \"kubernetes.io/projected/162e8871-064e-4c8d-ac88-8e9f05004281-kube-api-access-lc2tq\") pod \"node-exporter-rgx98\" (UID: \"162e8871-064e-4c8d-ac88-8e9f05004281\") " pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.401577 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.401555 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-465hd\" (UniqueName: \"kubernetes.io/projected/c24d8a59-7bac-4a6c-b551-16d2797363c4-kube-api-access-465hd\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.401659 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.401596 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tnqj\" (UniqueName: \"kubernetes.io/projected/f28fd914-3db3-4f97-971c-9aeebda65314-kube-api-access-4tnqj\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.410409 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.410382 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g4lvm" May 20 17:06:03.457179 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.457148 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgx98" May 20 17:06:03.465296 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:03.465265 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162e8871_064e_4c8d_ac88_8e9f05004281.slice/crio-3c6b47efef21830736aaa02132b47791898a586aaebf3460c9662896ed44fbbd WatchSource:0}: Error finding container 3c6b47efef21830736aaa02132b47791898a586aaebf3460c9662896ed44fbbd: Status 404 returned error can't find the container with id 3c6b47efef21830736aaa02132b47791898a586aaebf3460c9662896ed44fbbd May 20 17:06:03.897023 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.896985 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.897209 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.897083 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:03.899629 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.899600 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c24d8a59-7bac-4a6c-b551-16d2797363c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-x925f\" (UID: \"c24d8a59-7bac-4a6c-b551-16d2797363c4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:03.900014 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:03.899987 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f28fd914-3db3-4f97-971c-9aeebda65314-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-rrslj\" (UID: \"f28fd914-3db3-4f97-971c-9aeebda65314\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:04.034709 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.034669 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" May 20 17:06:04.048553 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.048510 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" May 20 17:06:04.190803 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.190476 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-x925f"] May 20 17:06:04.193226 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.193203 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:06:04.197353 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.197334 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.199938 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.199787 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 20 17:06:04.199938 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.199848 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 20 17:06:04.199938 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.199859 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 20 17:06:04.200161 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.200138 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 20 17:06:04.203054 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.203036 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 20 17:06:04.203338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.203041 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 20 17:06:04.203338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.203089 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 20 17:06:04.203338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.203303 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 20 17:06:04.203590 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.203460 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j454z\"" May 20 17:06:04.203590 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.203511 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 20 17:06:04.212447 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.212425 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:06:04.215125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.215086 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj"] May 20 17:06:04.300456 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300420 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-out\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.300456 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300465 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.300751 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300495 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.300751 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300525 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.300751 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300579 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.300751 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300700 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-web-config\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.300751 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300743 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.301010 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300789 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.301010 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300868 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.301010 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300924 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.301010 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300951 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.301010 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.300981 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q2kk\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-kube-api-access-9q2kk\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.301215 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.301030 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.380033 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:04.379996 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28fd914_3db3_4f97_971c_9aeebda65314.slice/crio-f62f71b743c2fb51fb3bfd330315b6632195ffe83104f69b5ee6b82376438015 WatchSource:0}: Error finding container f62f71b743c2fb51fb3bfd330315b6632195ffe83104f69b5ee6b82376438015: Status 404 returned error can't find the container with id f62f71b743c2fb51fb3bfd330315b6632195ffe83104f69b5ee6b82376438015 May 20 17:06:04.380610 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:04.380583 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24d8a59_7bac_4a6c_b551_16d2797363c4.slice/crio-aabb36249a9a7382f77d1bc0d4265989d55e63f356d8fdcd48f37409974edd88 WatchSource:0}: Error finding container aabb36249a9a7382f77d1bc0d4265989d55e63f356d8fdcd48f37409974edd88: Status 404 returned error can't find the container with id aabb36249a9a7382f77d1bc0d4265989d55e63f356d8fdcd48f37409974edd88 May 20 17:06:04.402211 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402155 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-web-config\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402211 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402202 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402358 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402242 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402358 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402285 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402358 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402333 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402513 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402358 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402513 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:06:04.402425 2545 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found May 20 17:06:04.402513 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:06:04.402485 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls podName:5445e5a0-0e06-4fc9-b7fc-5c48080d18d5 nodeName:}" failed. No retries permitted until 2026-05-20 17:06:04.902465245 +0000 UTC m=+176.490059368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5") : secret "alertmanager-main-tls" not found May 20 17:06:04.402513 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402508 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9q2kk\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-kube-api-access-9q2kk\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402741 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402559 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402741 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402595 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-out\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402741 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402621 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402741 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402648 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402741 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402680 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.402741 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.402711 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.403147 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.403124 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.403782 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.403675 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.403895 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.403825 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.405466 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.405435 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.406237 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.406171 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.406380 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.406337 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.407089 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.406835 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.407089 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.407048 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.407954 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.407918 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.408032 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.407978 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-web-config\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.408552 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.408516 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-out\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.414815 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.414794 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q2kk\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-kube-api-access-9q2kk\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.438885 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.438853 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" event={"ID":"f28fd914-3db3-4f97-971c-9aeebda65314","Type":"ContainerStarted","Data":"f62f71b743c2fb51fb3bfd330315b6632195ffe83104f69b5ee6b82376438015"} May 20 17:06:04.440300 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.440272 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgx98" event={"ID":"162e8871-064e-4c8d-ac88-8e9f05004281","Type":"ContainerStarted","Data":"3c6b47efef21830736aaa02132b47791898a586aaebf3460c9662896ed44fbbd"} May 20 17:06:04.441930 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.441900 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" event={"ID":"c24d8a59-7bac-4a6c-b551-16d2797363c4","Type":"ContainerStarted","Data":"aabb36249a9a7382f77d1bc0d4265989d55e63f356d8fdcd48f37409974edd88"} May 20 17:06:04.907553 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.907505 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:04.909921 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:04.909892 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:05.107989 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:05.107955 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 17:06:05.255356 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:05.255334 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:06:05.258326 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:05.258282 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5445e5a0_0e06_4fc9_b7fc_5c48080d18d5.slice/crio-396dcf6cfb293ca4fa117cfeafec9c2b163bb211915d1633322bcef32bbb1da2 WatchSource:0}: Error finding container 396dcf6cfb293ca4fa117cfeafec9c2b163bb211915d1633322bcef32bbb1da2: Status 404 returned error can't find the container with id 396dcf6cfb293ca4fa117cfeafec9c2b163bb211915d1633322bcef32bbb1da2 May 20 17:06:05.448808 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:05.447769 2545 generic.go:358] "Generic (PLEG): container finished" podID="162e8871-064e-4c8d-ac88-8e9f05004281" containerID="d3638672314190cf8150ba836a07eefb5b8727451ab762e949caddcbbe4a5916" exitCode=0 May 20 17:06:05.448808 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:05.447851 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgx98" event={"ID":"162e8871-064e-4c8d-ac88-8e9f05004281","Type":"ContainerDied","Data":"d3638672314190cf8150ba836a07eefb5b8727451ab762e949caddcbbe4a5916"} May 20 17:06:05.451001 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:05.450968 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerStarted","Data":"396dcf6cfb293ca4fa117cfeafec9c2b163bb211915d1633322bcef32bbb1da2"} May 20 17:06:05.452999 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:05.452968 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" event={"ID":"c24d8a59-7bac-4a6c-b551-16d2797363c4","Type":"ContainerStarted","Data":"425a8ebc89c490bd1cc08f4839cb6d985e3bcdd2ac73add4158c2f6acc64d427"} May 20 17:06:05.452999 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:05.453005 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" event={"ID":"c24d8a59-7bac-4a6c-b551-16d2797363c4","Type":"ContainerStarted","Data":"b043ed9d0ec206073bbd1a0d98bb1f1f08a3d0dca8173ab88dfe3a79227c9009"} May 20 17:06:06.125830 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.121135 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57cb87977f-nxpj8"] May 20 17:06:06.131201 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.129419 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.132908 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.132767 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 20 17:06:06.134663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.133063 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 20 17:06:06.134663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.133387 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bceh33fj01mjr\"" May 20 17:06:06.134663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.133645 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hvw6h\"" May 20 17:06:06.134663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.133837 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 20 17:06:06.134663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.134387 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 20 17:06:06.134663 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.134462 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 20 17:06:06.149780 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.146483 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57cb87977f-nxpj8"] May 20 17:06:06.320295 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.320256 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55bd6a06-0acd-4884-94b3-907a83f6f5e6-metrics-client-ca\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.320665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.320307 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-grpc-tls\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.320665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.320386 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.320665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.320415 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.320665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.320443 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwqt4\" (UniqueName: \"kubernetes.io/projected/55bd6a06-0acd-4884-94b3-907a83f6f5e6-kube-api-access-wwqt4\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.320665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.320551 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.320665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.320631 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-tls\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.320852 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.320704 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.421906 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.421868 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-tls\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.422065 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.421954 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.422065 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.422000 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55bd6a06-0acd-4884-94b3-907a83f6f5e6-metrics-client-ca\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.422065 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.422027 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-grpc-tls\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.422246 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.422067 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.422246 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.422110 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.422246 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.422139 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwqt4\" (UniqueName: \"kubernetes.io/projected/55bd6a06-0acd-4884-94b3-907a83f6f5e6-kube-api-access-wwqt4\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.422246 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.422188 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.424848 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.424315 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55bd6a06-0acd-4884-94b3-907a83f6f5e6-metrics-client-ca\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.425925 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.425871 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.426799 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.426759 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.427322 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.427287 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-grpc-tls\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.427412 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.427359 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-tls\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.428149 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.428106 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.428712 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.428665 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55bd6a06-0acd-4884-94b3-907a83f6f5e6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.437883 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.437839 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwqt4\" (UniqueName: \"kubernetes.io/projected/55bd6a06-0acd-4884-94b3-907a83f6f5e6-kube-api-access-wwqt4\") pod \"thanos-querier-57cb87977f-nxpj8\" (UID: \"55bd6a06-0acd-4884-94b3-907a83f6f5e6\") " pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.452614 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.452590 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:06.457884 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.457820 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" event={"ID":"c24d8a59-7bac-4a6c-b551-16d2797363c4","Type":"ContainerStarted","Data":"45cb44eeb4709b3a31993c38dd2e526526308fa8c8b87200c872507d7bae7bd5"} May 20 17:06:06.460061 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.459979 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" event={"ID":"f28fd914-3db3-4f97-971c-9aeebda65314","Type":"ContainerStarted","Data":"ff30236f8016bdb09327a18f60019cc0a27d44b4a39c6f4d72821e1fecfb78d1"} May 20 17:06:06.460061 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.460019 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" event={"ID":"f28fd914-3db3-4f97-971c-9aeebda65314","Type":"ContainerStarted","Data":"f4e5d786378208e42b1a661aad51269d14d1676f37b926f76afa39556534b26b"} May 20 17:06:06.460061 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.460037 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" event={"ID":"f28fd914-3db3-4f97-971c-9aeebda65314","Type":"ContainerStarted","Data":"aa524045b811218465696742425e51b147ca39f50035a56c4182a737c6b05e87"} May 20 17:06:06.462323 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.462296 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgx98" event={"ID":"162e8871-064e-4c8d-ac88-8e9f05004281","Type":"ContainerStarted","Data":"1d5c1d816fe7e3727aff6f6fbc2d8cdc859a4c182ee5410c0b02d774693057fb"} May 20 17:06:06.462437 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.462332 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgx98" event={"ID":"162e8871-064e-4c8d-ac88-8e9f05004281","Type":"ContainerStarted","Data":"697c7ac7c50fe43e75c4372b456193a5dad100ae6cf3aaa6964609ab4e061765"} May 20 17:06:06.476692 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.476644 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-x925f" podStartSLOduration=2.066984534 podStartE2EDuration="3.476630622s" podCreationTimestamp="2026-05-20 17:06:03 +0000 UTC" firstStartedPulling="2026-05-20 17:06:04.53943208 +0000 UTC m=+176.127026201" lastFinishedPulling="2026-05-20 17:06:05.949078155 +0000 UTC m=+177.536672289" observedRunningTime="2026-05-20 17:06:06.475199438 +0000 UTC m=+178.062793579" watchObservedRunningTime="2026-05-20 17:06:06.476630622 +0000 UTC m=+178.064224782" May 20 17:06:06.495904 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.495804 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rgx98" podStartSLOduration=2.537717546 podStartE2EDuration="3.495783654s" podCreationTimestamp="2026-05-20 17:06:03 +0000 UTC" firstStartedPulling="2026-05-20 17:06:03.466890975 +0000 UTC m=+175.054485096" lastFinishedPulling="2026-05-20 17:06:04.424957086 +0000 UTC m=+176.012551204" observedRunningTime="2026-05-20 17:06:06.495372507 +0000 UTC m=+178.082966648" watchObservedRunningTime="2026-05-20 17:06:06.495783654 +0000 UTC m=+178.083377796" May 20 17:06:06.514708 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.514640 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-rrslj" podStartSLOduration=1.949747167 podStartE2EDuration="3.514619326s" podCreationTimestamp="2026-05-20 17:06:03 +0000 UTC" firstStartedPulling="2026-05-20 17:06:04.382086624 +0000 UTC m=+175.969680742" lastFinishedPulling="2026-05-20 17:06:05.946958781 +0000 UTC m=+177.534552901" observedRunningTime="2026-05-20 17:06:06.513227191 +0000 UTC m=+178.100821331" watchObservedRunningTime="2026-05-20 17:06:06.514619326 +0000 UTC m=+178.102213664" May 20 17:06:06.604594 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:06.604560 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57cb87977f-nxpj8"] May 20 17:06:06.746124 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:06.746052 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bd6a06_0acd_4884_94b3_907a83f6f5e6.slice/crio-fa938e6ebebd677faa37d159f746eb90a04ed4968f052959bc562fcebb710459 WatchSource:0}: Error finding container fa938e6ebebd677faa37d159f746eb90a04ed4968f052959bc562fcebb710459: Status 404 returned error can't find the container with id fa938e6ebebd677faa37d159f746eb90a04ed4968f052959bc562fcebb710459 May 20 17:06:07.466945 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.466908 2545 generic.go:358] "Generic (PLEG): container finished" podID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerID="c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab" exitCode=0 May 20 17:06:07.467414 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.466958 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerDied","Data":"c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab"} May 20 17:06:07.468651 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.468605 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" event={"ID":"55bd6a06-0acd-4884-94b3-907a83f6f5e6","Type":"ContainerStarted","Data":"fa938e6ebebd677faa37d159f746eb90a04ed4968f052959bc562fcebb710459"} May 20 17:06:07.512896 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.512866 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65f745f78b-ksfzh"] May 20 17:06:07.516219 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.516201 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.523213 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.523162 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 20 17:06:07.523441 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.523296 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 17:06:07.523559 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.523475 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-78r4635cip86j\"" May 20 17:06:07.523559 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.523517 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 20 17:06:07.523559 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.523551 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 20 17:06:07.524049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.524024 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zwsx9\"" May 20 17:06:07.535840 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.535823 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65f745f78b-ksfzh"] May 20 17:06:07.633644 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.633603 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0834c75-e935-4826-83e9-e6f5cce8180c-metrics-server-audit-profiles\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.634045 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.634023 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-secret-metrics-server-client-certs\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.634166 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.634084 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-client-ca-bundle\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.634599 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.634573 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2mbb\" (UniqueName: \"kubernetes.io/projected/f0834c75-e935-4826-83e9-e6f5cce8180c-kube-api-access-c2mbb\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.634723 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.634613 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0834c75-e935-4826-83e9-e6f5cce8180c-audit-log\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.634782 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.634752 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-secret-metrics-server-tls\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.634838 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.634788 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0834c75-e935-4826-83e9-e6f5cce8180c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.735717 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.735612 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0834c75-e935-4826-83e9-e6f5cce8180c-metrics-server-audit-profiles\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.735717 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.735673 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-secret-metrics-server-client-certs\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.735717 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.735698 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-client-ca-bundle\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.736021 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.735749 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2mbb\" (UniqueName: \"kubernetes.io/projected/f0834c75-e935-4826-83e9-e6f5cce8180c-kube-api-access-c2mbb\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.736021 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.735780 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0834c75-e935-4826-83e9-e6f5cce8180c-audit-log\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.736021 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.735807 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-secret-metrics-server-tls\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.736021 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.735828 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0834c75-e935-4826-83e9-e6f5cce8180c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.736502 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.736475 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0834c75-e935-4826-83e9-e6f5cce8180c-audit-log\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.736617 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.736501 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0834c75-e935-4826-83e9-e6f5cce8180c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.736810 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.736751 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0834c75-e935-4826-83e9-e6f5cce8180c-metrics-server-audit-profiles\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.738840 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.738820 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-client-ca-bundle\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.738928 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.738906 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-secret-metrics-server-client-certs\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.739150 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.739133 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0834c75-e935-4826-83e9-e6f5cce8180c-secret-metrics-server-tls\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.744148 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.744125 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2mbb\" (UniqueName: \"kubernetes.io/projected/f0834c75-e935-4826-83e9-e6f5cce8180c-kube-api-access-c2mbb\") pod \"metrics-server-65f745f78b-ksfzh\" (UID: \"f0834c75-e935-4826-83e9-e6f5cce8180c\") " pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.827364 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.827333 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:07.959974 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:07.959940 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65f745f78b-ksfzh"] May 20 17:06:07.963461 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:07.963429 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0834c75_e935_4826_83e9_e6f5cce8180c.slice/crio-008db91a8a0aeceacc8471b8b8d5ea2c86e8d715f9e1b13651a38e052fb84d8b WatchSource:0}: Error finding container 008db91a8a0aeceacc8471b8b8d5ea2c86e8d715f9e1b13651a38e052fb84d8b: Status 404 returned error can't find the container with id 008db91a8a0aeceacc8471b8b8d5ea2c86e8d715f9e1b13651a38e052fb84d8b May 20 17:06:08.324904 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.324869 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c66b7b56b-646ds"] May 20 17:06:08.328590 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.328558 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.330856 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.330828 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 20 17:06:08.331030 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.331010 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 20 17:06:08.331091 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.331039 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 20 17:06:08.331091 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.331060 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zfw4w\"" May 20 17:06:08.331197 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.331139 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 20 17:06:08.331253 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.331193 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 20 17:06:08.336897 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.336872 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 20 17:06:08.341629 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.341603 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c66b7b56b-646ds"] May 20 17:06:08.342783 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.342757 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-serving-certs-ca-bundle\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.342881 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.342801 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-metrics-client-ca\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.342881 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.342839 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.342881 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.342874 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-federate-client-tls\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.343031 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.342962 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-secret-telemeter-client\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.343031 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.342995 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.343031 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.343026 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-telemeter-client-tls\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.343176 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.343059 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7g2\" (UniqueName: \"kubernetes.io/projected/8501d0b1-9c5d-4f42-a468-0a988abc53f7-kube-api-access-mg7g2\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.443432 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.443385 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-secret-telemeter-client\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.443634 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.443441 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.443634 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.443469 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-telemeter-client-tls\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.443634 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.443495 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7g2\" (UniqueName: \"kubernetes.io/projected/8501d0b1-9c5d-4f42-a468-0a988abc53f7-kube-api-access-mg7g2\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.443634 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.443563 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-serving-certs-ca-bundle\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.443958 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.443930 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-metrics-client-ca\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.444088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.443993 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.444088 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.444025 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-federate-client-tls\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.444310 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.444265 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-serving-certs-ca-bundle\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.444707 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.444662 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-metrics-client-ca\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.444934 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.444907 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8501d0b1-9c5d-4f42-a468-0a988abc53f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.446583 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.446560 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.446892 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.446872 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-federate-client-tls\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.446966 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.446902 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-secret-telemeter-client\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.447328 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.447302 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8501d0b1-9c5d-4f42-a468-0a988abc53f7-telemeter-client-tls\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.456045 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.456013 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7g2\" (UniqueName: \"kubernetes.io/projected/8501d0b1-9c5d-4f42-a468-0a988abc53f7-kube-api-access-mg7g2\") pod \"telemeter-client-5c66b7b56b-646ds\" (UID: \"8501d0b1-9c5d-4f42-a468-0a988abc53f7\") " pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:08.472691 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.472619 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" event={"ID":"f0834c75-e935-4826-83e9-e6f5cce8180c","Type":"ContainerStarted","Data":"008db91a8a0aeceacc8471b8b8d5ea2c86e8d715f9e1b13651a38e052fb84d8b"} May 20 17:06:08.646209 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:08.646174 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" May 20 17:06:09.172499 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:09.172315 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c66b7b56b-646ds"] May 20 17:06:09.178107 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:09.178057 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8501d0b1_9c5d_4f42_a468_0a988abc53f7.slice/crio-d85ecc3fbb1dbda342129b04a32b99fd5bf91e311c188b6f2bff956dda7b07c7 WatchSource:0}: Error finding container d85ecc3fbb1dbda342129b04a32b99fd5bf91e311c188b6f2bff956dda7b07c7: Status 404 returned error can't find the container with id d85ecc3fbb1dbda342129b04a32b99fd5bf91e311c188b6f2bff956dda7b07c7 May 20 17:06:09.481178 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:09.481124 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" event={"ID":"8501d0b1-9c5d-4f42-a468-0a988abc53f7","Type":"ContainerStarted","Data":"d85ecc3fbb1dbda342129b04a32b99fd5bf91e311c188b6f2bff956dda7b07c7"} May 20 17:06:09.483302 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:09.483274 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" event={"ID":"55bd6a06-0acd-4884-94b3-907a83f6f5e6","Type":"ContainerStarted","Data":"b167093e8dd6ab626d0ec1359a13c193e5e0228d3748badfd1a8960fe585f38b"} May 20 17:06:09.483302 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:09.483308 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" event={"ID":"55bd6a06-0acd-4884-94b3-907a83f6f5e6","Type":"ContainerStarted","Data":"73947fe0f09281386e136e5ca192585640a173a70d272e4c685505707fc5ef8e"} May 20 17:06:09.483497 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:09.483331 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" event={"ID":"55bd6a06-0acd-4884-94b3-907a83f6f5e6","Type":"ContainerStarted","Data":"af1410b76ad46b7f21a67cd545ceb83aa4100381e65175bc474a84a76ff7698d"} May 20 17:06:10.491118 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:10.491003 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerStarted","Data":"ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe"} May 20 17:06:10.491118 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:10.491062 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerStarted","Data":"dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4"} May 20 17:06:10.491118 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:10.491076 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerStarted","Data":"00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8"} May 20 17:06:10.491118 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:10.491090 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerStarted","Data":"896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed"} May 20 17:06:10.491118 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:10.491102 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerStarted","Data":"64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489"} May 20 17:06:10.492824 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:10.492792 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" event={"ID":"f0834c75-e935-4826-83e9-e6f5cce8180c","Type":"ContainerStarted","Data":"305db6c409568b8146970f9707308ceb3b8bf3382a4fa52448d19c6061f677c7"} May 20 17:06:10.510134 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:10.510071 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" podStartSLOduration=1.42640987 podStartE2EDuration="3.510051714s" podCreationTimestamp="2026-05-20 17:06:07 +0000 UTC" firstStartedPulling="2026-05-20 17:06:07.966038922 +0000 UTC m=+179.553633040" lastFinishedPulling="2026-05-20 17:06:10.04968076 +0000 UTC m=+181.637274884" observedRunningTime="2026-05-20 17:06:10.508447075 +0000 UTC m=+182.096041216" watchObservedRunningTime="2026-05-20 17:06:10.510051714 +0000 UTC m=+182.097645856" May 20 17:06:11.397904 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:11.397871 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-599f8769dc-tgx8b" May 20 17:06:11.498121 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:11.498081 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" event={"ID":"55bd6a06-0acd-4884-94b3-907a83f6f5e6","Type":"ContainerStarted","Data":"32527977ae609f07fa0acb82c4b928b4433c295fa617931950a581ad45383596"} May 20 17:06:11.498519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:11.498130 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" event={"ID":"55bd6a06-0acd-4884-94b3-907a83f6f5e6","Type":"ContainerStarted","Data":"42715751d3711e463d2702d70bf182b8d6d5e048df6d9c70d978f677d10b2aac"} May 20 17:06:11.498519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:11.498144 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" event={"ID":"55bd6a06-0acd-4884-94b3-907a83f6f5e6","Type":"ContainerStarted","Data":"e82f55e4b133677f873704acdb8bd9e4212d3f9d0fc903e82b53b87db29c9611"} May 20 17:06:11.498519 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:11.498234 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:11.500756 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:11.500728 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerStarted","Data":"1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27"} May 20 17:06:11.519056 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:11.519013 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" podStartSLOduration=1.7087086729999998 podStartE2EDuration="5.518998513s" podCreationTimestamp="2026-05-20 17:06:06 +0000 UTC" firstStartedPulling="2026-05-20 17:06:06.748189322 +0000 UTC m=+178.335783458" lastFinishedPulling="2026-05-20 17:06:10.558479169 +0000 UTC m=+182.146073298" observedRunningTime="2026-05-20 17:06:11.517902073 +0000 UTC m=+183.105496213" watchObservedRunningTime="2026-05-20 17:06:11.518998513 +0000 UTC m=+183.106592652" May 20 17:06:11.557177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:11.557130 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.094510471 podStartE2EDuration="7.557113457s" podCreationTimestamp="2026-05-20 17:06:04 +0000 UTC" firstStartedPulling="2026-05-20 17:06:05.260698274 +0000 UTC m=+176.848292414" lastFinishedPulling="2026-05-20 17:06:10.723301278 +0000 UTC m=+182.310895400" observedRunningTime="2026-05-20 17:06:11.555397399 +0000 UTC m=+183.142991536" watchObservedRunningTime="2026-05-20 17:06:11.557113457 +0000 UTC m=+183.144707635" May 20 17:06:12.505402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:12.505361 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" event={"ID":"8501d0b1-9c5d-4f42-a468-0a988abc53f7","Type":"ContainerStarted","Data":"62b25b3ceaf795b276ca416317f7107346740154b2f4967cfaa8e2ee6ef26c02"} May 20 17:06:12.505402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:12.505405 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" event={"ID":"8501d0b1-9c5d-4f42-a468-0a988abc53f7","Type":"ContainerStarted","Data":"25cf1bde9f55a889d8825221d800e570a07f4ada31d397aaa277a7faa0d388d0"} May 20 17:06:12.505910 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:12.505418 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" event={"ID":"8501d0b1-9c5d-4f42-a468-0a988abc53f7","Type":"ContainerStarted","Data":"65d9657c6f5281575b95396002814468b192dc4fb4f7a4f482c5b62011612183"} May 20 17:06:12.528179 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:12.528134 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c66b7b56b-646ds" podStartSLOduration=2.195716859 podStartE2EDuration="4.528120755s" podCreationTimestamp="2026-05-20 17:06:08 +0000 UTC" firstStartedPulling="2026-05-20 17:06:09.183035483 +0000 UTC m=+180.770629615" lastFinishedPulling="2026-05-20 17:06:11.515439381 +0000 UTC m=+183.103033511" observedRunningTime="2026-05-20 17:06:12.526655489 +0000 UTC m=+184.114249630" watchObservedRunningTime="2026-05-20 17:06:12.528120755 +0000 UTC m=+184.115714893" May 20 17:06:14.641292 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.641258 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f6544d87-6pmnn"] May 20 17:06:14.644512 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.644494 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.647793 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.647767 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 20 17:06:14.647793 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.647792 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7zj9k\"" May 20 17:06:14.647950 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.647810 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 20 17:06:14.647950 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.647781 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 20 17:06:14.647950 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.647862 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 20 17:06:14.647950 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.647926 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 20 17:06:14.648134 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.648001 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 20 17:06:14.648195 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.648181 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 20 17:06:14.653794 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.653773 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f6544d87-6pmnn"] May 20 17:06:14.700748 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.700723 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-serving-cert\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.700882 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.700754 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8fkd\" (UniqueName: \"kubernetes.io/projected/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-kube-api-access-q8fkd\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.700882 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.700776 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-service-ca\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.701005 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.700927 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-oauth-serving-cert\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.701005 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.700973 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-oauth-config\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.701079 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.701002 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-config\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.801530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.801496 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-serving-cert\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.801530 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.801549 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8fkd\" (UniqueName: \"kubernetes.io/projected/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-kube-api-access-q8fkd\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.801779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.801580 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-service-ca\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.801779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.801673 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-oauth-serving-cert\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.801779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.801708 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-oauth-config\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.801779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.801729 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-config\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.802338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.802310 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-service-ca\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.802338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.802335 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-oauth-serving-cert\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.802572 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.802432 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-config\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.804768 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.804748 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-oauth-config\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.804868 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.804785 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-serving-cert\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.809234 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.809208 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8fkd\" (UniqueName: \"kubernetes.io/projected/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-kube-api-access-q8fkd\") pod \"console-7f6544d87-6pmnn\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:14.954721 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:14.954622 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:15.094340 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:15.094312 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f6544d87-6pmnn"] May 20 17:06:15.097742 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:15.097715 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b53aa0_d75b_4b4f_9e9e_fb62fd74c9cd.slice/crio-2d73798e225c1b42e149dfa212779fb2d6c2e5856010485a986de793cb9f1d1d WatchSource:0}: Error finding container 2d73798e225c1b42e149dfa212779fb2d6c2e5856010485a986de793cb9f1d1d: Status 404 returned error can't find the container with id 2d73798e225c1b42e149dfa212779fb2d6c2e5856010485a986de793cb9f1d1d May 20 17:06:15.515609 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:15.515570 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6544d87-6pmnn" event={"ID":"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd","Type":"ContainerStarted","Data":"2d73798e225c1b42e149dfa212779fb2d6c2e5856010485a986de793cb9f1d1d"} May 20 17:06:17.512338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:17.512312 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57cb87977f-nxpj8" May 20 17:06:18.526135 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:18.526092 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6544d87-6pmnn" event={"ID":"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd","Type":"ContainerStarted","Data":"7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec"} May 20 17:06:18.542342 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:18.542297 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f6544d87-6pmnn" podStartSLOduration=1.330517418 podStartE2EDuration="4.542279892s" podCreationTimestamp="2026-05-20 17:06:14 +0000 UTC" firstStartedPulling="2026-05-20 17:06:15.099812501 +0000 UTC m=+186.687406623" lastFinishedPulling="2026-05-20 17:06:18.311574977 +0000 UTC m=+189.899169097" observedRunningTime="2026-05-20 17:06:18.541804169 +0000 UTC m=+190.129398309" watchObservedRunningTime="2026-05-20 17:06:18.542279892 +0000 UTC m=+190.129874031" May 20 17:06:23.482134 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.482100 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57d74fff97-n2qxp"] May 20 17:06:23.485487 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.485466 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.492751 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.492727 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 20 17:06:23.496810 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.496780 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d74fff97-n2qxp"] May 20 17:06:23.586144 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.586109 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-oauth-config\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.586144 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.586155 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-service-ca\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.586402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.586186 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-oauth-serving-cert\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.586402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.586257 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-serving-cert\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.586402 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.586313 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-trusted-ca-bundle\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.586522 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.586401 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q6r2\" (UniqueName: \"kubernetes.io/projected/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-kube-api-access-5q6r2\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.586522 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.586444 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-config\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.687656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.687615 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5q6r2\" (UniqueName: \"kubernetes.io/projected/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-kube-api-access-5q6r2\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.687656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.687662 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-config\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.687902 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.687700 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-oauth-config\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.687902 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.687718 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-service-ca\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.687902 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.687733 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-oauth-serving-cert\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.687902 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.687768 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-serving-cert\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.687902 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.687814 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-trusted-ca-bundle\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.688557 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.688514 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-config\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.688683 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.688563 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-service-ca\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.688683 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.688514 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-oauth-serving-cert\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.689114 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.689092 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-trusted-ca-bundle\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.690382 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.690358 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-oauth-config\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.690463 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.690384 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-serving-cert\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.695719 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.695696 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q6r2\" (UniqueName: \"kubernetes.io/projected/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-kube-api-access-5q6r2\") pod \"console-57d74fff97-n2qxp\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.795139 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.795052 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:23.928119 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:23.928090 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57d74fff97-n2qxp"] May 20 17:06:23.931002 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:06:23.930971 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebedf09b_a232_40a5_b868_c5d8c0d3f9b8.slice/crio-0ede47ff04d80f2a96725e6cac85177f35bd80b0a1a1248309cd95938567937c WatchSource:0}: Error finding container 0ede47ff04d80f2a96725e6cac85177f35bd80b0a1a1248309cd95938567937c: Status 404 returned error can't find the container with id 0ede47ff04d80f2a96725e6cac85177f35bd80b0a1a1248309cd95938567937c May 20 17:06:24.545472 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:24.545434 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d74fff97-n2qxp" event={"ID":"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8","Type":"ContainerStarted","Data":"3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1"} May 20 17:06:24.545472 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:24.545475 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d74fff97-n2qxp" event={"ID":"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8","Type":"ContainerStarted","Data":"0ede47ff04d80f2a96725e6cac85177f35bd80b0a1a1248309cd95938567937c"} May 20 17:06:24.562161 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:24.562106 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57d74fff97-n2qxp" podStartSLOduration=1.5620885439999999 podStartE2EDuration="1.562088544s" podCreationTimestamp="2026-05-20 17:06:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:06:24.56103622 +0000 UTC m=+196.148630361" watchObservedRunningTime="2026-05-20 17:06:24.562088544 +0000 UTC m=+196.149682683" May 20 17:06:24.954810 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:24.954772 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:24.954999 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:24.954865 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:24.959693 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:24.959669 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:25.552287 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:25.552253 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:06:27.828361 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:27.828322 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:27.828771 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:27.828376 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:33.796092 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:33.796041 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:33.796092 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:33.796091 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:33.800971 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:33.800944 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:34.583628 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:34.583596 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:06:34.628474 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:34.628432 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f6544d87-6pmnn"] May 20 17:06:47.833081 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:47.833048 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:47.836839 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:47.836815 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65f745f78b-ksfzh" May 20 17:06:59.650410 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:59.650348 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f6544d87-6pmnn" podUID="e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" containerName="console" containerID="cri-o://7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec" gracePeriod=15 May 20 17:06:59.905716 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:59.905657 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f6544d87-6pmnn_e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd/console/0.log" May 20 17:06:59.905840 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:06:59.905731 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:07:00.016128 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016093 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-serving-cert\") pod \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " May 20 17:07:00.016316 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016146 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-oauth-serving-cert\") pod \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " May 20 17:07:00.016316 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016188 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-service-ca\") pod \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " May 20 17:07:00.016316 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016239 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-oauth-config\") pod \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " May 20 17:07:00.016316 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016268 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-config\") pod \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " May 20 17:07:00.016532 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016335 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8fkd\" (UniqueName: \"kubernetes.io/projected/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-kube-api-access-q8fkd\") pod \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\" (UID: \"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd\") " May 20 17:07:00.016700 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016664 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" (UID: "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:00.016700 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016673 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" (UID: "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:00.016843 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.016700 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-config" (OuterVolumeSpecName: "console-config") pod "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" (UID: "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:00.018487 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.018458 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" (UID: "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:00.018487 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.018474 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" (UID: "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:00.018657 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.018527 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-kube-api-access-q8fkd" (OuterVolumeSpecName: "kube-api-access-q8fkd") pod "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" (UID: "e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd"). InnerVolumeSpecName "kube-api-access-q8fkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:07:00.117522 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.117481 2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-oauth-serving-cert\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:00.117522 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.117517 2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-service-ca\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:00.117779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.117532 2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-oauth-config\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:00.117779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.117574 2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-config\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:00.117779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.117589 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8fkd\" (UniqueName: \"kubernetes.io/projected/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-kube-api-access-q8fkd\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:00.117779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.117604 2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd-console-serving-cert\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:00.652105 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.652079 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f6544d87-6pmnn_e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd/console/0.log" May 20 17:07:00.652531 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.652116 2545 generic.go:358] "Generic (PLEG): container finished" podID="e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" containerID="7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec" exitCode=2 May 20 17:07:00.652531 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.652188 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6544d87-6pmnn" May 20 17:07:00.652531 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.652198 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6544d87-6pmnn" event={"ID":"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd","Type":"ContainerDied","Data":"7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec"} May 20 17:07:00.652531 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.652225 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6544d87-6pmnn" event={"ID":"e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd","Type":"ContainerDied","Data":"2d73798e225c1b42e149dfa212779fb2d6c2e5856010485a986de793cb9f1d1d"} May 20 17:07:00.652531 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.652239 2545 scope.go:117] "RemoveContainer" containerID="7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec" May 20 17:07:00.662160 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.662144 2545 scope.go:117] "RemoveContainer" containerID="7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec" May 20 17:07:00.662380 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:07:00.662362 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec\": container with ID starting with 7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec not found: ID does not exist" containerID="7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec" May 20 17:07:00.662430 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.662386 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec"} err="failed to get container status \"7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec\": rpc error: code = NotFound desc = could not find container \"7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec\": container with ID starting with 7136c4fcf882a5ae681e61647461c7758a81cd286ee897ccb27ce5b4d36671ec not found: ID does not exist" May 20 17:07:00.671942 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.671917 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f6544d87-6pmnn"] May 20 17:07:00.677190 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:00.677170 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f6544d87-6pmnn"] May 20 17:07:01.002650 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:01.002576 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" path="/var/lib/kubelet/pods/e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd/volumes" May 20 17:07:20.807297 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:20.807252 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:07:20.809548 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:20.809517 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/064653ee-ac31-45f8-9a7b-1cd046e1799d-metrics-certs\") pod \"network-metrics-daemon-vlk94\" (UID: \"064653ee-ac31-45f8-9a7b-1cd046e1799d\") " pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:07:20.902060 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:20.902029 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-phplh\"" May 20 17:07:20.909942 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:20.909917 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk94" May 20 17:07:21.037273 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:21.037236 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vlk94"] May 20 17:07:21.041301 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:07:21.041274 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064653ee_ac31_45f8_9a7b_1cd046e1799d.slice/crio-db1c3c22b4f93493b0fe5d822ad523b7e5685e3fe78874af571263ebac518464 WatchSource:0}: Error finding container db1c3c22b4f93493b0fe5d822ad523b7e5685e3fe78874af571263ebac518464: Status 404 returned error can't find the container with id db1c3c22b4f93493b0fe5d822ad523b7e5685e3fe78874af571263ebac518464 May 20 17:07:21.715955 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:21.715904 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlk94" event={"ID":"064653ee-ac31-45f8-9a7b-1cd046e1799d","Type":"ContainerStarted","Data":"db1c3c22b4f93493b0fe5d822ad523b7e5685e3fe78874af571263ebac518464"} May 20 17:07:22.720731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:22.720693 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlk94" event={"ID":"064653ee-ac31-45f8-9a7b-1cd046e1799d","Type":"ContainerStarted","Data":"16fdcacb1b95404868f6b1fbd1bd7b08d3a1853c52ef6d461fea90bbc25d9737"} May 20 17:07:22.720731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:22.720728 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlk94" event={"ID":"064653ee-ac31-45f8-9a7b-1cd046e1799d","Type":"ContainerStarted","Data":"cbaad5294d6bae9ca2372b88a1bb6da9b5f3c423fb501f449bc44723a504db77"} May 20 17:07:22.737097 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:22.737049 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vlk94" podStartSLOduration=252.810035175 podStartE2EDuration="4m13.737035646s" podCreationTimestamp="2026-05-20 17:03:09 +0000 UTC" firstStartedPulling="2026-05-20 17:07:21.043249969 +0000 UTC m=+252.630844087" lastFinishedPulling="2026-05-20 17:07:21.97025044 +0000 UTC m=+253.557844558" observedRunningTime="2026-05-20 17:07:22.735654899 +0000 UTC m=+254.323249039" watchObservedRunningTime="2026-05-20 17:07:22.737035646 +0000 UTC m=+254.324629786" May 20 17:07:23.462551 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:23.462503 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:07:23.725206 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:23.725110 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="config-reloader" containerID="cri-o://896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed" gracePeriod=120 May 20 17:07:23.725206 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:23.725141 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy" containerID="cri-o://dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4" gracePeriod=120 May 20 17:07:23.725206 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:23.725139 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="prom-label-proxy" containerID="cri-o://1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27" gracePeriod=120 May 20 17:07:23.725206 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:23.725074 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="alertmanager" containerID="cri-o://64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489" gracePeriod=120 May 20 17:07:23.725830 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:23.725114 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy-metric" containerID="cri-o://ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe" gracePeriod=120 May 20 17:07:23.725830 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:23.725122 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy-web" containerID="cri-o://00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8" gracePeriod=120 May 20 17:07:24.730055 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730024 2545 generic.go:358] "Generic (PLEG): container finished" podID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerID="1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27" exitCode=0 May 20 17:07:24.730055 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730049 2545 generic.go:358] "Generic (PLEG): container finished" podID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerID="ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe" exitCode=0 May 20 17:07:24.730055 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730055 2545 generic.go:358] "Generic (PLEG): container finished" podID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerID="dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4" exitCode=0 May 20 17:07:24.730055 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730061 2545 generic.go:358] "Generic (PLEG): container finished" podID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerID="896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed" exitCode=0 May 20 17:07:24.730055 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730066 2545 generic.go:358] "Generic (PLEG): container finished" podID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerID="64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489" exitCode=0 May 20 17:07:24.730554 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730091 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerDied","Data":"1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27"} May 20 17:07:24.730554 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730122 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerDied","Data":"ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe"} May 20 17:07:24.730554 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730133 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerDied","Data":"dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4"} May 20 17:07:24.730554 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730141 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerDied","Data":"896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed"} May 20 17:07:24.730554 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.730170 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerDied","Data":"64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489"} May 20 17:07:24.970694 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:24.970671 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.029740 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.029658 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-557579c6f5-5rmnz"] May 20 17:07:25.029997 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.029982 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy-web" May 20 17:07:25.029997 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.029998 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy-web" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030008 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="alertmanager" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030014 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="alertmanager" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030022 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="prom-label-proxy" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030028 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="prom-label-proxy" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030036 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" containerName="console" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030044 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" containerName="console" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030053 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="config-reloader" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030058 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="config-reloader" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030064 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy-metric" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030069 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy-metric" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030085 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="init-config-reloader" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030090 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="init-config-reloader" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030096 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy" May 20 17:07:25.030125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030100 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy" May 20 17:07:25.030918 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030153 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="config-reloader" May 20 17:07:25.030918 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030161 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy-web" May 20 17:07:25.030918 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030169 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="alertmanager" May 20 17:07:25.030918 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030178 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0b53aa0-d75b-4b4f-9e9e-fb62fd74c9cd" containerName="console" May 20 17:07:25.030918 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030185 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy" May 20 17:07:25.030918 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030194 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="kube-rbac-proxy-metric" May 20 17:07:25.030918 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.030203 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerName="prom-label-proxy" May 20 17:07:25.033119 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.033097 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.044106 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.044083 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557579c6f5-5rmnz"] May 20 17:07:25.145560 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145510 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-trusted-ca-bundle\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.145740 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145578 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q2kk\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-kube-api-access-9q2kk\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.145740 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145611 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-metrics-client-ca\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.145740 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145636 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.145740 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145666 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-out\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.145740 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145702 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-tls-assets\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.145740 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145734 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-volume\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.146049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145774 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.146049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145796 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-web-config\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.146049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145842 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.146049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145880 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-cluster-tls-config\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.146049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145929 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-main-db\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.146049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145978 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:25.146049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.145989 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:07:25.146049 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146015 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\" (UID: \"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5\") " May 20 17:07:25.146443 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146142 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-trusted-ca-bundle\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.146443 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146188 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-serving-cert\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.146443 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146224 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjr5\" (UniqueName: \"kubernetes.io/projected/e897fd3d-7f82-4d64-995e-9f949f994d45-kube-api-access-txjr5\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.146443 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146259 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-service-ca\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.146443 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146357 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-console-config\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.146443 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146390 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-oauth-serving-cert\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.146775 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146459 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-oauth-config\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.146775 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146501 2545 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.146775 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.146516 2545 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-metrics-client-ca\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.148612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.148557 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 17:07:25.148940 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.148917 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:25.149036 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.148983 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:07:25.149174 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.149138 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-volume" (OuterVolumeSpecName: "config-volume") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:25.149332 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.149303 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-out" (OuterVolumeSpecName: "config-out") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 17:07:25.149393 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.149345 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-kube-api-access-9q2kk" (OuterVolumeSpecName: "kube-api-access-9q2kk") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "kube-api-access-9q2kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:07:25.149572 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.149529 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:25.150640 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.150622 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:25.150779 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.150756 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:25.154164 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.154076 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:25.160469 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.160445 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-web-config" (OuterVolumeSpecName: "web-config") pod "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" (UID: "5445e5a0-0e06-4fc9-b7fc-5c48080d18d5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:07:25.247531 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247483 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-console-config\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.247531 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247545 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-oauth-serving-cert\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.247804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247595 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-oauth-config\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.247804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247619 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-trusted-ca-bundle\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.247804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247643 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-serving-cert\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.247804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247659 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txjr5\" (UniqueName: \"kubernetes.io/projected/e897fd3d-7f82-4d64-995e-9f949f994d45-kube-api-access-txjr5\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.247804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247712 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-service-ca\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247817 2545 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-alertmanager-main-db\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247840 2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247856 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q2kk\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-kube-api-access-9q2kk\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247871 2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-main-tls\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247886 2545 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-out\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247901 2545 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-tls-assets\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247915 2545 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-config-volume\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247930 2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247944 2545 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-web-config\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247958 2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248046 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.247974 2545 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5-cluster-tls-config\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:07:25.248576 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.248292 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-console-config\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.248576 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.248424 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-oauth-serving-cert\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.248576 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.248479 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-service-ca\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.248740 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.248630 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-trusted-ca-bundle\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.249996 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.249974 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-oauth-config\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.250095 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.250081 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-serving-cert\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.256233 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.256209 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjr5\" (UniqueName: \"kubernetes.io/projected/e897fd3d-7f82-4d64-995e-9f949f994d45-kube-api-access-txjr5\") pod \"console-557579c6f5-5rmnz\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.344131 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.344020 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:25.465587 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.465559 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557579c6f5-5rmnz"] May 20 17:07:25.467902 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:07:25.467873 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode897fd3d_7f82_4d64_995e_9f949f994d45.slice/crio-c2328e9c6fc98c8291a5c36745aab2ef4c654e52b82b6205d755f2db69ba2aa9 WatchSource:0}: Error finding container c2328e9c6fc98c8291a5c36745aab2ef4c654e52b82b6205d755f2db69ba2aa9: Status 404 returned error can't find the container with id c2328e9c6fc98c8291a5c36745aab2ef4c654e52b82b6205d755f2db69ba2aa9 May 20 17:07:25.735827 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.735784 2545 generic.go:358] "Generic (PLEG): container finished" podID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" containerID="00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8" exitCode=0 May 20 17:07:25.736289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.735866 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerDied","Data":"00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8"} May 20 17:07:25.736289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.735906 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.736289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.735922 2545 scope.go:117] "RemoveContainer" containerID="1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27" May 20 17:07:25.736289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.735910 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5445e5a0-0e06-4fc9-b7fc-5c48080d18d5","Type":"ContainerDied","Data":"396dcf6cfb293ca4fa117cfeafec9c2b163bb211915d1633322bcef32bbb1da2"} May 20 17:07:25.737185 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.737167 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557579c6f5-5rmnz" event={"ID":"e897fd3d-7f82-4d64-995e-9f949f994d45","Type":"ContainerStarted","Data":"90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6"} May 20 17:07:25.737264 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.737192 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557579c6f5-5rmnz" event={"ID":"e897fd3d-7f82-4d64-995e-9f949f994d45","Type":"ContainerStarted","Data":"c2328e9c6fc98c8291a5c36745aab2ef4c654e52b82b6205d755f2db69ba2aa9"} May 20 17:07:25.744133 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.744118 2545 scope.go:117] "RemoveContainer" containerID="ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe" May 20 17:07:25.750651 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.750631 2545 scope.go:117] "RemoveContainer" containerID="dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4" May 20 17:07:25.756785 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.756771 2545 scope.go:117] "RemoveContainer" containerID="00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8" May 20 17:07:25.759518 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.759479 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-557579c6f5-5rmnz" podStartSLOduration=0.759465761 podStartE2EDuration="759.465761ms" podCreationTimestamp="2026-05-20 17:07:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:07:25.758101207 +0000 UTC m=+257.345695348" watchObservedRunningTime="2026-05-20 17:07:25.759465761 +0000 UTC m=+257.347059902" May 20 17:07:25.763476 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.763453 2545 scope.go:117] "RemoveContainer" containerID="896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed" May 20 17:07:25.769824 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.769804 2545 scope.go:117] "RemoveContainer" containerID="64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489" May 20 17:07:25.772209 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.772187 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:07:25.776198 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.776175 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:07:25.777259 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.777246 2545 scope.go:117] "RemoveContainer" containerID="c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab" May 20 17:07:25.783697 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.783682 2545 scope.go:117] "RemoveContainer" containerID="1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27" May 20 17:07:25.783935 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:07:25.783917 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27\": container with ID starting with 1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27 not found: ID does not exist" containerID="1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27" May 20 17:07:25.783986 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.783946 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27"} err="failed to get container status \"1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27\": rpc error: code = NotFound desc = could not find container \"1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27\": container with ID starting with 1ce237f52e8a8d7464872f62ab185b0d83af356c273de4816a105ad94692fd27 not found: ID does not exist" May 20 17:07:25.783986 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.783969 2545 scope.go:117] "RemoveContainer" containerID="ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe" May 20 17:07:25.784167 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:07:25.784154 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe\": container with ID starting with ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe not found: ID does not exist" containerID="ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe" May 20 17:07:25.784207 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.784172 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe"} err="failed to get container status \"ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe\": rpc error: code = NotFound desc = could not find container \"ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe\": container with ID starting with ba5f234e1cf8e22efb97cfc5e9e4200b146fde9998d6e8edfb0a52b724795ebe not found: ID does not exist" May 20 17:07:25.784207 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.784184 2545 scope.go:117] "RemoveContainer" containerID="dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4" May 20 17:07:25.784422 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:07:25.784406 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4\": container with ID starting with dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4 not found: ID does not exist" containerID="dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4" May 20 17:07:25.784496 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.784431 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4"} err="failed to get container status \"dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4\": rpc error: code = NotFound desc = could not find container \"dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4\": container with ID starting with dd6ad496dba794e679ebd9ac408a509db12720a7d39d4c423ee7e6abcdc088f4 not found: ID does not exist" May 20 17:07:25.784496 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.784453 2545 scope.go:117] "RemoveContainer" containerID="00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8" May 20 17:07:25.784719 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:07:25.784704 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8\": container with ID starting with 00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8 not found: ID does not exist" containerID="00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8" May 20 17:07:25.784765 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.784724 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8"} err="failed to get container status \"00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8\": rpc error: code = NotFound desc = could not find container \"00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8\": container with ID starting with 00fe14c596fae28776cdc0047c577509a4e3f8aa168e8aabc1cb8fadf73e48d8 not found: ID does not exist" May 20 17:07:25.784765 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.784737 2545 scope.go:117] "RemoveContainer" containerID="896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed" May 20 17:07:25.784967 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:07:25.784950 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed\": container with ID starting with 896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed not found: ID does not exist" containerID="896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed" May 20 17:07:25.785029 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.784973 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed"} err="failed to get container status \"896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed\": rpc error: code = NotFound desc = could not find container \"896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed\": container with ID starting with 896394268ebef37eb2f7c3ade7ee433924bff13f97ae01b070b0746fb3f9d9ed not found: ID does not exist" May 20 17:07:25.785029 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.784990 2545 scope.go:117] "RemoveContainer" containerID="64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489" May 20 17:07:25.785214 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:07:25.785198 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489\": container with ID starting with 64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489 not found: ID does not exist" containerID="64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489" May 20 17:07:25.785274 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.785222 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489"} err="failed to get container status \"64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489\": rpc error: code = NotFound desc = could not find container \"64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489\": container with ID starting with 64fd4432c28cc0b93e90710c09cf472d41336fa9d75dc9aba73d80bb91d83489 not found: ID does not exist" May 20 17:07:25.785274 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.785246 2545 scope.go:117] "RemoveContainer" containerID="c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab" May 20 17:07:25.785473 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:07:25.785457 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab\": container with ID starting with c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab not found: ID does not exist" containerID="c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab" May 20 17:07:25.785514 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.785477 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab"} err="failed to get container status \"c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab\": rpc error: code = NotFound desc = could not find container \"c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab\": container with ID starting with c37bb70ab5432cf1396eebe2c37f6ddfc171f901f6edc8d959aa8563b6de9bab not found: ID does not exist" May 20 17:07:25.800692 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.800672 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:07:25.806156 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.806139 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.808465 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.808443 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 20 17:07:25.808628 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.808449 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 20 17:07:25.808628 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.808568 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 20 17:07:25.808628 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.808606 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 20 17:07:25.808845 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.808631 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j454z\"" May 20 17:07:25.808845 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.808655 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 20 17:07:25.808845 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.808777 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 20 17:07:25.809098 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.809083 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 20 17:07:25.809739 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.809724 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 20 17:07:25.813524 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.813505 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 20 17:07:25.817092 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.817071 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:07:25.955346 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955303 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24320544-555f-45d6-9f6b-69a49e2ed6eb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955505 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955362 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955505 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955401 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955505 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955425 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24320544-555f-45d6-9f6b-69a49e2ed6eb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955505 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955456 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955505 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955500 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vqhp\" (UniqueName: \"kubernetes.io/projected/24320544-555f-45d6-9f6b-69a49e2ed6eb-kube-api-access-7vqhp\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955526 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-web-config\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955582 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-config-volume\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955607 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24320544-555f-45d6-9f6b-69a49e2ed6eb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955631 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24320544-555f-45d6-9f6b-69a49e2ed6eb-config-out\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955654 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24320544-555f-45d6-9f6b-69a49e2ed6eb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955685 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:25.955904 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:25.955727 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056297 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056208 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-config-volume\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056297 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056246 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24320544-555f-45d6-9f6b-69a49e2ed6eb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056297 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056272 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24320544-555f-45d6-9f6b-69a49e2ed6eb-config-out\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056302 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24320544-555f-45d6-9f6b-69a49e2ed6eb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056328 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056355 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056410 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24320544-555f-45d6-9f6b-69a49e2ed6eb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056443 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056465 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056491 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24320544-555f-45d6-9f6b-69a49e2ed6eb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056524 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.056582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056581 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vqhp\" (UniqueName: \"kubernetes.io/projected/24320544-555f-45d6-9f6b-69a49e2ed6eb-kube-api-access-7vqhp\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.057024 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.056624 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-web-config\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.057445 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.057240 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24320544-555f-45d6-9f6b-69a49e2ed6eb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.057445 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.057358 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24320544-555f-45d6-9f6b-69a49e2ed6eb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.057639 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.057617 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24320544-555f-45d6-9f6b-69a49e2ed6eb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.059134 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.059106 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24320544-555f-45d6-9f6b-69a49e2ed6eb-config-out\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.059633 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.059450 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-config-volume\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.059783 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.059725 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24320544-555f-45d6-9f6b-69a49e2ed6eb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.059891 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.059876 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-web-config\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.060126 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.060104 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.060176 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.060107 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.060239 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.060220 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.060552 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.060514 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.061278 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.061257 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24320544-555f-45d6-9f6b-69a49e2ed6eb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.064898 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.064879 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vqhp\" (UniqueName: \"kubernetes.io/projected/24320544-555f-45d6-9f6b-69a49e2ed6eb-kube-api-access-7vqhp\") pod \"alertmanager-main-0\" (UID: \"24320544-555f-45d6-9f6b-69a49e2ed6eb\") " pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.115724 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.115688 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 20 17:07:26.255956 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.255933 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 20 17:07:26.258624 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:07:26.258597 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24320544_555f_45d6_9f6b_69a49e2ed6eb.slice/crio-0cfc9a1446a766202e5835922f3023772dcda21847aa3a8cc1fc8a2bd870fa8e WatchSource:0}: Error finding container 0cfc9a1446a766202e5835922f3023772dcda21847aa3a8cc1fc8a2bd870fa8e: Status 404 returned error can't find the container with id 0cfc9a1446a766202e5835922f3023772dcda21847aa3a8cc1fc8a2bd870fa8e May 20 17:07:26.743145 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.743113 2545 generic.go:358] "Generic (PLEG): container finished" podID="24320544-555f-45d6-9f6b-69a49e2ed6eb" containerID="3e8a2d3a9ac3d9e0027694ca347affe5eb497ad09bea67a2ab5b6b148bd60149" exitCode=0 May 20 17:07:26.743512 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.743203 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24320544-555f-45d6-9f6b-69a49e2ed6eb","Type":"ContainerDied","Data":"3e8a2d3a9ac3d9e0027694ca347affe5eb497ad09bea67a2ab5b6b148bd60149"} May 20 17:07:26.743512 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:26.743244 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24320544-555f-45d6-9f6b-69a49e2ed6eb","Type":"ContainerStarted","Data":"0cfc9a1446a766202e5835922f3023772dcda21847aa3a8cc1fc8a2bd870fa8e"} May 20 17:07:27.004974 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:27.004948 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5445e5a0-0e06-4fc9-b7fc-5c48080d18d5" path="/var/lib/kubelet/pods/5445e5a0-0e06-4fc9-b7fc-5c48080d18d5/volumes" May 20 17:07:27.750018 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:27.749988 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24320544-555f-45d6-9f6b-69a49e2ed6eb","Type":"ContainerStarted","Data":"bafd1cca507e7b82450ae635669067d66ed412d4787dde1b8a98ea5750713f1c"} May 20 17:07:27.750018 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:27.750022 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24320544-555f-45d6-9f6b-69a49e2ed6eb","Type":"ContainerStarted","Data":"b5176969a7b142f414f0b20f1b10a262dcdafb61f65b5b899c2018ea5b8e4179"} May 20 17:07:27.750018 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:27.750033 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24320544-555f-45d6-9f6b-69a49e2ed6eb","Type":"ContainerStarted","Data":"094eae1fc3411a3b088758dc0b41e889a3ecc960b4ecddee99392a60c2e7b55d"} May 20 17:07:27.750465 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:27.750041 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24320544-555f-45d6-9f6b-69a49e2ed6eb","Type":"ContainerStarted","Data":"7c3f21b927b8f023158da68479aa79ffc2c71c94e9280d2a6c0b03b77f7fb5dc"} May 20 17:07:27.750465 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:27.750050 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24320544-555f-45d6-9f6b-69a49e2ed6eb","Type":"ContainerStarted","Data":"1f2e7ae40a9db14cabc0f2114458daacf1e3662411ac44b5eb3d388241a423f9"} May 20 17:07:27.750465 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:27.750058 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24320544-555f-45d6-9f6b-69a49e2ed6eb","Type":"ContainerStarted","Data":"46a30dcb3af9ab2448316e910c07ae4252158fb1646063fb7630ccccd4f08d48"} May 20 17:07:27.775996 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:27.775938 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.775923716 podStartE2EDuration="2.775923716s" podCreationTimestamp="2026-05-20 17:07:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:07:27.774333965 +0000 UTC m=+259.361928109" watchObservedRunningTime="2026-05-20 17:07:27.775923716 +0000 UTC m=+259.363517856" May 20 17:07:35.344377 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:35.344341 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:35.344377 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:35.344385 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:35.349100 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:35.349073 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:35.776868 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:35.776844 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:07:35.843127 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:07:35.843095 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d74fff97-n2qxp"] May 20 17:08:00.863723 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:00.863651 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-57d74fff97-n2qxp" podUID="ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" containerName="console" containerID="cri-o://3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1" gracePeriod=15 May 20 17:08:01.104318 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.104298 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57d74fff97-n2qxp_ebedf09b-a232-40a5-b868-c5d8c0d3f9b8/console/0.log" May 20 17:08:01.104434 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.104356 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:08:01.152738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.152715 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-oauth-config\") pod \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " May 20 17:08:01.152861 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.152759 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-oauth-serving-cert\") pod \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " May 20 17:08:01.152861 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.152798 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q6r2\" (UniqueName: \"kubernetes.io/projected/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-kube-api-access-5q6r2\") pod \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " May 20 17:08:01.152861 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.152820 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-service-ca\") pod \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " May 20 17:08:01.152861 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.152853 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-trusted-ca-bundle\") pod \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " May 20 17:08:01.153059 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.152879 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-config\") pod \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " May 20 17:08:01.153059 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.152906 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-serving-cert\") pod \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\" (UID: \"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8\") " May 20 17:08:01.153327 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.153284 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" (UID: "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:08:01.153327 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.153301 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-service-ca" (OuterVolumeSpecName: "service-ca") pod "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" (UID: "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:08:01.153327 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.153313 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" (UID: "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:08:01.153521 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.153326 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-config" (OuterVolumeSpecName: "console-config") pod "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" (UID: "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:08:01.155110 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.155091 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" (UID: "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:08:01.155278 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.155258 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-kube-api-access-5q6r2" (OuterVolumeSpecName: "kube-api-access-5q6r2") pod "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" (UID: "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8"). InnerVolumeSpecName "kube-api-access-5q6r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:08:01.155278 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.155263 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" (UID: "ebedf09b-a232-40a5-b868-c5d8c0d3f9b8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:08:01.254163 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.254137 2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-oauth-config\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:08:01.254163 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.254162 2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-oauth-serving-cert\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:08:01.254163 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.254171 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q6r2\" (UniqueName: \"kubernetes.io/projected/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-kube-api-access-5q6r2\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:08:01.254378 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.254181 2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-service-ca\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:08:01.254378 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.254190 2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-trusted-ca-bundle\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:08:01.254378 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.254198 2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-config\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:08:01.254378 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.254206 2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8-console-serving-cert\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:08:01.850029 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.850004 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57d74fff97-n2qxp_ebedf09b-a232-40a5-b868-c5d8c0d3f9b8/console/0.log" May 20 17:08:01.850227 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.850043 2545 generic.go:358] "Generic (PLEG): container finished" podID="ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" containerID="3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1" exitCode=2 May 20 17:08:01.850227 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.850074 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d74fff97-n2qxp" event={"ID":"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8","Type":"ContainerDied","Data":"3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1"} May 20 17:08:01.850227 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.850115 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57d74fff97-n2qxp" event={"ID":"ebedf09b-a232-40a5-b868-c5d8c0d3f9b8","Type":"ContainerDied","Data":"0ede47ff04d80f2a96725e6cac85177f35bd80b0a1a1248309cd95938567937c"} May 20 17:08:01.850227 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.850120 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57d74fff97-n2qxp" May 20 17:08:01.850227 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.850131 2545 scope.go:117] "RemoveContainer" containerID="3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1" May 20 17:08:01.858244 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.858226 2545 scope.go:117] "RemoveContainer" containerID="3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1" May 20 17:08:01.858472 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:08:01.858450 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1\": container with ID starting with 3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1 not found: ID does not exist" containerID="3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1" May 20 17:08:01.858524 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.858484 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1"} err="failed to get container status \"3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1\": rpc error: code = NotFound desc = could not find container \"3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1\": container with ID starting with 3868c3de8540ea2d2a2fc7db5b22703790be5dbdbab6e1a57305b05a314ef1a1 not found: ID does not exist" May 20 17:08:01.870286 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.870264 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57d74fff97-n2qxp"] May 20 17:08:01.875177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:01.875157 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57d74fff97-n2qxp"] May 20 17:08:03.002207 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:03.002176 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" path="/var/lib/kubelet/pods/ebedf09b-a232-40a5-b868-c5d8c0d3f9b8/volumes" May 20 17:08:08.888741 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:08.888712 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:08:08.891380 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:08.891358 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:08:08.893574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:08:08.893556 2545 kubelet.go:1628] "Image garbage collection succeeded" May 20 17:11:17.971062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:17.971025 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d8bcb5f7c-7sdkt"] May 20 17:11:17.971693 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:17.971505 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" containerName="console" May 20 17:11:17.971693 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:17.971525 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" containerName="console" May 20 17:11:17.971693 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:17.971648 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebedf09b-a232-40a5-b868-c5d8c0d3f9b8" containerName="console" May 20 17:11:17.974651 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:17.974629 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:17.996247 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:17.996216 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d8bcb5f7c-7sdkt"] May 20 17:11:18.027863 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.027829 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-config\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.027863 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.027865 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-trusted-ca-bundle\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.028062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.027884 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-oauth-serving-cert\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.028062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.027908 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-serving-cert\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.028062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.027960 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-service-ca\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.028062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.028021 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-oauth-config\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.028062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.028045 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttl8d\" (UniqueName: \"kubernetes.io/projected/b91db36e-7ba5-436a-be77-7c4cdfbf45db-kube-api-access-ttl8d\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.128901 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.128844 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-config\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129112 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.128937 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-trusted-ca-bundle\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129112 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.128969 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-oauth-serving-cert\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129112 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.128998 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-serving-cert\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129112 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.129022 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-service-ca\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129112 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.129081 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-oauth-config\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129459 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.129115 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttl8d\" (UniqueName: \"kubernetes.io/projected/b91db36e-7ba5-436a-be77-7c4cdfbf45db-kube-api-access-ttl8d\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129681 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.129654 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-config\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129785 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.129744 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-oauth-serving-cert\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129785 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.129763 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-service-ca\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.129962 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.129942 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91db36e-7ba5-436a-be77-7c4cdfbf45db-trusted-ca-bundle\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.131546 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.131515 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-oauth-config\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.131634 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.131615 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b91db36e-7ba5-436a-be77-7c4cdfbf45db-console-serving-cert\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.137085 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.137064 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttl8d\" (UniqueName: \"kubernetes.io/projected/b91db36e-7ba5-436a-be77-7c4cdfbf45db-kube-api-access-ttl8d\") pod \"console-6d8bcb5f7c-7sdkt\" (UID: \"b91db36e-7ba5-436a-be77-7c4cdfbf45db\") " pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.284566 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.284462 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:18.409813 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.409773 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d8bcb5f7c-7sdkt"] May 20 17:11:18.412419 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:11:18.412390 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91db36e_7ba5_436a_be77_7c4cdfbf45db.slice/crio-92426462cc8b735dca7b7a2f5027b0e038e6ec821c22a3a9a8557ba68e7cc80f WatchSource:0}: Error finding container 92426462cc8b735dca7b7a2f5027b0e038e6ec821c22a3a9a8557ba68e7cc80f: Status 404 returned error can't find the container with id 92426462cc8b735dca7b7a2f5027b0e038e6ec821c22a3a9a8557ba68e7cc80f May 20 17:11:18.414143 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:18.414128 2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:11:19.414834 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:19.414798 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8bcb5f7c-7sdkt" event={"ID":"b91db36e-7ba5-436a-be77-7c4cdfbf45db","Type":"ContainerStarted","Data":"f98b3061077378b68cc9b70f3913d2de0388b911a9bde2a4c8908ddf34096869"} May 20 17:11:19.414834 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:19.414837 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d8bcb5f7c-7sdkt" event={"ID":"b91db36e-7ba5-436a-be77-7c4cdfbf45db","Type":"ContainerStarted","Data":"92426462cc8b735dca7b7a2f5027b0e038e6ec821c22a3a9a8557ba68e7cc80f"} May 20 17:11:19.433072 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:19.433026 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d8bcb5f7c-7sdkt" podStartSLOduration=2.433007993 podStartE2EDuration="2.433007993s" podCreationTimestamp="2026-05-20 17:11:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:11:19.431800948 +0000 UTC m=+491.019395099" watchObservedRunningTime="2026-05-20 17:11:19.433007993 +0000 UTC m=+491.020602132" May 20 17:11:28.284643 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:28.284558 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:28.284643 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:28.284604 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:28.289426 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:28.289402 2545 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:28.443771 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:28.443744 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d8bcb5f7c-7sdkt" May 20 17:11:28.488104 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:28.488071 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557579c6f5-5rmnz"] May 20 17:11:53.510006 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.509897 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-557579c6f5-5rmnz" podUID="e897fd3d-7f82-4d64-995e-9f949f994d45" containerName="console" containerID="cri-o://90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6" gracePeriod=15 May 20 17:11:53.742925 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.742902 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557579c6f5-5rmnz_e897fd3d-7f82-4d64-995e-9f949f994d45/console/0.log" May 20 17:11:53.743050 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.742969 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:11:53.837104 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837032 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txjr5\" (UniqueName: \"kubernetes.io/projected/e897fd3d-7f82-4d64-995e-9f949f994d45-kube-api-access-txjr5\") pod \"e897fd3d-7f82-4d64-995e-9f949f994d45\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " May 20 17:11:53.837250 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837114 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-oauth-config\") pod \"e897fd3d-7f82-4d64-995e-9f949f994d45\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " May 20 17:11:53.837250 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837141 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-service-ca\") pod \"e897fd3d-7f82-4d64-995e-9f949f994d45\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " May 20 17:11:53.837250 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837159 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-serving-cert\") pod \"e897fd3d-7f82-4d64-995e-9f949f994d45\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " May 20 17:11:53.837250 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837180 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-console-config\") pod \"e897fd3d-7f82-4d64-995e-9f949f994d45\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " May 20 17:11:53.837250 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837228 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-trusted-ca-bundle\") pod \"e897fd3d-7f82-4d64-995e-9f949f994d45\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " May 20 17:11:53.837503 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837275 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-oauth-serving-cert\") pod \"e897fd3d-7f82-4d64-995e-9f949f994d45\" (UID: \"e897fd3d-7f82-4d64-995e-9f949f994d45\") " May 20 17:11:53.837668 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837631 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-console-config" (OuterVolumeSpecName: "console-config") pod "e897fd3d-7f82-4d64-995e-9f949f994d45" (UID: "e897fd3d-7f82-4d64-995e-9f949f994d45"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:11:53.837813 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837749 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e897fd3d-7f82-4d64-995e-9f949f994d45" (UID: "e897fd3d-7f82-4d64-995e-9f949f994d45"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:11:53.837907 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837873 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e897fd3d-7f82-4d64-995e-9f949f994d45" (UID: "e897fd3d-7f82-4d64-995e-9f949f994d45"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:11:53.838003 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.837953 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-service-ca" (OuterVolumeSpecName: "service-ca") pod "e897fd3d-7f82-4d64-995e-9f949f994d45" (UID: "e897fd3d-7f82-4d64-995e-9f949f994d45"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 17:11:53.839226 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.839200 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e897fd3d-7f82-4d64-995e-9f949f994d45" (UID: "e897fd3d-7f82-4d64-995e-9f949f994d45"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:11:53.839318 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.839249 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e897fd3d-7f82-4d64-995e-9f949f994d45" (UID: "e897fd3d-7f82-4d64-995e-9f949f994d45"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:11:53.839318 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.839249 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e897fd3d-7f82-4d64-995e-9f949f994d45-kube-api-access-txjr5" (OuterVolumeSpecName: "kube-api-access-txjr5") pod "e897fd3d-7f82-4d64-995e-9f949f994d45" (UID: "e897fd3d-7f82-4d64-995e-9f949f994d45"). InnerVolumeSpecName "kube-api-access-txjr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:11:53.937948 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.937913 2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-oauth-serving-cert\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:11:53.937948 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.937940 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txjr5\" (UniqueName: \"kubernetes.io/projected/e897fd3d-7f82-4d64-995e-9f949f994d45-kube-api-access-txjr5\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:11:53.937948 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.937950 2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-oauth-config\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:11:53.938177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.937959 2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-service-ca\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:11:53.938177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.937970 2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e897fd3d-7f82-4d64-995e-9f949f994d45-console-serving-cert\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:11:53.938177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.937979 2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-console-config\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:11:53.938177 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:53.937988 2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e897fd3d-7f82-4d64-995e-9f949f994d45-trusted-ca-bundle\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:11:54.519297 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.519271 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557579c6f5-5rmnz_e897fd3d-7f82-4d64-995e-9f949f994d45/console/0.log" May 20 17:11:54.519780 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.519309 2545 generic.go:358] "Generic (PLEG): container finished" podID="e897fd3d-7f82-4d64-995e-9f949f994d45" containerID="90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6" exitCode=2 May 20 17:11:54.519780 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.519344 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557579c6f5-5rmnz" event={"ID":"e897fd3d-7f82-4d64-995e-9f949f994d45","Type":"ContainerDied","Data":"90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6"} May 20 17:11:54.519780 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.519374 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557579c6f5-5rmnz" May 20 17:11:54.519780 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.519401 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557579c6f5-5rmnz" event={"ID":"e897fd3d-7f82-4d64-995e-9f949f994d45","Type":"ContainerDied","Data":"c2328e9c6fc98c8291a5c36745aab2ef4c654e52b82b6205d755f2db69ba2aa9"} May 20 17:11:54.519780 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.519424 2545 scope.go:117] "RemoveContainer" containerID="90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6" May 20 17:11:54.527444 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.527422 2545 scope.go:117] "RemoveContainer" containerID="90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6" May 20 17:11:54.527713 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:11:54.527691 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6\": container with ID starting with 90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6 not found: ID does not exist" containerID="90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6" May 20 17:11:54.527772 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.527723 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6"} err="failed to get container status \"90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6\": rpc error: code = NotFound desc = could not find container \"90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6\": container with ID starting with 90dcfd36f4515b8ff9ba866959ff45cfb4ec9a79cb995d0f50989e71355da9c6 not found: ID does not exist" May 20 17:11:54.539162 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.539134 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557579c6f5-5rmnz"] May 20 17:11:54.547096 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:54.547076 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-557579c6f5-5rmnz"] May 20 17:11:55.002638 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:11:55.002606 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e897fd3d-7f82-4d64-995e-9f949f994d45" path="/var/lib/kubelet/pods/e897fd3d-7f82-4d64-995e-9f949f994d45/volumes" May 20 17:12:01.996181 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:01.996134 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9"] May 20 17:12:01.996706 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:01.996641 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e897fd3d-7f82-4d64-995e-9f949f994d45" containerName="console" May 20 17:12:01.996706 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:01.996658 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="e897fd3d-7f82-4d64-995e-9f949f994d45" containerName="console" May 20 17:12:01.996785 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:01.996729 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="e897fd3d-7f82-4d64-995e-9f949f994d45" containerName="console" May 20 17:12:02.001179 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.001163 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" May 20 17:12:02.003600 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.003576 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" May 20 17:12:02.003600 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.003594 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" May 20 17:12:02.003738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.003612 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-55zgf\"" May 20 17:12:02.011410 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.011380 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trvtz\" (UniqueName: \"kubernetes.io/projected/3b275532-e93b-4cc3-9b64-e142ed75955b-kube-api-access-trvtz\") pod \"cert-manager-operator-controller-manager-54b9655956-wmvm9\" (UID: \"3b275532-e93b-4cc3-9b64-e142ed75955b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" May 20 17:12:02.011492 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.011458 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b275532-e93b-4cc3-9b64-e142ed75955b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-wmvm9\" (UID: \"3b275532-e93b-4cc3-9b64-e142ed75955b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" May 20 17:12:02.011814 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.011797 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9"] May 20 17:12:02.112844 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.112806 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b275532-e93b-4cc3-9b64-e142ed75955b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-wmvm9\" (UID: \"3b275532-e93b-4cc3-9b64-e142ed75955b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" May 20 17:12:02.113017 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.112868 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trvtz\" (UniqueName: \"kubernetes.io/projected/3b275532-e93b-4cc3-9b64-e142ed75955b-kube-api-access-trvtz\") pod \"cert-manager-operator-controller-manager-54b9655956-wmvm9\" (UID: \"3b275532-e93b-4cc3-9b64-e142ed75955b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" May 20 17:12:02.113197 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.113180 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b275532-e93b-4cc3-9b64-e142ed75955b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-wmvm9\" (UID: \"3b275532-e93b-4cc3-9b64-e142ed75955b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" May 20 17:12:02.123776 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.123750 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trvtz\" (UniqueName: \"kubernetes.io/projected/3b275532-e93b-4cc3-9b64-e142ed75955b-kube-api-access-trvtz\") pod \"cert-manager-operator-controller-manager-54b9655956-wmvm9\" (UID: \"3b275532-e93b-4cc3-9b64-e142ed75955b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" May 20 17:12:02.310698 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.310599 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" May 20 17:12:02.442810 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.442767 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9"] May 20 17:12:02.446017 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:12:02.445991 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b275532_e93b_4cc3_9b64_e142ed75955b.slice/crio-c9da67688cf0681d232462d93f180ae8186ae84918d34e03fe087f101158883d WatchSource:0}: Error finding container c9da67688cf0681d232462d93f180ae8186ae84918d34e03fe087f101158883d: Status 404 returned error can't find the container with id c9da67688cf0681d232462d93f180ae8186ae84918d34e03fe087f101158883d May 20 17:12:02.548716 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:02.548677 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" event={"ID":"3b275532-e93b-4cc3-9b64-e142ed75955b","Type":"ContainerStarted","Data":"c9da67688cf0681d232462d93f180ae8186ae84918d34e03fe087f101158883d"} May 20 17:12:06.571322 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:06.571282 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" event={"ID":"3b275532-e93b-4cc3-9b64-e142ed75955b","Type":"ContainerStarted","Data":"f8504561becd73f6e6fba7690be4f8fe65e467724f08129c251c03822ce7e321"} May 20 17:12:06.592793 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:06.592736 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-wmvm9" podStartSLOduration=2.477254122 podStartE2EDuration="5.592719004s" podCreationTimestamp="2026-05-20 17:12:01 +0000 UTC" firstStartedPulling="2026-05-20 17:12:02.448494734 +0000 UTC m=+534.036088851" lastFinishedPulling="2026-05-20 17:12:05.5639596 +0000 UTC m=+537.151553733" observedRunningTime="2026-05-20 17:12:06.591159014 +0000 UTC m=+538.178753153" watchObservedRunningTime="2026-05-20 17:12:06.592719004 +0000 UTC m=+538.180313146" May 20 17:12:09.172009 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.171915 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-qzhpk"] May 20 17:12:09.176606 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.176585 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:09.178991 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.178965 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 20 17:12:09.179116 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.179030 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 20 17:12:09.179116 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.179081 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bdf28\"" May 20 17:12:09.185344 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.185321 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-qzhpk"] May 20 17:12:09.273308 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.273265 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdffe69c-ca0e-4ba8-bbd4-58218e3a0225-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-qzhpk\" (UID: \"bdffe69c-ca0e-4ba8-bbd4-58218e3a0225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:09.273481 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.273321 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrf2p\" (UniqueName: \"kubernetes.io/projected/bdffe69c-ca0e-4ba8-bbd4-58218e3a0225-kube-api-access-hrf2p\") pod \"cert-manager-webhook-587ccfb98-qzhpk\" (UID: \"bdffe69c-ca0e-4ba8-bbd4-58218e3a0225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:09.374755 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.374720 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrf2p\" (UniqueName: \"kubernetes.io/projected/bdffe69c-ca0e-4ba8-bbd4-58218e3a0225-kube-api-access-hrf2p\") pod \"cert-manager-webhook-587ccfb98-qzhpk\" (UID: \"bdffe69c-ca0e-4ba8-bbd4-58218e3a0225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:09.374930 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.374827 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdffe69c-ca0e-4ba8-bbd4-58218e3a0225-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-qzhpk\" (UID: \"bdffe69c-ca0e-4ba8-bbd4-58218e3a0225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:09.385560 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.385520 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdffe69c-ca0e-4ba8-bbd4-58218e3a0225-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-qzhpk\" (UID: \"bdffe69c-ca0e-4ba8-bbd4-58218e3a0225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:09.385700 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.385640 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrf2p\" (UniqueName: \"kubernetes.io/projected/bdffe69c-ca0e-4ba8-bbd4-58218e3a0225-kube-api-access-hrf2p\") pod \"cert-manager-webhook-587ccfb98-qzhpk\" (UID: \"bdffe69c-ca0e-4ba8-bbd4-58218e3a0225\") " pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:09.496252 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.496164 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:09.622133 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:09.621969 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-qzhpk"] May 20 17:12:09.624909 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:12:09.624883 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdffe69c_ca0e_4ba8_bbd4_58218e3a0225.slice/crio-96ee3e404c495d50b77473b187592be965f88a14199cd8f8b311ac7cad4dca50 WatchSource:0}: Error finding container 96ee3e404c495d50b77473b187592be965f88a14199cd8f8b311ac7cad4dca50: Status 404 returned error can't find the container with id 96ee3e404c495d50b77473b187592be965f88a14199cd8f8b311ac7cad4dca50 May 20 17:12:10.198559 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.198509 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-crw2h"] May 20 17:12:10.203022 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.203003 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" May 20 17:12:10.205119 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.205102 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kzjsn\"" May 20 17:12:10.211106 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.211084 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-crw2h"] May 20 17:12:10.281902 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.281868 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqq6\" (UniqueName: \"kubernetes.io/projected/1d4e5e3c-6004-4409-93d7-aca619a54722-kube-api-access-gxqq6\") pod \"cert-manager-cainjector-68b757865b-crw2h\" (UID: \"1d4e5e3c-6004-4409-93d7-aca619a54722\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" May 20 17:12:10.282073 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.281921 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d4e5e3c-6004-4409-93d7-aca619a54722-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-crw2h\" (UID: \"1d4e5e3c-6004-4409-93d7-aca619a54722\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" May 20 17:12:10.383209 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.383170 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqq6\" (UniqueName: \"kubernetes.io/projected/1d4e5e3c-6004-4409-93d7-aca619a54722-kube-api-access-gxqq6\") pod \"cert-manager-cainjector-68b757865b-crw2h\" (UID: \"1d4e5e3c-6004-4409-93d7-aca619a54722\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" May 20 17:12:10.383389 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.383231 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d4e5e3c-6004-4409-93d7-aca619a54722-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-crw2h\" (UID: \"1d4e5e3c-6004-4409-93d7-aca619a54722\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" May 20 17:12:10.397150 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.394846 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d4e5e3c-6004-4409-93d7-aca619a54722-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-crw2h\" (UID: \"1d4e5e3c-6004-4409-93d7-aca619a54722\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" May 20 17:12:10.397150 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.395153 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqq6\" (UniqueName: \"kubernetes.io/projected/1d4e5e3c-6004-4409-93d7-aca619a54722-kube-api-access-gxqq6\") pod \"cert-manager-cainjector-68b757865b-crw2h\" (UID: \"1d4e5e3c-6004-4409-93d7-aca619a54722\") " pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" May 20 17:12:10.512643 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.512550 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" May 20 17:12:10.588012 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.587973 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" event={"ID":"bdffe69c-ca0e-4ba8-bbd4-58218e3a0225","Type":"ContainerStarted","Data":"96ee3e404c495d50b77473b187592be965f88a14199cd8f8b311ac7cad4dca50"} May 20 17:12:10.667330 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:10.667179 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-crw2h"] May 20 17:12:10.670665 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:12:10.670623 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4e5e3c_6004_4409_93d7_aca619a54722.slice/crio-5b3ffff606b6763c187076d0e90cb64c377d1e0ee0e5bef92de6df6da174d786 WatchSource:0}: Error finding container 5b3ffff606b6763c187076d0e90cb64c377d1e0ee0e5bef92de6df6da174d786: Status 404 returned error can't find the container with id 5b3ffff606b6763c187076d0e90cb64c377d1e0ee0e5bef92de6df6da174d786 May 20 17:12:11.593244 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:11.593205 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" event={"ID":"1d4e5e3c-6004-4409-93d7-aca619a54722","Type":"ContainerStarted","Data":"5b3ffff606b6763c187076d0e90cb64c377d1e0ee0e5bef92de6df6da174d786"} May 20 17:12:12.598404 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:12.598307 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" event={"ID":"bdffe69c-ca0e-4ba8-bbd4-58218e3a0225","Type":"ContainerStarted","Data":"eea87c44d25f1b15faa04e8b78b5ce195534f9247f2b1e892ab7b374b8a48785"} May 20 17:12:12.598404 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:12.598395 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:12.599750 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:12.599724 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" event={"ID":"1d4e5e3c-6004-4409-93d7-aca619a54722","Type":"ContainerStarted","Data":"a66271a8dcf6e1db17898e29306e1b0977978b1596e5a5380f77de7a647abcc0"} May 20 17:12:12.614081 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:12.614041 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" podStartSLOduration=0.982391151 podStartE2EDuration="3.614029233s" podCreationTimestamp="2026-05-20 17:12:09 +0000 UTC" firstStartedPulling="2026-05-20 17:12:09.626704239 +0000 UTC m=+541.214298371" lastFinishedPulling="2026-05-20 17:12:12.258342335 +0000 UTC m=+543.845936453" observedRunningTime="2026-05-20 17:12:12.61339431 +0000 UTC m=+544.200988452" watchObservedRunningTime="2026-05-20 17:12:12.614029233 +0000 UTC m=+544.201623373" May 20 17:12:12.627845 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:12.627808 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-crw2h" podStartSLOduration=1.041610544 podStartE2EDuration="2.627795098s" podCreationTimestamp="2026-05-20 17:12:10 +0000 UTC" firstStartedPulling="2026-05-20 17:12:10.672870024 +0000 UTC m=+542.260464157" lastFinishedPulling="2026-05-20 17:12:12.259054579 +0000 UTC m=+543.846648711" observedRunningTime="2026-05-20 17:12:12.62635243 +0000 UTC m=+544.213946570" watchObservedRunningTime="2026-05-20 17:12:12.627795098 +0000 UTC m=+544.215389238" May 20 17:12:18.605684 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:18.605652 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-qzhpk" May 20 17:12:45.653239 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.653205 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt"] May 20 17:12:45.661281 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.661258 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.664562 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.664527 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 20 17:12:45.664692 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.664589 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 20 17:12:45.664692 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.664638 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 20 17:12:45.666116 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.666098 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-chgpn\"" May 20 17:12:45.666248 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.666229 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 20 17:12:45.669747 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.669727 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt"] May 20 17:12:45.795388 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.795351 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc317bba-c171-4f90-87da-b255ca3c7307-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.795605 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.795403 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvdl\" (UniqueName: \"kubernetes.io/projected/cc317bba-c171-4f90-87da-b255ca3c7307-kube-api-access-lsvdl\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.795605 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.795522 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc317bba-c171-4f90-87da-b255ca3c7307-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.896630 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.896595 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc317bba-c171-4f90-87da-b255ca3c7307-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.896792 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.896684 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc317bba-c171-4f90-87da-b255ca3c7307-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.896792 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.896723 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvdl\" (UniqueName: \"kubernetes.io/projected/cc317bba-c171-4f90-87da-b255ca3c7307-kube-api-access-lsvdl\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.899145 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.899120 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc317bba-c171-4f90-87da-b255ca3c7307-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.899290 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.899225 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc317bba-c171-4f90-87da-b255ca3c7307-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.905580 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.905510 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvdl\" (UniqueName: \"kubernetes.io/projected/cc317bba-c171-4f90-87da-b255ca3c7307-kube-api-access-lsvdl\") pod \"opendatahub-operator-controller-manager-5c544869d7-pncmt\" (UID: \"cc317bba-c171-4f90-87da-b255ca3c7307\") " pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:45.972527 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:45.972501 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:46.105783 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:46.105753 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt"] May 20 17:12:46.108372 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:12:46.108345 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc317bba_c171_4f90_87da_b255ca3c7307.slice/crio-169baef867d21d8cc9dbe74a686967cd178174212936ece627285794141d241c WatchSource:0}: Error finding container 169baef867d21d8cc9dbe74a686967cd178174212936ece627285794141d241c: Status 404 returned error can't find the container with id 169baef867d21d8cc9dbe74a686967cd178174212936ece627285794141d241c May 20 17:12:46.712399 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:46.712356 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" event={"ID":"cc317bba-c171-4f90-87da-b255ca3c7307","Type":"ContainerStarted","Data":"169baef867d21d8cc9dbe74a686967cd178174212936ece627285794141d241c"} May 20 17:12:49.725391 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:49.725359 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" event={"ID":"cc317bba-c171-4f90-87da-b255ca3c7307","Type":"ContainerStarted","Data":"2360f71959adb2579d74b1f577600632033ab2845a64b686b75c581ac06cb1df"} May 20 17:12:49.725915 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:49.725512 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:12:49.749673 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:12:49.749628 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" podStartSLOduration=2.160696997 podStartE2EDuration="4.749614379s" podCreationTimestamp="2026-05-20 17:12:45 +0000 UTC" firstStartedPulling="2026-05-20 17:12:46.110111042 +0000 UTC m=+577.697705160" lastFinishedPulling="2026-05-20 17:12:48.699028422 +0000 UTC m=+580.286622542" observedRunningTime="2026-05-20 17:12:49.748612946 +0000 UTC m=+581.336207085" watchObservedRunningTime="2026-05-20 17:12:49.749614379 +0000 UTC m=+581.337208519" May 20 17:13:00.731658 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:00.731625 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c544869d7-pncmt" May 20 17:13:04.786186 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.786148 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57795f5895-4xtqt"] May 20 17:13:04.789791 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.789768 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.793952 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.793928 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 20 17:13:04.794397 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.794377 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 20 17:13:04.794488 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.794378 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p5xkw\"" May 20 17:13:04.805943 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.805916 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57795f5895-4xtqt"] May 20 17:13:04.858124 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.858091 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd2cb\" (UniqueName: \"kubernetes.io/projected/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-kube-api-access-hd2cb\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.858316 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.858161 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-tmp\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.858316 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.858218 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-tls-certs\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.959060 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.959022 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hd2cb\" (UniqueName: \"kubernetes.io/projected/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-kube-api-access-hd2cb\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.959252 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.959077 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-tmp\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.959252 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.959115 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-tls-certs\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.961428 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.961393 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-tmp\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.961579 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.961509 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-tls-certs\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:04.968043 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:04.968009 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd2cb\" (UniqueName: \"kubernetes.io/projected/ec0dab7c-b00f-4eab-b1cb-5265da97ec28-kube-api-access-hd2cb\") pod \"kube-auth-proxy-57795f5895-4xtqt\" (UID: \"ec0dab7c-b00f-4eab-b1cb-5265da97ec28\") " pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:05.099332 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:05.099247 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" May 20 17:13:05.235235 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:05.235205 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57795f5895-4xtqt"] May 20 17:13:05.238390 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:13:05.238345 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0dab7c_b00f_4eab_b1cb_5265da97ec28.slice/crio-294e472f58ad4671ba3288b3852ab7fd2246b8ede8dcadef99bedb1e25106c2f WatchSource:0}: Error finding container 294e472f58ad4671ba3288b3852ab7fd2246b8ede8dcadef99bedb1e25106c2f: Status 404 returned error can't find the container with id 294e472f58ad4671ba3288b3852ab7fd2246b8ede8dcadef99bedb1e25106c2f May 20 17:13:05.780310 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:05.780268 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" event={"ID":"ec0dab7c-b00f-4eab-b1cb-5265da97ec28","Type":"ContainerStarted","Data":"294e472f58ad4671ba3288b3852ab7fd2246b8ede8dcadef99bedb1e25106c2f"} May 20 17:13:07.323987 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.323950 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-gmkrz"] May 20 17:13:07.327217 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.327201 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:07.330062 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.330028 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 20 17:13:07.330189 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.330142 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dmnr6\"" May 20 17:13:07.347626 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.347594 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-gmkrz"] May 20 17:13:07.381745 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.381704 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrmg\" (UniqueName: \"kubernetes.io/projected/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-kube-api-access-pjrmg\") pod \"odh-model-controller-858dbf95b8-gmkrz\" (UID: \"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4\") " pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:07.381906 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.381767 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert\") pod \"odh-model-controller-858dbf95b8-gmkrz\" (UID: \"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4\") " pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:07.483284 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.483253 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrmg\" (UniqueName: \"kubernetes.io/projected/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-kube-api-access-pjrmg\") pod \"odh-model-controller-858dbf95b8-gmkrz\" (UID: \"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4\") " pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:07.483483 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.483305 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert\") pod \"odh-model-controller-858dbf95b8-gmkrz\" (UID: \"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4\") " pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:07.483483 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:07.483472 2545 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 20 17:13:07.483605 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:07.483566 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert podName:1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4 nodeName:}" failed. No retries permitted until 2026-05-20 17:13:07.983524882 +0000 UTC m=+599.571119014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert") pod "odh-model-controller-858dbf95b8-gmkrz" (UID: "1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4") : secret "odh-model-controller-webhook-cert" not found May 20 17:13:07.496652 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.496620 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrmg\" (UniqueName: \"kubernetes.io/projected/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-kube-api-access-pjrmg\") pod \"odh-model-controller-858dbf95b8-gmkrz\" (UID: \"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4\") " pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:07.988436 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:07.988401 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert\") pod \"odh-model-controller-858dbf95b8-gmkrz\" (UID: \"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4\") " pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:07.988640 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:07.988620 2545 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 20 17:13:07.988704 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:07.988687 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert podName:1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4 nodeName:}" failed. No retries permitted until 2026-05-20 17:13:08.988667998 +0000 UTC m=+600.576262135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert") pod "odh-model-controller-858dbf95b8-gmkrz" (UID: "1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4") : secret "odh-model-controller-webhook-cert" not found May 20 17:13:08.792180 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:08.792094 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" event={"ID":"ec0dab7c-b00f-4eab-b1cb-5265da97ec28","Type":"ContainerStarted","Data":"7ef12558c42d5b22823c0149d918df9b7ca842d7fda977ee740f27bbd4b6300d"} May 20 17:13:08.808960 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:08.808915 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57795f5895-4xtqt" podStartSLOduration=1.5987066890000001 podStartE2EDuration="4.808901353s" podCreationTimestamp="2026-05-20 17:13:04 +0000 UTC" firstStartedPulling="2026-05-20 17:13:05.240199735 +0000 UTC m=+596.827793854" lastFinishedPulling="2026-05-20 17:13:08.4503944 +0000 UTC m=+600.037988518" observedRunningTime="2026-05-20 17:13:08.808529649 +0000 UTC m=+600.396123801" watchObservedRunningTime="2026-05-20 17:13:08.808901353 +0000 UTC m=+600.396495497" May 20 17:13:08.915470 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:08.915445 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:13:08.915748 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:08.915727 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:13:08.997546 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:08.997514 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert\") pod \"odh-model-controller-858dbf95b8-gmkrz\" (UID: \"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4\") " pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:09.000332 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:09.000302 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4-cert\") pod \"odh-model-controller-858dbf95b8-gmkrz\" (UID: \"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4\") " pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:09.148137 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:09.148104 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dmnr6\"" May 20 17:13:09.150455 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:09.150422 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:09.309036 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:09.308982 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-gmkrz"] May 20 17:13:09.315626 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:13:09.315516 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4d3d9d_6c2a_4e00_a4c3_c31ff5239cd4.slice/crio-4740b7ff09aff0e20d45a40789b0fad6a650a8d25957c8af554ed564bff59a5e WatchSource:0}: Error finding container 4740b7ff09aff0e20d45a40789b0fad6a650a8d25957c8af554ed564bff59a5e: Status 404 returned error can't find the container with id 4740b7ff09aff0e20d45a40789b0fad6a650a8d25957c8af554ed564bff59a5e May 20 17:13:09.797415 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:09.797377 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" event={"ID":"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4","Type":"ContainerStarted","Data":"4740b7ff09aff0e20d45a40789b0fad6a650a8d25957c8af554ed564bff59a5e"} May 20 17:13:12.808932 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:12.808900 2545 generic.go:358] "Generic (PLEG): container finished" podID="1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4" containerID="6438751dfe7101f2033c33986b68ddf30488d06f4a3f6a6e46f29487b8e17039" exitCode=1 May 20 17:13:12.809406 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:12.808982 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" event={"ID":"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4","Type":"ContainerDied","Data":"6438751dfe7101f2033c33986b68ddf30488d06f4a3f6a6e46f29487b8e17039"} May 20 17:13:12.809406 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:12.809241 2545 scope.go:117] "RemoveContainer" containerID="6438751dfe7101f2033c33986b68ddf30488d06f4a3f6a6e46f29487b8e17039" May 20 17:13:13.810662 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.810617 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-w7757"] May 20 17:13:13.814193 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.814166 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" event={"ID":"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4","Type":"ContainerDied","Data":"c9d36dc9fc08320da4ee27599be4c2e9fb36f7f221462e4f5830e235a5d4f9d8"} May 20 17:13:13.814310 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.814206 2545 scope.go:117] "RemoveContainer" containerID="6438751dfe7101f2033c33986b68ddf30488d06f4a3f6a6e46f29487b8e17039" May 20 17:13:13.814310 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.814167 2545 generic.go:358] "Generic (PLEG): container finished" podID="1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4" containerID="c9d36dc9fc08320da4ee27599be4c2e9fb36f7f221462e4f5830e235a5d4f9d8" exitCode=1 May 20 17:13:13.814429 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.814355 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:13.814627 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.814518 2545 scope.go:117] "RemoveContainer" containerID="c9d36dc9fc08320da4ee27599be4c2e9fb36f7f221462e4f5830e235a5d4f9d8" May 20 17:13:13.814798 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:13.814775 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-gmkrz_opendatahub(1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4)\"" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" podUID="1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4" May 20 17:13:13.818550 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.818513 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 20 17:13:13.820736 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.820716 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hmh6b\"" May 20 17:13:13.837059 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.837035 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-w7757"] May 20 17:13:13.946186 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.946151 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23b46edf-8441-4442-b253-817e7667fd9f-cert\") pod \"kserve-controller-manager-856948b99f-w7757\" (UID: \"23b46edf-8441-4442-b253-817e7667fd9f\") " pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:13.946378 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:13.946309 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8cd9\" (UniqueName: \"kubernetes.io/projected/23b46edf-8441-4442-b253-817e7667fd9f-kube-api-access-b8cd9\") pod \"kserve-controller-manager-856948b99f-w7757\" (UID: \"23b46edf-8441-4442-b253-817e7667fd9f\") " pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:14.047864 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:14.047830 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8cd9\" (UniqueName: \"kubernetes.io/projected/23b46edf-8441-4442-b253-817e7667fd9f-kube-api-access-b8cd9\") pod \"kserve-controller-manager-856948b99f-w7757\" (UID: \"23b46edf-8441-4442-b253-817e7667fd9f\") " pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:14.048032 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:14.047893 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23b46edf-8441-4442-b253-817e7667fd9f-cert\") pod \"kserve-controller-manager-856948b99f-w7757\" (UID: \"23b46edf-8441-4442-b253-817e7667fd9f\") " pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:14.048032 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:14.047992 2545 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 20 17:13:14.048114 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:14.048067 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23b46edf-8441-4442-b253-817e7667fd9f-cert podName:23b46edf-8441-4442-b253-817e7667fd9f nodeName:}" failed. No retries permitted until 2026-05-20 17:13:14.54805087 +0000 UTC m=+606.135644987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/23b46edf-8441-4442-b253-817e7667fd9f-cert") pod "kserve-controller-manager-856948b99f-w7757" (UID: "23b46edf-8441-4442-b253-817e7667fd9f") : secret "kserve-webhook-server-cert" not found May 20 17:13:14.071878 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:14.071798 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8cd9\" (UniqueName: \"kubernetes.io/projected/23b46edf-8441-4442-b253-817e7667fd9f-kube-api-access-b8cd9\") pod \"kserve-controller-manager-856948b99f-w7757\" (UID: \"23b46edf-8441-4442-b253-817e7667fd9f\") " pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:14.552391 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:14.552357 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23b46edf-8441-4442-b253-817e7667fd9f-cert\") pod \"kserve-controller-manager-856948b99f-w7757\" (UID: \"23b46edf-8441-4442-b253-817e7667fd9f\") " pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:14.554777 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:14.554752 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23b46edf-8441-4442-b253-817e7667fd9f-cert\") pod \"kserve-controller-manager-856948b99f-w7757\" (UID: \"23b46edf-8441-4442-b253-817e7667fd9f\") " pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:14.726139 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:14.726101 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:14.821240 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:14.821147 2545 scope.go:117] "RemoveContainer" containerID="c9d36dc9fc08320da4ee27599be4c2e9fb36f7f221462e4f5830e235a5d4f9d8" May 20 17:13:14.821687 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:14.821386 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-gmkrz_opendatahub(1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4)\"" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" podUID="1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4" May 20 17:13:14.877193 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:14.876983 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-w7757"] May 20 17:13:14.879478 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:13:14.879452 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b46edf_8441_4442_b253_817e7667fd9f.slice/crio-a585b2768add756f7c48ed29714f9d26d346f28da3a4d674391a42b0beaed3e3 WatchSource:0}: Error finding container a585b2768add756f7c48ed29714f9d26d346f28da3a4d674391a42b0beaed3e3: Status 404 returned error can't find the container with id a585b2768add756f7c48ed29714f9d26d346f28da3a4d674391a42b0beaed3e3 May 20 17:13:15.826388 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:15.826347 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-w7757" event={"ID":"23b46edf-8441-4442-b253-817e7667fd9f","Type":"ContainerStarted","Data":"a585b2768add756f7c48ed29714f9d26d346f28da3a4d674391a42b0beaed3e3"} May 20 17:13:18.838213 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:18.838169 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-w7757" event={"ID":"23b46edf-8441-4442-b253-817e7667fd9f","Type":"ContainerStarted","Data":"aa25efbfb3788c1b2d2f0a510aa908905ca3083489db8bc4d7b6063abb2d7f8e"} May 20 17:13:18.838672 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:18.838296 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:13:18.854886 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:18.854812 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-w7757" podStartSLOduration=2.9115182490000002 podStartE2EDuration="5.854793559s" podCreationTimestamp="2026-05-20 17:13:13 +0000 UTC" firstStartedPulling="2026-05-20 17:13:14.880875005 +0000 UTC m=+606.468469123" lastFinishedPulling="2026-05-20 17:13:17.82415031 +0000 UTC m=+609.411744433" observedRunningTime="2026-05-20 17:13:18.854182175 +0000 UTC m=+610.441776315" watchObservedRunningTime="2026-05-20 17:13:18.854793559 +0000 UTC m=+610.442387700" May 20 17:13:19.151195 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:19.151152 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:19.151665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:19.151646 2545 scope.go:117] "RemoveContainer" containerID="c9d36dc9fc08320da4ee27599be4c2e9fb36f7f221462e4f5830e235a5d4f9d8" May 20 17:13:19.151884 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:13:19.151865 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-gmkrz_opendatahub(1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4)\"" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" podUID="1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4" May 20 17:13:23.306157 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.306066 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-5grfs"] May 20 17:13:23.313685 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.313661 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:23.316546 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.316516 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 20 17:13:23.316634 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.316548 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 20 17:13:23.316987 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.316971 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-j7x2f\"" May 20 17:13:23.323522 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.323501 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-5grfs"] May 20 17:13:23.437256 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.437221 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0dd8ecf3-e835-452a-b853-0dfd15b75608-operator-config\") pod \"servicemesh-operator3-55f49c5f94-5grfs\" (UID: \"0dd8ecf3-e835-452a-b853-0dfd15b75608\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:23.437442 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.437269 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2tfs\" (UniqueName: \"kubernetes.io/projected/0dd8ecf3-e835-452a-b853-0dfd15b75608-kube-api-access-v2tfs\") pod \"servicemesh-operator3-55f49c5f94-5grfs\" (UID: \"0dd8ecf3-e835-452a-b853-0dfd15b75608\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:23.538607 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.538568 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0dd8ecf3-e835-452a-b853-0dfd15b75608-operator-config\") pod \"servicemesh-operator3-55f49c5f94-5grfs\" (UID: \"0dd8ecf3-e835-452a-b853-0dfd15b75608\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:23.538787 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.538643 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2tfs\" (UniqueName: \"kubernetes.io/projected/0dd8ecf3-e835-452a-b853-0dfd15b75608-kube-api-access-v2tfs\") pod \"servicemesh-operator3-55f49c5f94-5grfs\" (UID: \"0dd8ecf3-e835-452a-b853-0dfd15b75608\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:23.541042 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.541010 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0dd8ecf3-e835-452a-b853-0dfd15b75608-operator-config\") pod \"servicemesh-operator3-55f49c5f94-5grfs\" (UID: \"0dd8ecf3-e835-452a-b853-0dfd15b75608\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:23.549929 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.549910 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2tfs\" (UniqueName: \"kubernetes.io/projected/0dd8ecf3-e835-452a-b853-0dfd15b75608-kube-api-access-v2tfs\") pod \"servicemesh-operator3-55f49c5f94-5grfs\" (UID: \"0dd8ecf3-e835-452a-b853-0dfd15b75608\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:23.624113 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.624019 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:23.763426 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.763398 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-5grfs"] May 20 17:13:23.765765 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:13:23.765735 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd8ecf3_e835_452a_b853_0dfd15b75608.slice/crio-b1d84260e02c8e3992e8f875d972e16fc28d1463e0cfe1b4d95b077d77aa4324 WatchSource:0}: Error finding container b1d84260e02c8e3992e8f875d972e16fc28d1463e0cfe1b4d95b077d77aa4324: Status 404 returned error can't find the container with id b1d84260e02c8e3992e8f875d972e16fc28d1463e0cfe1b4d95b077d77aa4324 May 20 17:13:23.856429 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:23.856392 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" event={"ID":"0dd8ecf3-e835-452a-b853-0dfd15b75608","Type":"ContainerStarted","Data":"b1d84260e02c8e3992e8f875d972e16fc28d1463e0cfe1b4d95b077d77aa4324"} May 20 17:13:26.870823 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:26.870783 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" event={"ID":"0dd8ecf3-e835-452a-b853-0dfd15b75608","Type":"ContainerStarted","Data":"ebdf078a0c0c80f4b3f6ab8d66dedf2dbeb529b3a10f8da5333d4fceea3b4811"} May 20 17:13:26.871201 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:26.870844 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:26.910852 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:26.910790 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" podStartSLOduration=1.309244863 podStartE2EDuration="3.910772267s" podCreationTimestamp="2026-05-20 17:13:23 +0000 UTC" firstStartedPulling="2026-05-20 17:13:23.768348929 +0000 UTC m=+615.355943050" lastFinishedPulling="2026-05-20 17:13:26.369876336 +0000 UTC m=+617.957470454" observedRunningTime="2026-05-20 17:13:26.907821251 +0000 UTC m=+618.495415391" watchObservedRunningTime="2026-05-20 17:13:26.910772267 +0000 UTC m=+618.498366406" May 20 17:13:29.151294 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:29.151260 2545 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:29.151721 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:29.151713 2545 scope.go:117] "RemoveContainer" containerID="c9d36dc9fc08320da4ee27599be4c2e9fb36f7f221462e4f5830e235a5d4f9d8" May 20 17:13:29.884797 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:29.884763 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" event={"ID":"1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4","Type":"ContainerStarted","Data":"b2a86afb7b2260dd7bec6cc5f94dad089c7605fff87f7f746d2e17b5481b7916"} May 20 17:13:29.884999 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:29.884975 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:29.920558 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:29.916380 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" podStartSLOduration=2.756212953 podStartE2EDuration="22.916362924s" podCreationTimestamp="2026-05-20 17:13:07 +0000 UTC" firstStartedPulling="2026-05-20 17:13:09.317090958 +0000 UTC m=+600.904685077" lastFinishedPulling="2026-05-20 17:13:29.47724093 +0000 UTC m=+621.064835048" observedRunningTime="2026-05-20 17:13:29.913751282 +0000 UTC m=+621.501345421" watchObservedRunningTime="2026-05-20 17:13:29.916362924 +0000 UTC m=+621.503957065" May 20 17:13:31.341466 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.341427 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7"] May 20 17:13:31.345514 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.345490 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.351075 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.351053 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 20 17:13:31.351407 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.351383 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 20 17:13:31.351567 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.351515 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jvlkn\"" May 20 17:13:31.351826 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.351788 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 20 17:13:31.351922 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.351791 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 20 17:13:31.378825 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.378793 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7"] May 20 17:13:31.513763 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.513719 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.513934 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.513772 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.513934 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.513841 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.513934 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.513866 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.513934 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.513892 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.513934 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.513929 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhrw\" (UniqueName: \"kubernetes.io/projected/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-kube-api-access-glhrw\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.514168 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.514026 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.615241 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.615154 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.615241 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.615192 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.615241 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.615211 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.615241 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.615238 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glhrw\" (UniqueName: \"kubernetes.io/projected/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-kube-api-access-glhrw\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.615624 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.615507 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.615624 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.615575 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.615749 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.615622 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.616166 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.616138 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.617682 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.617649 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.617822 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.617803 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.618012 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.617998 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.618070 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.618043 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.629418 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.629396 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.632673 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.632647 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhrw\" (UniqueName: \"kubernetes.io/projected/9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1-kube-api-access-glhrw\") pod \"istiod-openshift-gateway-798958bb55-4fgw7\" (UID: \"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.656401 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.656372 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:31.856102 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.856068 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7"] May 20 17:13:31.859203 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:13:31.859176 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9293a14a_f5d1_4a7d_95b1_4cc7b3576fb1.slice/crio-0effa9de277b407ba1e353be00143be380301cdb8d63c4c5de83472d2d05e24b WatchSource:0}: Error finding container 0effa9de277b407ba1e353be00143be380301cdb8d63c4c5de83472d2d05e24b: Status 404 returned error can't find the container with id 0effa9de277b407ba1e353be00143be380301cdb8d63c4c5de83472d2d05e24b May 20 17:13:31.894960 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:31.894927 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" event={"ID":"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1","Type":"ContainerStarted","Data":"0effa9de277b407ba1e353be00143be380301cdb8d63c4c5de83472d2d05e24b"} May 20 17:13:34.451486 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:34.451430 2545 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 20 17:13:34.451859 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:34.451519 2545 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} May 20 17:13:34.908635 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:34.908591 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" event={"ID":"9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1","Type":"ContainerStarted","Data":"b6252722a21d0b4695f388936c223c0d380758a75b6604c1c93e68f36c7c9830"} May 20 17:13:34.908805 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:34.908734 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:34.968219 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:34.968159 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" podStartSLOduration=1.378316699 podStartE2EDuration="3.968138847s" podCreationTimestamp="2026-05-20 17:13:31 +0000 UTC" firstStartedPulling="2026-05-20 17:13:31.861362282 +0000 UTC m=+623.448956400" lastFinishedPulling="2026-05-20 17:13:34.451184417 +0000 UTC m=+626.038778548" observedRunningTime="2026-05-20 17:13:34.966236943 +0000 UTC m=+626.553831083" watchObservedRunningTime="2026-05-20 17:13:34.968138847 +0000 UTC m=+626.555732994" May 20 17:13:35.914060 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:35.914022 2545 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-4fgw7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 20 17:13:35.914415 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:35.914087 2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" podUID="9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 17:13:37.876660 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:37.876630 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-5grfs" May 20 17:13:38.913556 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:38.913489 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4fgw7" May 20 17:13:40.890218 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:40.890185 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-gmkrz" May 20 17:13:49.846738 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:13:49.846704 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-w7757" May 20 17:14:35.829731 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:35.829693 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ptjpn"] May 20 17:14:35.833313 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:35.833297 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" May 20 17:14:35.835679 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:35.835655 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 20 17:14:35.835784 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:35.835713 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sd8cp\"" May 20 17:14:35.836422 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:35.836406 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 20 17:14:35.846791 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:35.846764 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ptjpn"] May 20 17:14:35.913473 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:35.913425 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2fsf\" (UniqueName: \"kubernetes.io/projected/bb704e90-2363-4416-b9b2-52537822acd9-kube-api-access-w2fsf\") pod \"authorino-operator-657f44b778-ptjpn\" (UID: \"bb704e90-2363-4416-b9b2-52537822acd9\") " pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" May 20 17:14:36.014627 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:36.014589 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2fsf\" (UniqueName: \"kubernetes.io/projected/bb704e90-2363-4416-b9b2-52537822acd9-kube-api-access-w2fsf\") pod \"authorino-operator-657f44b778-ptjpn\" (UID: \"bb704e90-2363-4416-b9b2-52537822acd9\") " pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" May 20 17:14:36.027612 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:36.027579 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2fsf\" (UniqueName: \"kubernetes.io/projected/bb704e90-2363-4416-b9b2-52537822acd9-kube-api-access-w2fsf\") pod \"authorino-operator-657f44b778-ptjpn\" (UID: \"bb704e90-2363-4416-b9b2-52537822acd9\") " pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" May 20 17:14:36.144036 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:36.143999 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" May 20 17:14:36.310885 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:36.310861 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ptjpn"] May 20 17:14:37.128116 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:37.128063 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" event={"ID":"bb704e90-2363-4416-b9b2-52537822acd9","Type":"ContainerStarted","Data":"c8b453806e587426889e4a8fe1d460211914871b5428a042f7fde8a190fa4a7a"} May 20 17:14:39.137633 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:39.137593 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" event={"ID":"bb704e90-2363-4416-b9b2-52537822acd9","Type":"ContainerStarted","Data":"1de3005a1c28423db787ff269cbbb778862f52516d5eb73d01f6dc0d8cf7a3bb"} May 20 17:14:39.138203 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:39.138180 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" May 20 17:14:39.178152 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:39.178097 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" podStartSLOduration=2.371058151 podStartE2EDuration="4.178078171s" podCreationTimestamp="2026-05-20 17:14:35 +0000 UTC" firstStartedPulling="2026-05-20 17:14:36.328267199 +0000 UTC m=+687.915861318" lastFinishedPulling="2026-05-20 17:14:38.135287206 +0000 UTC m=+689.722881338" observedRunningTime="2026-05-20 17:14:39.176394253 +0000 UTC m=+690.763988394" watchObservedRunningTime="2026-05-20 17:14:39.178078171 +0000 UTC m=+690.765672312" May 20 17:14:45.866987 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:45.866948 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr"] May 20 17:14:45.870584 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:45.870562 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:14:45.873427 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:45.873406 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fkdtd\"" May 20 17:14:45.890164 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:45.890131 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr"] May 20 17:14:46.008602 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:46.008533 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjsbh\" (UniqueName: \"kubernetes.io/projected/15a77c85-2781-4b6f-9130-05ba4bcb7a7b-kube-api-access-fjsbh\") pod \"limitador-operator-controller-manager-85c4996f8c-zr9vr\" (UID: \"15a77c85-2781-4b6f-9130-05ba4bcb7a7b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:14:46.109390 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:46.109352 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjsbh\" (UniqueName: \"kubernetes.io/projected/15a77c85-2781-4b6f-9130-05ba4bcb7a7b-kube-api-access-fjsbh\") pod \"limitador-operator-controller-manager-85c4996f8c-zr9vr\" (UID: \"15a77c85-2781-4b6f-9130-05ba4bcb7a7b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:14:46.135659 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:46.135632 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjsbh\" (UniqueName: \"kubernetes.io/projected/15a77c85-2781-4b6f-9130-05ba4bcb7a7b-kube-api-access-fjsbh\") pod \"limitador-operator-controller-manager-85c4996f8c-zr9vr\" (UID: \"15a77c85-2781-4b6f-9130-05ba4bcb7a7b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:14:46.180392 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:46.180355 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:14:46.341125 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:46.341091 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr"] May 20 17:14:46.344266 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:14:46.344232 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a77c85_2781_4b6f_9130_05ba4bcb7a7b.slice/crio-136f395e8c44f7118f222c857365f830b9cac3020c7825de8983b7caeb4ab7db WatchSource:0}: Error finding container 136f395e8c44f7118f222c857365f830b9cac3020c7825de8983b7caeb4ab7db: Status 404 returned error can't find the container with id 136f395e8c44f7118f222c857365f830b9cac3020c7825de8983b7caeb4ab7db May 20 17:14:47.167345 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:47.167314 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" event={"ID":"15a77c85-2781-4b6f-9130-05ba4bcb7a7b","Type":"ContainerStarted","Data":"136f395e8c44f7118f222c857365f830b9cac3020c7825de8983b7caeb4ab7db"} May 20 17:14:49.176892 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:49.176845 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" event={"ID":"15a77c85-2781-4b6f-9130-05ba4bcb7a7b","Type":"ContainerStarted","Data":"e206e8c2d0f65878b9db425d8dc2342c3a9b40b77292d031d0e817af446cc3bb"} May 20 17:14:49.177334 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:49.176993 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:14:49.208807 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:49.208757 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" podStartSLOduration=2.168600161 podStartE2EDuration="4.208740178s" podCreationTimestamp="2026-05-20 17:14:45 +0000 UTC" firstStartedPulling="2026-05-20 17:14:46.346068387 +0000 UTC m=+697.933662508" lastFinishedPulling="2026-05-20 17:14:48.386208408 +0000 UTC m=+699.973802525" observedRunningTime="2026-05-20 17:14:49.207867778 +0000 UTC m=+700.795461919" watchObservedRunningTime="2026-05-20 17:14:49.208740178 +0000 UTC m=+700.796334383" May 20 17:14:50.143761 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:14:50.143732 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-ptjpn" May 20 17:15:00.182872 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:00.182795 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:15:01.023586 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.023551 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr"] May 20 17:15:01.023870 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.023828 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" containerName="manager" containerID="cri-o://e206e8c2d0f65878b9db425d8dc2342c3a9b40b77292d031d0e817af446cc3bb" gracePeriod=2 May 20 17:15:01.026269 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.026236 2545 status_manager.go:895] "Failed to get status for pod" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" err="pods \"limitador-operator-controller-manager-85c4996f8c-zr9vr\" is forbidden: User \"system:node:ip-10-0-135-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-136.ec2.internal' and this object" May 20 17:15:01.026389 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.026366 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr"] May 20 17:15:01.090866 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.090837 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49"] May 20 17:15:01.091229 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.091217 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" containerName="manager" May 20 17:15:01.091278 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.091231 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" containerName="manager" May 20 17:15:01.091324 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.091310 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" containerName="manager" May 20 17:15:01.094218 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.094199 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" May 20 17:15:01.126724 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.126689 2545 status_manager.go:895] "Failed to get status for pod" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" err="pods \"limitador-operator-controller-manager-85c4996f8c-zr9vr\" is forbidden: User \"system:node:ip-10-0-135-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-136.ec2.internal' and this object" May 20 17:15:01.171362 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.171330 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49"] May 20 17:15:01.222467 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.222432 2545 generic.go:358] "Generic (PLEG): container finished" podID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" containerID="e206e8c2d0f65878b9db425d8dc2342c3a9b40b77292d031d0e817af446cc3bb" exitCode=0 May 20 17:15:01.247334 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.247308 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsptk\" (UniqueName: \"kubernetes.io/projected/82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad-kube-api-access-wsptk\") pod \"limitador-operator-controller-manager-85c4996f8c-mnf49\" (UID: \"82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" May 20 17:15:01.263613 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.263592 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:15:01.266431 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.266406 2545 status_manager.go:895] "Failed to get status for pod" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" err="pods \"limitador-operator-controller-manager-85c4996f8c-zr9vr\" is forbidden: User \"system:node:ip-10-0-135-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-136.ec2.internal' and this object" May 20 17:15:01.348056 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.347994 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsptk\" (UniqueName: \"kubernetes.io/projected/82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad-kube-api-access-wsptk\") pod \"limitador-operator-controller-manager-85c4996f8c-mnf49\" (UID: \"82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" May 20 17:15:01.362915 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.362891 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsptk\" (UniqueName: \"kubernetes.io/projected/82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad-kube-api-access-wsptk\") pod \"limitador-operator-controller-manager-85c4996f8c-mnf49\" (UID: \"82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" May 20 17:15:01.428106 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.428077 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" May 20 17:15:01.448480 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.448454 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjsbh\" (UniqueName: \"kubernetes.io/projected/15a77c85-2781-4b6f-9130-05ba4bcb7a7b-kube-api-access-fjsbh\") pod \"15a77c85-2781-4b6f-9130-05ba4bcb7a7b\" (UID: \"15a77c85-2781-4b6f-9130-05ba4bcb7a7b\") " May 20 17:15:01.450650 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.450609 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a77c85-2781-4b6f-9130-05ba4bcb7a7b-kube-api-access-fjsbh" (OuterVolumeSpecName: "kube-api-access-fjsbh") pod "15a77c85-2781-4b6f-9130-05ba4bcb7a7b" (UID: "15a77c85-2781-4b6f-9130-05ba4bcb7a7b"). InnerVolumeSpecName "kube-api-access-fjsbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:15:01.549574 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.549529 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjsbh\" (UniqueName: \"kubernetes.io/projected/15a77c85-2781-4b6f-9130-05ba4bcb7a7b-kube-api-access-fjsbh\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:15:01.573161 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:01.573135 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49"] May 20 17:15:01.574136 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:15:01.574111 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82aa1985_be30_4d5b_9b0d_b92fa3fbf6ad.slice/crio-f4ba4cac9fabbd8b81236fbc4042516836de3c5db93647152a5eabc5db21a4de WatchSource:0}: Error finding container f4ba4cac9fabbd8b81236fbc4042516836de3c5db93647152a5eabc5db21a4de: Status 404 returned error can't find the container with id f4ba4cac9fabbd8b81236fbc4042516836de3c5db93647152a5eabc5db21a4de May 20 17:15:02.227677 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:02.227633 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" event={"ID":"82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad","Type":"ContainerStarted","Data":"b885ddac2cc9af93a67800006820ac6fa7bb8629af3b3ab8f26f05ef578b5eff"} May 20 17:15:02.227677 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:02.227682 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" May 20 17:15:02.228193 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:02.227693 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" event={"ID":"82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad","Type":"ContainerStarted","Data":"f4ba4cac9fabbd8b81236fbc4042516836de3c5db93647152a5eabc5db21a4de"} May 20 17:15:02.228925 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:02.228907 2545 scope.go:117] "RemoveContainer" containerID="e206e8c2d0f65878b9db425d8dc2342c3a9b40b77292d031d0e817af446cc3bb" May 20 17:15:02.228925 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:02.228921 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" May 20 17:15:02.230241 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:02.230217 2545 status_manager.go:895] "Failed to get status for pod" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" err="pods \"limitador-operator-controller-manager-85c4996f8c-zr9vr\" is forbidden: User \"system:node:ip-10-0-135-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-136.ec2.internal' and this object" May 20 17:15:02.258344 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:02.258292 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" podStartSLOduration=1.258277394 podStartE2EDuration="1.258277394s" podCreationTimestamp="2026-05-20 17:15:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:15:02.256957268 +0000 UTC m=+713.844551409" watchObservedRunningTime="2026-05-20 17:15:02.258277394 +0000 UTC m=+713.845871534" May 20 17:15:02.266143 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:02.266118 2545 status_manager.go:895] "Failed to get status for pod" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zr9vr" err="pods \"limitador-operator-controller-manager-85c4996f8c-zr9vr\" is forbidden: User \"system:node:ip-10-0-135-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-136.ec2.internal' and this object" May 20 17:15:03.003344 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:03.003313 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a77c85-2781-4b6f-9130-05ba4bcb7a7b" path="/var/lib/kubelet/pods/15a77c85-2781-4b6f-9130-05ba4bcb7a7b/volumes" May 20 17:15:13.236670 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:15:13.236640 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mnf49" May 20 17:16:20.164277 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.164243 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-578bcdf6b-g68vj"] May 20 17:16:20.167448 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.167428 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-578bcdf6b-g68vj" May 20 17:16:20.170005 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.169986 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jfm79\"" May 20 17:16:20.179122 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.179103 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-578bcdf6b-g68vj"] May 20 17:16:20.252807 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.252772 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-578bcdf6b-g68vj"] May 20 17:16:20.253069 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:16:20.253047 2545 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bsfk7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-578bcdf6b-g68vj" podUID="f146629b-800f-46b5-8d2c-c1953074190f" May 20 17:16:20.275137 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.275103 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/f146629b-800f-46b5-8d2c-c1953074190f-kube-api-access-bsfk7\") pod \"authorino-578bcdf6b-g68vj\" (UID: \"f146629b-800f-46b5-8d2c-c1953074190f\") " pod="kuadrant-system/authorino-578bcdf6b-g68vj" May 20 17:16:20.376493 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.376457 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/f146629b-800f-46b5-8d2c-c1953074190f-kube-api-access-bsfk7\") pod \"authorino-578bcdf6b-g68vj\" (UID: \"f146629b-800f-46b5-8d2c-c1953074190f\") " pod="kuadrant-system/authorino-578bcdf6b-g68vj" May 20 17:16:20.384856 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.384830 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/f146629b-800f-46b5-8d2c-c1953074190f-kube-api-access-bsfk7\") pod \"authorino-578bcdf6b-g68vj\" (UID: \"f146629b-800f-46b5-8d2c-c1953074190f\") " pod="kuadrant-system/authorino-578bcdf6b-g68vj" May 20 17:16:20.513131 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.513050 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-578bcdf6b-g68vj" May 20 17:16:20.517960 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.517937 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-578bcdf6b-g68vj" May 20 17:16:20.679818 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.679789 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/f146629b-800f-46b5-8d2c-c1953074190f-kube-api-access-bsfk7\") pod \"f146629b-800f-46b5-8d2c-c1953074190f\" (UID: \"f146629b-800f-46b5-8d2c-c1953074190f\") " May 20 17:16:20.681886 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.681863 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f146629b-800f-46b5-8d2c-c1953074190f-kube-api-access-bsfk7" (OuterVolumeSpecName: "kube-api-access-bsfk7") pod "f146629b-800f-46b5-8d2c-c1953074190f" (UID: "f146629b-800f-46b5-8d2c-c1953074190f"). InnerVolumeSpecName "kube-api-access-bsfk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:16:20.781032 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:20.780949 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsfk7\" (UniqueName: \"kubernetes.io/projected/f146629b-800f-46b5-8d2c-c1953074190f-kube-api-access-bsfk7\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:16:21.516835 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:21.516805 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-578bcdf6b-g68vj" May 20 17:16:21.554324 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:21.554291 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-578bcdf6b-g68vj"] May 20 17:16:21.557728 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:21.557704 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-578bcdf6b-g68vj"] May 20 17:16:23.003270 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:23.003237 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f146629b-800f-46b5-8d2c-c1953074190f" path="/var/lib/kubelet/pods/f146629b-800f-46b5-8d2c-c1953074190f/volumes" May 20 17:16:27.690005 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.689960 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8s8p4"] May 20 17:16:27.693822 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.693798 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" May 20 17:16:27.697796 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.697772 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 17:16:27.698169 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.698154 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-blkgm\"" May 20 17:16:27.705832 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.705808 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8s8p4"] May 20 17:16:27.844390 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.844359 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzs4\" (UniqueName: \"kubernetes.io/projected/69a093a2-0248-4394-bf49-8f42c60ba77c-kube-api-access-4gzs4\") pod \"maas-controller-68fb5d86bc-8s8p4\" (UID: \"69a093a2-0248-4394-bf49-8f42c60ba77c\") " pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" May 20 17:16:27.851019 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.850971 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-zsvcg"] May 20 17:16:27.854436 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.854414 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:27.863720 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.863694 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-zsvcg"] May 20 17:16:27.945585 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.945471 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzs4\" (UniqueName: \"kubernetes.io/projected/69a093a2-0248-4394-bf49-8f42c60ba77c-kube-api-access-4gzs4\") pod \"maas-controller-68fb5d86bc-8s8p4\" (UID: \"69a093a2-0248-4394-bf49-8f42c60ba77c\") " pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" May 20 17:16:27.956986 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.956956 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzs4\" (UniqueName: \"kubernetes.io/projected/69a093a2-0248-4394-bf49-8f42c60ba77c-kube-api-access-4gzs4\") pod \"maas-controller-68fb5d86bc-8s8p4\" (UID: \"69a093a2-0248-4394-bf49-8f42c60ba77c\") " pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" May 20 17:16:27.981112 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.981081 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8s8p4"] May 20 17:16:27.981407 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:27.981392 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" May 20 17:16:28.013930 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.013887 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-585598586b-gfqgb"] May 20 17:16:28.018714 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.018687 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:16:28.026678 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.026651 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585598586b-gfqgb"] May 20 17:16:28.046702 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.046671 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpwq8\" (UniqueName: \"kubernetes.io/projected/72182124-2d5d-4571-aae3-f2028d141ec1-kube-api-access-jpwq8\") pod \"maas-controller-7bf576fcc5-zsvcg\" (UID: \"72182124-2d5d-4571-aae3-f2028d141ec1\") " pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:28.122725 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.122657 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8s8p4"] May 20 17:16:28.125092 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:16:28.125063 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a093a2_0248_4394_bf49_8f42c60ba77c.slice/crio-94c0010d209c41acbf66bfb67dcc0ec49e93bdaffefa0e9e52c16a5d797e8f32 WatchSource:0}: Error finding container 94c0010d209c41acbf66bfb67dcc0ec49e93bdaffefa0e9e52c16a5d797e8f32: Status 404 returned error can't find the container with id 94c0010d209c41acbf66bfb67dcc0ec49e93bdaffefa0e9e52c16a5d797e8f32 May 20 17:16:28.126319 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.126304 2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:16:28.147582 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.147516 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp76s\" (UniqueName: \"kubernetes.io/projected/59da0bae-f89a-423b-8e46-73550e0f2c90-kube-api-access-dp76s\") pod \"maas-controller-585598586b-gfqgb\" (UID: \"59da0bae-f89a-423b-8e46-73550e0f2c90\") " pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:16:28.147748 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.147719 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpwq8\" (UniqueName: \"kubernetes.io/projected/72182124-2d5d-4571-aae3-f2028d141ec1-kube-api-access-jpwq8\") pod \"maas-controller-7bf576fcc5-zsvcg\" (UID: \"72182124-2d5d-4571-aae3-f2028d141ec1\") " pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:28.156231 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.156203 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpwq8\" (UniqueName: \"kubernetes.io/projected/72182124-2d5d-4571-aae3-f2028d141ec1-kube-api-access-jpwq8\") pod \"maas-controller-7bf576fcc5-zsvcg\" (UID: \"72182124-2d5d-4571-aae3-f2028d141ec1\") " pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:28.166037 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.166002 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:28.249207 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.249175 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dp76s\" (UniqueName: \"kubernetes.io/projected/59da0bae-f89a-423b-8e46-73550e0f2c90-kube-api-access-dp76s\") pod \"maas-controller-585598586b-gfqgb\" (UID: \"59da0bae-f89a-423b-8e46-73550e0f2c90\") " pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:16:28.259023 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.258993 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp76s\" (UniqueName: \"kubernetes.io/projected/59da0bae-f89a-423b-8e46-73550e0f2c90-kube-api-access-dp76s\") pod \"maas-controller-585598586b-gfqgb\" (UID: \"59da0bae-f89a-423b-8e46-73550e0f2c90\") " pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:16:28.301587 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.301529 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-zsvcg"] May 20 17:16:28.307789 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:16:28.307758 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72182124_2d5d_4571_aae3_f2028d141ec1.slice/crio-b84b1d943845017fc9cb1f947ce7011a647bb6d160fa2dea7bb04e73d8967b2f WatchSource:0}: Error finding container b84b1d943845017fc9cb1f947ce7011a647bb6d160fa2dea7bb04e73d8967b2f: Status 404 returned error can't find the container with id b84b1d943845017fc9cb1f947ce7011a647bb6d160fa2dea7bb04e73d8967b2f May 20 17:16:28.333736 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.333696 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:16:28.470714 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.470682 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585598586b-gfqgb"] May 20 17:16:28.473314 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:16:28.473281 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59da0bae_f89a_423b_8e46_73550e0f2c90.slice/crio-5e3121672e309e700085cee313d00b44711c8a1f700a53fee8a78bb1aeb11a73 WatchSource:0}: Error finding container 5e3121672e309e700085cee313d00b44711c8a1f700a53fee8a78bb1aeb11a73: Status 404 returned error can't find the container with id 5e3121672e309e700085cee313d00b44711c8a1f700a53fee8a78bb1aeb11a73 May 20 17:16:28.541298 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.541258 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-gfqgb" event={"ID":"59da0bae-f89a-423b-8e46-73550e0f2c90","Type":"ContainerStarted","Data":"5e3121672e309e700085cee313d00b44711c8a1f700a53fee8a78bb1aeb11a73"} May 20 17:16:28.542369 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.542340 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" event={"ID":"69a093a2-0248-4394-bf49-8f42c60ba77c","Type":"ContainerStarted","Data":"94c0010d209c41acbf66bfb67dcc0ec49e93bdaffefa0e9e52c16a5d797e8f32"} May 20 17:16:28.543338 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:28.543316 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" event={"ID":"72182124-2d5d-4571-aae3-f2028d141ec1","Type":"ContainerStarted","Data":"b84b1d943845017fc9cb1f947ce7011a647bb6d160fa2dea7bb04e73d8967b2f"} May 20 17:16:32.563477 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.563367 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" event={"ID":"72182124-2d5d-4571-aae3-f2028d141ec1","Type":"ContainerStarted","Data":"aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31"} May 20 17:16:32.563477 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.563430 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:32.564818 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.564795 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-gfqgb" event={"ID":"59da0bae-f89a-423b-8e46-73550e0f2c90","Type":"ContainerStarted","Data":"d27c2c803452178cbb128ef62fb67a7e67da00c3341389c0219bc575fa7c5591"} May 20 17:16:32.564941 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.564920 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:16:32.566307 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.566287 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" event={"ID":"69a093a2-0248-4394-bf49-8f42c60ba77c","Type":"ContainerStarted","Data":"7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e"} May 20 17:16:32.566418 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.566394 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" podUID="69a093a2-0248-4394-bf49-8f42c60ba77c" containerName="manager" containerID="cri-o://7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e" gracePeriod=30 May 20 17:16:32.566463 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.566433 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" May 20 17:16:32.582299 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.582244 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" podStartSLOduration=1.703829391 podStartE2EDuration="5.582226578s" podCreationTimestamp="2026-05-20 17:16:27 +0000 UTC" firstStartedPulling="2026-05-20 17:16:28.309117329 +0000 UTC m=+799.896711447" lastFinishedPulling="2026-05-20 17:16:32.187514513 +0000 UTC m=+803.775108634" observedRunningTime="2026-05-20 17:16:32.581767783 +0000 UTC m=+804.169361934" watchObservedRunningTime="2026-05-20 17:16:32.582226578 +0000 UTC m=+804.169820719" May 20 17:16:32.599466 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.599414 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-585598586b-gfqgb" podStartSLOduration=1.896941373 podStartE2EDuration="5.599391082s" podCreationTimestamp="2026-05-20 17:16:27 +0000 UTC" firstStartedPulling="2026-05-20 17:16:28.474600807 +0000 UTC m=+800.062194924" lastFinishedPulling="2026-05-20 17:16:32.177050511 +0000 UTC m=+803.764644633" observedRunningTime="2026-05-20 17:16:32.597904535 +0000 UTC m=+804.185498674" watchObservedRunningTime="2026-05-20 17:16:32.599391082 +0000 UTC m=+804.186985221" May 20 17:16:32.623289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.623232 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" podStartSLOduration=1.573071062 podStartE2EDuration="5.623216352s" podCreationTimestamp="2026-05-20 17:16:27 +0000 UTC" firstStartedPulling="2026-05-20 17:16:28.126432813 +0000 UTC m=+799.714026930" lastFinishedPulling="2026-05-20 17:16:32.176578087 +0000 UTC m=+803.764172220" observedRunningTime="2026-05-20 17:16:32.622927816 +0000 UTC m=+804.210521957" watchObservedRunningTime="2026-05-20 17:16:32.623216352 +0000 UTC m=+804.210810492" May 20 17:16:32.814690 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.814617 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" May 20 17:16:32.894701 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.894669 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gzs4\" (UniqueName: \"kubernetes.io/projected/69a093a2-0248-4394-bf49-8f42c60ba77c-kube-api-access-4gzs4\") pod \"69a093a2-0248-4394-bf49-8f42c60ba77c\" (UID: \"69a093a2-0248-4394-bf49-8f42c60ba77c\") " May 20 17:16:32.896959 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.896932 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a093a2-0248-4394-bf49-8f42c60ba77c-kube-api-access-4gzs4" (OuterVolumeSpecName: "kube-api-access-4gzs4") pod "69a093a2-0248-4394-bf49-8f42c60ba77c" (UID: "69a093a2-0248-4394-bf49-8f42c60ba77c"). InnerVolumeSpecName "kube-api-access-4gzs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:16:32.995296 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:32.995252 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gzs4\" (UniqueName: \"kubernetes.io/projected/69a093a2-0248-4394-bf49-8f42c60ba77c-kube-api-access-4gzs4\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:16:33.571331 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.571244 2545 generic.go:358] "Generic (PLEG): container finished" podID="69a093a2-0248-4394-bf49-8f42c60ba77c" containerID="7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e" exitCode=0 May 20 17:16:33.571331 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.571310 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" May 20 17:16:33.571814 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.571334 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" event={"ID":"69a093a2-0248-4394-bf49-8f42c60ba77c","Type":"ContainerDied","Data":"7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e"} May 20 17:16:33.571814 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.571382 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-8s8p4" event={"ID":"69a093a2-0248-4394-bf49-8f42c60ba77c","Type":"ContainerDied","Data":"94c0010d209c41acbf66bfb67dcc0ec49e93bdaffefa0e9e52c16a5d797e8f32"} May 20 17:16:33.571814 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.571409 2545 scope.go:117] "RemoveContainer" containerID="7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e" May 20 17:16:33.579925 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.579910 2545 scope.go:117] "RemoveContainer" containerID="7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e" May 20 17:16:33.580170 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:16:33.580153 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e\": container with ID starting with 7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e not found: ID does not exist" containerID="7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e" May 20 17:16:33.580228 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.580177 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e"} err="failed to get container status \"7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e\": rpc error: code = NotFound desc = could not find container \"7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e\": container with ID starting with 7e7db78efea27c9635601c4f1d8e85459f704a378315d2268d748b963767aa2e not found: ID does not exist" May 20 17:16:33.587119 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.587100 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8s8p4"] May 20 17:16:33.591102 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:33.591082 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-8s8p4"] May 20 17:16:34.587758 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.587723 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6587d649f8-xf4dw"] May 20 17:16:34.588290 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.588275 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a093a2-0248-4394-bf49-8f42c60ba77c" containerName="manager" May 20 17:16:34.588353 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.588293 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a093a2-0248-4394-bf49-8f42c60ba77c" containerName="manager" May 20 17:16:34.588416 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.588405 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a093a2-0248-4394-bf49-8f42c60ba77c" containerName="manager" May 20 17:16:34.593072 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.593054 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:34.599276 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.599248 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 20 17:16:34.599276 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.599263 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ktkxb\"" May 20 17:16:34.603677 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.603656 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6587d649f8-xf4dw"] May 20 17:16:34.610350 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.610330 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r55tw\" (UniqueName: \"kubernetes.io/projected/146e5d7b-39ef-484e-b9e8-e1875543a0c4-kube-api-access-r55tw\") pod \"maas-api-6587d649f8-xf4dw\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:34.610449 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.610359 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls\") pod \"maas-api-6587d649f8-xf4dw\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:34.711645 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.711608 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r55tw\" (UniqueName: \"kubernetes.io/projected/146e5d7b-39ef-484e-b9e8-e1875543a0c4-kube-api-access-r55tw\") pod \"maas-api-6587d649f8-xf4dw\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:34.711645 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.711644 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls\") pod \"maas-api-6587d649f8-xf4dw\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:34.711889 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:16:34.711827 2545 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 20 17:16:34.711944 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:16:34.711902 2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls podName:146e5d7b-39ef-484e-b9e8-e1875543a0c4 nodeName:}" failed. No retries permitted until 2026-05-20 17:16:35.21188576 +0000 UTC m=+806.799479878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls") pod "maas-api-6587d649f8-xf4dw" (UID: "146e5d7b-39ef-484e-b9e8-e1875543a0c4") : secret "maas-api-serving-cert" not found May 20 17:16:34.723377 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.723346 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r55tw\" (UniqueName: \"kubernetes.io/projected/146e5d7b-39ef-484e-b9e8-e1875543a0c4-kube-api-access-r55tw\") pod \"maas-api-6587d649f8-xf4dw\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:34.959661 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.959624 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7fhqf"] May 20 17:16:34.963278 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.963262 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" May 20 17:16:34.965842 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.965808 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-txc6t\"" May 20 17:16:34.966119 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.966100 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 20 17:16:34.973012 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:34.972988 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7fhqf"] May 20 17:16:35.003435 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.003393 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69a093a2-0248-4394-bf49-8f42c60ba77c" path="/var/lib/kubelet/pods/69a093a2-0248-4394-bf49-8f42c60ba77c/volumes" May 20 17:16:35.013399 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.013379 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29t95\" (UniqueName: \"kubernetes.io/projected/84ddc2b0-ea56-48a6-9e62-1a4909ed36a8-kube-api-access-29t95\") pod \"payload-processing-58b6c8fdc7-7fhqf\" (UID: \"84ddc2b0-ea56-48a6-9e62-1a4909ed36a8\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" May 20 17:16:35.114355 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.114316 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29t95\" (UniqueName: \"kubernetes.io/projected/84ddc2b0-ea56-48a6-9e62-1a4909ed36a8-kube-api-access-29t95\") pod \"payload-processing-58b6c8fdc7-7fhqf\" (UID: \"84ddc2b0-ea56-48a6-9e62-1a4909ed36a8\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" May 20 17:16:35.131317 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.131290 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29t95\" (UniqueName: \"kubernetes.io/projected/84ddc2b0-ea56-48a6-9e62-1a4909ed36a8-kube-api-access-29t95\") pod \"payload-processing-58b6c8fdc7-7fhqf\" (UID: \"84ddc2b0-ea56-48a6-9e62-1a4909ed36a8\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" May 20 17:16:35.215807 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.215724 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls\") pod \"maas-api-6587d649f8-xf4dw\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:35.218197 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.218175 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls\") pod \"maas-api-6587d649f8-xf4dw\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:35.275054 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.275015 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" May 20 17:16:35.417969 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.417947 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7fhqf"] May 20 17:16:35.420142 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:16:35.420106 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ddc2b0_ea56_48a6_9e62_1a4909ed36a8.slice/crio-23bf9874c9297651a5c807f3dd4422c73ef1d22fa155427f7bffe7501edf280f WatchSource:0}: Error finding container 23bf9874c9297651a5c807f3dd4422c73ef1d22fa155427f7bffe7501edf280f: Status 404 returned error can't find the container with id 23bf9874c9297651a5c807f3dd4422c73ef1d22fa155427f7bffe7501edf280f May 20 17:16:35.504907 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.504819 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:35.582179 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.582147 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" event={"ID":"84ddc2b0-ea56-48a6-9e62-1a4909ed36a8","Type":"ContainerStarted","Data":"23bf9874c9297651a5c807f3dd4422c73ef1d22fa155427f7bffe7501edf280f"} May 20 17:16:35.639916 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:35.639887 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6587d649f8-xf4dw"] May 20 17:16:35.641704 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:16:35.641670 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146e5d7b_39ef_484e_b9e8_e1875543a0c4.slice/crio-0d05180e785e20e6539b0ce7fdccc405a7434ec7d70f691e98ba5c4a96822427 WatchSource:0}: Error finding container 0d05180e785e20e6539b0ce7fdccc405a7434ec7d70f691e98ba5c4a96822427: Status 404 returned error can't find the container with id 0d05180e785e20e6539b0ce7fdccc405a7434ec7d70f691e98ba5c4a96822427 May 20 17:16:36.587302 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:36.587268 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6587d649f8-xf4dw" event={"ID":"146e5d7b-39ef-484e-b9e8-e1875543a0c4","Type":"ContainerStarted","Data":"0d05180e785e20e6539b0ce7fdccc405a7434ec7d70f691e98ba5c4a96822427"} May 20 17:16:37.591874 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:37.591782 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" event={"ID":"84ddc2b0-ea56-48a6-9e62-1a4909ed36a8","Type":"ContainerStarted","Data":"8a5e128f56560770a2a95ed6baab1d181a603c5a7f56ac8885a9ec1f05c71b28"} May 20 17:16:37.592285 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:37.591885 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" May 20 17:16:37.593195 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:37.593171 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6587d649f8-xf4dw" event={"ID":"146e5d7b-39ef-484e-b9e8-e1875543a0c4","Type":"ContainerStarted","Data":"cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6"} May 20 17:16:37.593295 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:37.593279 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:37.610652 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:37.610608 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" podStartSLOduration=1.82465044 podStartE2EDuration="3.610595476s" podCreationTimestamp="2026-05-20 17:16:34 +0000 UTC" firstStartedPulling="2026-05-20 17:16:35.421883365 +0000 UTC m=+807.009477482" lastFinishedPulling="2026-05-20 17:16:37.207828401 +0000 UTC m=+808.795422518" observedRunningTime="2026-05-20 17:16:37.608967485 +0000 UTC m=+809.196561627" watchObservedRunningTime="2026-05-20 17:16:37.610595476 +0000 UTC m=+809.198189616" May 20 17:16:37.626778 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:37.626731 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6587d649f8-xf4dw" podStartSLOduration=2.059533542 podStartE2EDuration="3.626717403s" podCreationTimestamp="2026-05-20 17:16:34 +0000 UTC" firstStartedPulling="2026-05-20 17:16:35.643142811 +0000 UTC m=+807.230736949" lastFinishedPulling="2026-05-20 17:16:37.210326684 +0000 UTC m=+808.797920810" observedRunningTime="2026-05-20 17:16:37.623791232 +0000 UTC m=+809.211385371" watchObservedRunningTime="2026-05-20 17:16:37.626717403 +0000 UTC m=+809.214311543" May 20 17:16:43.576782 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:43.576748 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:16:43.577199 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:43.577110 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:43.601502 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:43.601475 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:16:43.628162 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:43.628127 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-zsvcg"] May 20 17:16:43.628348 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:43.628313 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" podUID="72182124-2d5d-4571-aae3-f2028d141ec1" containerName="manager" containerID="cri-o://aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31" gracePeriod=30 May 20 17:16:43.883657 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:43.883631 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:44.000506 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.000472 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpwq8\" (UniqueName: \"kubernetes.io/projected/72182124-2d5d-4571-aae3-f2028d141ec1-kube-api-access-jpwq8\") pod \"72182124-2d5d-4571-aae3-f2028d141ec1\" (UID: \"72182124-2d5d-4571-aae3-f2028d141ec1\") " May 20 17:16:44.002493 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.002462 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72182124-2d5d-4571-aae3-f2028d141ec1-kube-api-access-jpwq8" (OuterVolumeSpecName: "kube-api-access-jpwq8") pod "72182124-2d5d-4571-aae3-f2028d141ec1" (UID: "72182124-2d5d-4571-aae3-f2028d141ec1"). InnerVolumeSpecName "kube-api-access-jpwq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:16:44.101369 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.101340 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpwq8\" (UniqueName: \"kubernetes.io/projected/72182124-2d5d-4571-aae3-f2028d141ec1-kube-api-access-jpwq8\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:16:44.618102 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.618068 2545 generic.go:358] "Generic (PLEG): container finished" podID="72182124-2d5d-4571-aae3-f2028d141ec1" containerID="aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31" exitCode=0 May 20 17:16:44.618602 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.618135 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" May 20 17:16:44.618602 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.618154 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" event={"ID":"72182124-2d5d-4571-aae3-f2028d141ec1","Type":"ContainerDied","Data":"aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31"} May 20 17:16:44.618602 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.618199 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-zsvcg" event={"ID":"72182124-2d5d-4571-aae3-f2028d141ec1","Type":"ContainerDied","Data":"b84b1d943845017fc9cb1f947ce7011a647bb6d160fa2dea7bb04e73d8967b2f"} May 20 17:16:44.618602 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.618222 2545 scope.go:117] "RemoveContainer" containerID="aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31" May 20 17:16:44.626382 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.626363 2545 scope.go:117] "RemoveContainer" containerID="aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31" May 20 17:16:44.626641 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:16:44.626624 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31\": container with ID starting with aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31 not found: ID does not exist" containerID="aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31" May 20 17:16:44.626697 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.626654 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31"} err="failed to get container status \"aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31\": rpc error: code = NotFound desc = could not find container \"aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31\": container with ID starting with aa898c4e9bda1ccd5d5166e8629cc01383eb9cb14db3fa998325a4d93ec5cd31 not found: ID does not exist" May 20 17:16:44.639756 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.639735 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-zsvcg"] May 20 17:16:44.643665 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:44.643644 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-zsvcg"] May 20 17:16:45.003018 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:45.002988 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72182124-2d5d-4571-aae3-f2028d141ec1" path="/var/lib/kubelet/pods/72182124-2d5d-4571-aae3-f2028d141ec1/volumes" May 20 17:16:48.598897 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:48.598868 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fhqf" May 20 17:16:59.436454 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:59.436388 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585598586b-gfqgb"] May 20 17:16:59.437120 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:59.436697 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-585598586b-gfqgb" podUID="59da0bae-f89a-423b-8e46-73550e0f2c90" containerName="manager" containerID="cri-o://d27c2c803452178cbb128ef62fb67a7e67da00c3341389c0219bc575fa7c5591" gracePeriod=30 May 20 17:16:59.674079 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:59.674043 2545 generic.go:358] "Generic (PLEG): container finished" podID="59da0bae-f89a-423b-8e46-73550e0f2c90" containerID="d27c2c803452178cbb128ef62fb67a7e67da00c3341389c0219bc575fa7c5591" exitCode=0 May 20 17:16:59.674233 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:59.674121 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-gfqgb" event={"ID":"59da0bae-f89a-423b-8e46-73550e0f2c90","Type":"ContainerDied","Data":"d27c2c803452178cbb128ef62fb67a7e67da00c3341389c0219bc575fa7c5591"} May 20 17:16:59.695667 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:59.695606 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:16:59.849393 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:59.849364 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp76s\" (UniqueName: \"kubernetes.io/projected/59da0bae-f89a-423b-8e46-73550e0f2c90-kube-api-access-dp76s\") pod \"59da0bae-f89a-423b-8e46-73550e0f2c90\" (UID: \"59da0bae-f89a-423b-8e46-73550e0f2c90\") " May 20 17:16:59.851370 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:59.851340 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59da0bae-f89a-423b-8e46-73550e0f2c90-kube-api-access-dp76s" (OuterVolumeSpecName: "kube-api-access-dp76s") pod "59da0bae-f89a-423b-8e46-73550e0f2c90" (UID: "59da0bae-f89a-423b-8e46-73550e0f2c90"). InnerVolumeSpecName "kube-api-access-dp76s". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:16:59.950671 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:16:59.950583 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp76s\" (UniqueName: \"kubernetes.io/projected/59da0bae-f89a-423b-8e46-73550e0f2c90-kube-api-access-dp76s\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:17:00.679023 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:00.678987 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-gfqgb" event={"ID":"59da0bae-f89a-423b-8e46-73550e0f2c90","Type":"ContainerDied","Data":"5e3121672e309e700085cee313d00b44711c8a1f700a53fee8a78bb1aeb11a73"} May 20 17:17:00.679023 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:00.679017 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-gfqgb" May 20 17:17:00.679023 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:00.679033 2545 scope.go:117] "RemoveContainer" containerID="d27c2c803452178cbb128ef62fb67a7e67da00c3341389c0219bc575fa7c5591" May 20 17:17:00.702699 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:00.702667 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585598586b-gfqgb"] May 20 17:17:00.712175 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:00.712148 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-585598586b-gfqgb"] May 20 17:17:01.002854 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:01.002761 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59da0bae-f89a-423b-8e46-73550e0f2c90" path="/var/lib/kubelet/pods/59da0bae-f89a-423b-8e46-73550e0f2c90/volumes" May 20 17:17:19.635025 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.634991 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-577fcc4c6f-796c7"] May 20 17:17:19.636275 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.636247 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59da0bae-f89a-423b-8e46-73550e0f2c90" containerName="manager" May 20 17:17:19.636422 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.636409 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="59da0bae-f89a-423b-8e46-73550e0f2c90" containerName="manager" May 20 17:17:19.636558 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.636528 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72182124-2d5d-4571-aae3-f2028d141ec1" containerName="manager" May 20 17:17:19.636674 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.636661 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="72182124-2d5d-4571-aae3-f2028d141ec1" containerName="manager" May 20 17:17:19.636877 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.636862 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="59da0bae-f89a-423b-8e46-73550e0f2c90" containerName="manager" May 20 17:17:19.636999 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.636987 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="72182124-2d5d-4571-aae3-f2028d141ec1" containerName="manager" May 20 17:17:19.640686 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.640665 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:19.648863 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.648843 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-577fcc4c6f-796c7"] May 20 17:17:19.709830 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.709795 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfs9\" (UniqueName: \"kubernetes.io/projected/903b1691-918c-49d7-9969-01957e8ef888-kube-api-access-bsfs9\") pod \"maas-api-577fcc4c6f-796c7\" (UID: \"903b1691-918c-49d7-9969-01957e8ef888\") " pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:19.710005 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.709846 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903b1691-918c-49d7-9969-01957e8ef888-maas-api-tls\") pod \"maas-api-577fcc4c6f-796c7\" (UID: \"903b1691-918c-49d7-9969-01957e8ef888\") " pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:19.811011 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.810982 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfs9\" (UniqueName: \"kubernetes.io/projected/903b1691-918c-49d7-9969-01957e8ef888-kube-api-access-bsfs9\") pod \"maas-api-577fcc4c6f-796c7\" (UID: \"903b1691-918c-49d7-9969-01957e8ef888\") " pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:19.811011 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.811017 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903b1691-918c-49d7-9969-01957e8ef888-maas-api-tls\") pod \"maas-api-577fcc4c6f-796c7\" (UID: \"903b1691-918c-49d7-9969-01957e8ef888\") " pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:19.813378 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.813353 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903b1691-918c-49d7-9969-01957e8ef888-maas-api-tls\") pod \"maas-api-577fcc4c6f-796c7\" (UID: \"903b1691-918c-49d7-9969-01957e8ef888\") " pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:19.818720 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.818700 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfs9\" (UniqueName: \"kubernetes.io/projected/903b1691-918c-49d7-9969-01957e8ef888-kube-api-access-bsfs9\") pod \"maas-api-577fcc4c6f-796c7\" (UID: \"903b1691-918c-49d7-9969-01957e8ef888\") " pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:19.952179 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:19.952085 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:20.086013 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:20.085981 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-577fcc4c6f-796c7"] May 20 17:17:20.098708 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:17:20.098678 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903b1691_918c_49d7_9969_01957e8ef888.slice/crio-3d0130f5907d69e8451778f9e07c18a21654baf58a9ffac4df53f13b4edc113e WatchSource:0}: Error finding container 3d0130f5907d69e8451778f9e07c18a21654baf58a9ffac4df53f13b4edc113e: Status 404 returned error can't find the container with id 3d0130f5907d69e8451778f9e07c18a21654baf58a9ffac4df53f13b4edc113e May 20 17:17:20.755700 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:20.755660 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-577fcc4c6f-796c7" event={"ID":"903b1691-918c-49d7-9969-01957e8ef888","Type":"ContainerStarted","Data":"3d0130f5907d69e8451778f9e07c18a21654baf58a9ffac4df53f13b4edc113e"} May 20 17:17:22.763166 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:22.763130 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-577fcc4c6f-796c7" event={"ID":"903b1691-918c-49d7-9969-01957e8ef888","Type":"ContainerStarted","Data":"e9d4908b8f86cf5dc458d2c12b673bb2b07fcd9ba17eaefde01157adb1cf4e6f"} May 20 17:17:22.763607 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:22.763241 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:22.781832 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:22.781783 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-577fcc4c6f-796c7" podStartSLOduration=2.102919387 podStartE2EDuration="3.781767214s" podCreationTimestamp="2026-05-20 17:17:19 +0000 UTC" firstStartedPulling="2026-05-20 17:17:20.100001025 +0000 UTC m=+851.687595143" lastFinishedPulling="2026-05-20 17:17:21.778848853 +0000 UTC m=+853.366442970" observedRunningTime="2026-05-20 17:17:22.780357182 +0000 UTC m=+854.367951323" watchObservedRunningTime="2026-05-20 17:17:22.781767214 +0000 UTC m=+854.369361353" May 20 17:17:27.900302 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.900271 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp"] May 20 17:17:27.902716 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.902699 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:27.905004 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.904983 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 20 17:17:27.905928 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.905910 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 20 17:17:27.906107 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.906061 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 20 17:17:27.906213 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.906181 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xmbbj\"" May 20 17:17:27.921490 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.921462 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp"] May 20 17:17:27.987756 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.987727 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:27.987907 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.987786 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:27.987907 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.987818 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b46wq\" (UniqueName: \"kubernetes.io/projected/151bd11c-08de-419c-859d-d04077b4685a-kube-api-access-b46wq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:27.987907 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.987864 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/151bd11c-08de-419c-859d-d04077b4685a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:27.987907 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.987905 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:27.988081 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:27.987928 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089072 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089043 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089251 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089078 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089396 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089364 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089523 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089472 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089523 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089473 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089523 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089503 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b46wq\" (UniqueName: \"kubernetes.io/projected/151bd11c-08de-419c-859d-d04077b4685a-kube-api-access-b46wq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089523 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089509 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089790 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089637 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/151bd11c-08de-419c-859d-d04077b4685a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.089910 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.089888 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.091856 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.091835 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/151bd11c-08de-419c-859d-d04077b4685a-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.092040 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.092022 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/151bd11c-08de-419c-859d-d04077b4685a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.098733 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.098710 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b46wq\" (UniqueName: \"kubernetes.io/projected/151bd11c-08de-419c-859d-d04077b4685a-kube-api-access-b46wq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp\" (UID: \"151bd11c-08de-419c-859d-d04077b4685a\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.213469 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.213396 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:28.359471 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.359447 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp"] May 20 17:17:28.361700 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:17:28.361662 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151bd11c_08de_419c_859d_d04077b4685a.slice/crio-71fbac427e63bfa238380047eb36e29eeb488b03d11d1f0a249ddd11909cd664 WatchSource:0}: Error finding container 71fbac427e63bfa238380047eb36e29eeb488b03d11d1f0a249ddd11909cd664: Status 404 returned error can't find the container with id 71fbac427e63bfa238380047eb36e29eeb488b03d11d1f0a249ddd11909cd664 May 20 17:17:28.773225 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.773193 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-577fcc4c6f-796c7" May 20 17:17:28.785610 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.785574 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" event={"ID":"151bd11c-08de-419c-859d-d04077b4685a","Type":"ContainerStarted","Data":"71fbac427e63bfa238380047eb36e29eeb488b03d11d1f0a249ddd11909cd664"} May 20 17:17:28.832306 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.832274 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-6587d649f8-xf4dw"] May 20 17:17:28.832602 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:28.832576 2545 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-6587d649f8-xf4dw" podUID="146e5d7b-39ef-484e-b9e8-e1875543a0c4" containerName="maas-api" containerID="cri-o://cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6" gracePeriod=30 May 20 17:17:29.079555 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.079520 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:17:29.200093 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.200054 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r55tw\" (UniqueName: \"kubernetes.io/projected/146e5d7b-39ef-484e-b9e8-e1875543a0c4-kube-api-access-r55tw\") pod \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " May 20 17:17:29.200274 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.200167 2545 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls\") pod \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\" (UID: \"146e5d7b-39ef-484e-b9e8-e1875543a0c4\") " May 20 17:17:29.202405 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.202376 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146e5d7b-39ef-484e-b9e8-e1875543a0c4-kube-api-access-r55tw" (OuterVolumeSpecName: "kube-api-access-r55tw") pod "146e5d7b-39ef-484e-b9e8-e1875543a0c4" (UID: "146e5d7b-39ef-484e-b9e8-e1875543a0c4"). InnerVolumeSpecName "kube-api-access-r55tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 17:17:29.202605 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.202580 2545 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "146e5d7b-39ef-484e-b9e8-e1875543a0c4" (UID: "146e5d7b-39ef-484e-b9e8-e1875543a0c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 17:17:29.301804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.301768 2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r55tw\" (UniqueName: \"kubernetes.io/projected/146e5d7b-39ef-484e-b9e8-e1875543a0c4-kube-api-access-r55tw\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:17:29.301804 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.301804 2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/146e5d7b-39ef-484e-b9e8-e1875543a0c4-maas-api-tls\") on node \"ip-10-0-135-136.ec2.internal\" DevicePath \"\"" May 20 17:17:29.791814 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.791781 2545 generic.go:358] "Generic (PLEG): container finished" podID="146e5d7b-39ef-484e-b9e8-e1875543a0c4" containerID="cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6" exitCode=0 May 20 17:17:29.792022 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.791847 2545 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6587d649f8-xf4dw" May 20 17:17:29.792022 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.791863 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6587d649f8-xf4dw" event={"ID":"146e5d7b-39ef-484e-b9e8-e1875543a0c4","Type":"ContainerDied","Data":"cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6"} May 20 17:17:29.792022 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.791903 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6587d649f8-xf4dw" event={"ID":"146e5d7b-39ef-484e-b9e8-e1875543a0c4","Type":"ContainerDied","Data":"0d05180e785e20e6539b0ce7fdccc405a7434ec7d70f691e98ba5c4a96822427"} May 20 17:17:29.792022 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.791928 2545 scope.go:117] "RemoveContainer" containerID="cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6" May 20 17:17:29.801919 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.801899 2545 scope.go:117] "RemoveContainer" containerID="cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6" May 20 17:17:29.802167 ip-10-0-135-136 kubenswrapper[2545]: E0520 17:17:29.802142 2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6\": container with ID starting with cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6 not found: ID does not exist" containerID="cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6" May 20 17:17:29.802259 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.802181 2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6"} err="failed to get container status \"cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6\": rpc error: code = NotFound desc = could not find container \"cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6\": container with ID starting with cd55e575ade00091c9678c3645da2dbad4b017c8361e9f10c0b4e24a2e897dc6 not found: ID does not exist" May 20 17:17:29.821124 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.821094 2545 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-6587d649f8-xf4dw"] May 20 17:17:29.824136 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:29.824117 2545 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-6587d649f8-xf4dw"] May 20 17:17:31.003212 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:31.003175 2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="146e5d7b-39ef-484e-b9e8-e1875543a0c4" path="/var/lib/kubelet/pods/146e5d7b-39ef-484e-b9e8-e1875543a0c4/volumes" May 20 17:17:34.815548 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:34.815492 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" event={"ID":"151bd11c-08de-419c-859d-d04077b4685a","Type":"ContainerStarted","Data":"eadded5f23c0e7b6781476739f33f20e6c72c2bc10ba068ee27f2c434d80e638"} May 20 17:17:35.578034 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.577993 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2"] May 20 17:17:35.578711 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.578693 2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="146e5d7b-39ef-484e-b9e8-e1875543a0c4" containerName="maas-api" May 20 17:17:35.578766 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.578715 2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="146e5d7b-39ef-484e-b9e8-e1875543a0c4" containerName="maas-api" May 20 17:17:35.578836 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.578825 2545 memory_manager.go:356] "RemoveStaleState removing state" podUID="146e5d7b-39ef-484e-b9e8-e1875543a0c4" containerName="maas-api" May 20 17:17:35.581405 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.581387 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.583890 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.583870 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 20 17:17:35.589293 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.589268 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2"] May 20 17:17:35.668971 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.668931 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.668971 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.668973 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txr8b\" (UniqueName: \"kubernetes.io/projected/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-kube-api-access-txr8b\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.669196 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.669093 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.669196 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.669139 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.669196 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.669190 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.669351 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.669254 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770061 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770028 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770251 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770082 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770251 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770138 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770251 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770159 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txr8b\" (UniqueName: \"kubernetes.io/projected/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-kube-api-access-txr8b\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770251 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770230 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770460 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770257 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770529 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770500 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770695 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770669 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.770860 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.770837 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.772599 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.772579 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.773320 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.773298 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.784114 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.784080 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txr8b\" (UniqueName: \"kubernetes.io/projected/d8bfe5a7-002b-43b4-82de-ed67dd1c5be7-kube-api-access-txr8b\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2\" (UID: \"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:35.895768 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:35.895733 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:36.047021 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:36.046992 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2"] May 20 17:17:36.824725 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:36.824680 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" event={"ID":"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7","Type":"ContainerStarted","Data":"4996ef0ff700bd4ae92306c130ad89d6d9ae665b377c84c09878d33970c48455"} May 20 17:17:36.824904 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:36.824734 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" event={"ID":"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7","Type":"ContainerStarted","Data":"6e2c7d5267c588ae4336db9d3371a2bf2edf2c5c9cc0901c98b4ee80fb74379b"} May 20 17:17:40.844798 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:40.844761 2545 generic.go:358] "Generic (PLEG): container finished" podID="151bd11c-08de-419c-859d-d04077b4685a" containerID="eadded5f23c0e7b6781476739f33f20e6c72c2bc10ba068ee27f2c434d80e638" exitCode=0 May 20 17:17:40.845205 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:40.844831 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" event={"ID":"151bd11c-08de-419c-859d-d04077b4685a","Type":"ContainerDied","Data":"eadded5f23c0e7b6781476739f33f20e6c72c2bc10ba068ee27f2c434d80e638"} May 20 17:17:42.855617 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:42.855580 2545 generic.go:358] "Generic (PLEG): container finished" podID="d8bfe5a7-002b-43b4-82de-ed67dd1c5be7" containerID="4996ef0ff700bd4ae92306c130ad89d6d9ae665b377c84c09878d33970c48455" exitCode=0 May 20 17:17:42.856053 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:42.855658 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" event={"ID":"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7","Type":"ContainerDied","Data":"4996ef0ff700bd4ae92306c130ad89d6d9ae665b377c84c09878d33970c48455"} May 20 17:17:42.857314 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:42.857293 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" event={"ID":"151bd11c-08de-419c-859d-d04077b4685a","Type":"ContainerStarted","Data":"b0832aabffcdb431c6faa7b52d1804501a9fb1109f454ffdc6bd03a5dad6164b"} May 20 17:17:42.857520 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:42.857503 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:42.899221 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:42.899168 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" podStartSLOduration=2.292412906 podStartE2EDuration="15.899156847s" podCreationTimestamp="2026-05-20 17:17:27 +0000 UTC" firstStartedPulling="2026-05-20 17:17:28.364075133 +0000 UTC m=+859.951669266" lastFinishedPulling="2026-05-20 17:17:41.970819077 +0000 UTC m=+873.558413207" observedRunningTime="2026-05-20 17:17:42.896630352 +0000 UTC m=+874.484224492" watchObservedRunningTime="2026-05-20 17:17:42.899156847 +0000 UTC m=+874.486750987" May 20 17:17:43.863250 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:43.863210 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" event={"ID":"d8bfe5a7-002b-43b4-82de-ed67dd1c5be7","Type":"ContainerStarted","Data":"9027908cb9e83469f7272961b03d1813dc18f27e7c5872c7e7f6aae9372b821f"} May 20 17:17:43.863702 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:43.863578 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:17:43.883787 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:43.883737 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" podStartSLOduration=8.628812079 podStartE2EDuration="8.883723225s" podCreationTimestamp="2026-05-20 17:17:35 +0000 UTC" firstStartedPulling="2026-05-20 17:17:42.856377978 +0000 UTC m=+874.443972096" lastFinishedPulling="2026-05-20 17:17:43.111289121 +0000 UTC m=+874.698883242" observedRunningTime="2026-05-20 17:17:43.881832291 +0000 UTC m=+875.469426432" watchObservedRunningTime="2026-05-20 17:17:43.883723225 +0000 UTC m=+875.471317365" May 20 17:17:53.876711 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:53.876639 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp" May 20 17:17:54.880428 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:17:54.880394 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2" May 20 17:18:08.946433 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:18:08.946401 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:18:08.947255 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:18:08.947238 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:23:08.974416 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:23:08.974389 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:23:08.975004 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:23:08.974873 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:28:09.000756 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:28:09.000723 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:28:09.003209 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:28:09.003186 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:33:09.026846 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:33:09.026811 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:33:09.031556 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:33:09.031524 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:38:09.053400 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:38:09.053372 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:38:09.059789 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:38:09.059768 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqnwd_c7173ba0-3ad2-4b0b-84c0-1d5d726dd4ff/ovn-acl-logging/0.log" May 20 17:41:41.488312 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:41.488286 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-w7757_23b46edf-8441-4442-b253-817e7667fd9f/manager/0.log" May 20 17:41:41.612876 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:41.612851 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-577fcc4c6f-796c7_903b1691-918c-49d7-9969-01957e8ef888/maas-api/0.log" May 20 17:41:41.962111 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:41.962079 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-gmkrz_1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4/manager/2.log" May 20 17:41:42.191964 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:42.191935 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c544869d7-pncmt_cc317bba-c171-4f90-87da-b255ca3c7307/manager/0.log" May 20 17:41:43.822660 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:43.822632 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-ptjpn_bb704e90-2363-4416-b9b2-52537822acd9/manager/0.log" May 20 17:41:44.544613 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:44.544583 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-mnf49_82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad/manager/0.log" May 20 17:41:44.998084 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:44.998051 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-4fgw7_9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1/discovery/0.log" May 20 17:41:45.111971 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:45.111943 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57795f5895-4xtqt_ec0dab7c-b00f-4eab-b1cb-5265da97ec28/kube-auth-proxy/0.log" May 20 17:41:45.455938 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:45.455908 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7fhqf_84ddc2b0-ea56-48a6-9e62-1a4909ed36a8/payload-processing/0.log" May 20 17:41:45.568509 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:45.568480 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9bd656cc6-7rtjg_dd0e91cd-ff0f-457c-b590-0cfd20195080/router/0.log" May 20 17:41:45.902203 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:45.902179 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp_151bd11c-08de-419c-859d-d04077b4685a/storage-initializer/0.log" May 20 17:41:45.909787 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:45.909768 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-fjsgp_151bd11c-08de-419c-859d-d04077b4685a/main/0.log" May 20 17:41:46.020999 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:46.020973 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2_d8bfe5a7-002b-43b4-82de-ed67dd1c5be7/storage-initializer/0.log" May 20 17:41:46.028976 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:46.028956 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-57cf2_d8bfe5a7-002b-43b4-82de-ed67dd1c5be7/main/0.log" May 20 17:41:53.838871 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:53.838762 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q2qdw_9c1c8045-0277-4491-8fa4-8b74fe969a25/global-pull-secret-syncer/0.log" May 20 17:41:53.967333 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:53.967304 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ch42w_8f5be0ce-186e-4792-a6d3-fe8b1f49789f/konnectivity-agent/0.log" May 20 17:41:54.098598 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:54.098519 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-136.ec2.internal_035f728b1f1c4c1d83fcee14f6626c93/haproxy/0.log" May 20 17:41:58.209689 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:58.209658 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-ptjpn_bb704e90-2363-4416-b9b2-52537822acd9/manager/0.log" May 20 17:41:58.485679 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:58.485604 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-mnf49_82aa1985-be30-4d5b-9b0d-b92fa3fbf6ad/manager/0.log" May 20 17:41:59.953629 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:59.953574 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24320544-555f-45d6-9f6b-69a49e2ed6eb/alertmanager/0.log" May 20 17:41:59.981526 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:41:59.981502 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24320544-555f-45d6-9f6b-69a49e2ed6eb/config-reloader/0.log" May 20 17:42:00.004343 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.004322 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24320544-555f-45d6-9f6b-69a49e2ed6eb/kube-rbac-proxy-web/0.log" May 20 17:42:00.025016 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.025001 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24320544-555f-45d6-9f6b-69a49e2ed6eb/kube-rbac-proxy/0.log" May 20 17:42:00.052701 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.052684 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24320544-555f-45d6-9f6b-69a49e2ed6eb/kube-rbac-proxy-metric/0.log" May 20 17:42:00.076632 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.076604 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24320544-555f-45d6-9f6b-69a49e2ed6eb/prom-label-proxy/0.log" May 20 17:42:00.100993 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.100978 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24320544-555f-45d6-9f6b-69a49e2ed6eb/init-config-reloader/0.log" May 20 17:42:00.176996 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.176977 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rrslj_f28fd914-3db3-4f97-971c-9aeebda65314/kube-state-metrics/0.log" May 20 17:42:00.196179 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.196161 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rrslj_f28fd914-3db3-4f97-971c-9aeebda65314/kube-rbac-proxy-main/0.log" May 20 17:42:00.219367 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.219313 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-rrslj_f28fd914-3db3-4f97-971c-9aeebda65314/kube-rbac-proxy-self/0.log" May 20 17:42:00.247498 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.247476 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65f745f78b-ksfzh_f0834c75-e935-4826-83e9-e6f5cce8180c/metrics-server/0.log" May 20 17:42:00.384203 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.384178 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgx98_162e8871-064e-4c8d-ac88-8e9f05004281/node-exporter/0.log" May 20 17:42:00.402656 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.402635 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgx98_162e8871-064e-4c8d-ac88-8e9f05004281/kube-rbac-proxy/0.log" May 20 17:42:00.422236 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.422213 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgx98_162e8871-064e-4c8d-ac88-8e9f05004281/init-textfile/0.log" May 20 17:42:00.537426 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.537347 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x925f_c24d8a59-7bac-4a6c-b551-16d2797363c4/kube-rbac-proxy-main/0.log" May 20 17:42:00.567729 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.567701 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x925f_c24d8a59-7bac-4a6c-b551-16d2797363c4/kube-rbac-proxy-self/0.log" May 20 17:42:00.590083 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.590056 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-x925f_c24d8a59-7bac-4a6c-b551-16d2797363c4/openshift-state-metrics/0.log" May 20 17:42:00.877114 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.877042 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c66b7b56b-646ds_8501d0b1-9c5d-4f42-a468-0a988abc53f7/telemeter-client/0.log" May 20 17:42:00.899927 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.899898 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c66b7b56b-646ds_8501d0b1-9c5d-4f42-a468-0a988abc53f7/reload/0.log" May 20 17:42:00.920101 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.920078 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c66b7b56b-646ds_8501d0b1-9c5d-4f42-a468-0a988abc53f7/kube-rbac-proxy/0.log" May 20 17:42:00.958121 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.958089 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57cb87977f-nxpj8_55bd6a06-0acd-4884-94b3-907a83f6f5e6/thanos-query/0.log" May 20 17:42:00.979981 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:00.979947 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57cb87977f-nxpj8_55bd6a06-0acd-4884-94b3-907a83f6f5e6/kube-rbac-proxy-web/0.log" May 20 17:42:01.000685 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:01.000644 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57cb87977f-nxpj8_55bd6a06-0acd-4884-94b3-907a83f6f5e6/kube-rbac-proxy/0.log" May 20 17:42:01.021290 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:01.021269 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57cb87977f-nxpj8_55bd6a06-0acd-4884-94b3-907a83f6f5e6/prom-label-proxy/0.log" May 20 17:42:01.045254 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:01.045225 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57cb87977f-nxpj8_55bd6a06-0acd-4884-94b3-907a83f6f5e6/kube-rbac-proxy-rules/0.log" May 20 17:42:01.070754 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:01.070729 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57cb87977f-nxpj8_55bd6a06-0acd-4884-94b3-907a83f6f5e6/kube-rbac-proxy-metrics/0.log" May 20 17:42:02.344634 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.344601 2545 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m"] May 20 17:42:02.348421 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.348397 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.350859 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.350834 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wkmlc\"/\"openshift-service-ca.crt\"" May 20 17:42:02.350983 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.350835 2545 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wkmlc\"/\"kube-root-ca.crt\"" May 20 17:42:02.351084 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.351071 2545 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wkmlc\"/\"default-dockercfg-jg2mz\"" May 20 17:42:02.357475 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.357449 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m"] May 20 17:42:02.416132 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.416090 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-podres\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.416289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.416140 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-proc\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.416289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.416241 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbpbn\" (UniqueName: \"kubernetes.io/projected/ae89f908-dbe5-47ac-bb58-2521b70161dc-kube-api-access-zbpbn\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.416289 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.416277 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-lib-modules\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.416420 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.416310 2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-sys\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517400 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517352 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-sys\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517569 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517443 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-podres\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517569 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517464 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-proc\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517569 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517476 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-sys\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517569 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517532 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-proc\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517569 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517563 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbpbn\" (UniqueName: \"kubernetes.io/projected/ae89f908-dbe5-47ac-bb58-2521b70161dc-kube-api-access-zbpbn\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517786 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517598 2545 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-lib-modules\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517786 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517643 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-podres\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.517786 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.517725 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae89f908-dbe5-47ac-bb58-2521b70161dc-lib-modules\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.524526 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.524499 2545 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbpbn\" (UniqueName: \"kubernetes.io/projected/ae89f908-dbe5-47ac-bb58-2521b70161dc-kube-api-access-zbpbn\") pod \"perf-node-gather-daemonset-zd59m\" (UID: \"ae89f908-dbe5-47ac-bb58-2521b70161dc\") " pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.659821 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.659787 2545 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:02.788705 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.788676 2545 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m"] May 20 17:42:02.791552 ip-10-0-135-136 kubenswrapper[2545]: W0520 17:42:02.791508 2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podae89f908_dbe5_47ac_bb58_2521b70161dc.slice/crio-e11b1d3a4aaf62bc4b97de94d8a7b8fddda6b4fcf1c32a94566622dcb3ca6282 WatchSource:0}: Error finding container e11b1d3a4aaf62bc4b97de94d8a7b8fddda6b4fcf1c32a94566622dcb3ca6282: Status 404 returned error can't find the container with id e11b1d3a4aaf62bc4b97de94d8a7b8fddda6b4fcf1c32a94566622dcb3ca6282 May 20 17:42:02.793148 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:02.793131 2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 17:42:03.237983 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:03.237956 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d8bcb5f7c-7sdkt_b91db36e-7ba5-436a-be77-7c4cdfbf45db/console/0.log" May 20 17:42:03.252406 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:03.252375 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" event={"ID":"ae89f908-dbe5-47ac-bb58-2521b70161dc","Type":"ContainerStarted","Data":"420ab20af2ddf62ecbc8f26b1083b83191ec878fe411acfc7e9ce53ecb6828c6"} May 20 17:42:03.252586 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:03.252413 2545 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" event={"ID":"ae89f908-dbe5-47ac-bb58-2521b70161dc","Type":"ContainerStarted","Data":"e11b1d3a4aaf62bc4b97de94d8a7b8fddda6b4fcf1c32a94566622dcb3ca6282"} May 20 17:42:03.252586 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:03.252505 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:03.267947 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:03.267901 2545 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" podStartSLOduration=1.267884465 podStartE2EDuration="1.267884465s" podCreationTimestamp="2026-05-20 17:42:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 17:42:03.267011543 +0000 UTC m=+2334.854605682" watchObservedRunningTime="2026-05-20 17:42:03.267884465 +0000 UTC m=+2334.855478606" May 20 17:42:04.642406 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:04.642378 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g4lvm_0db386cd-2c26-442f-9aa1-2cf0dad4dff1/dns/0.log" May 20 17:42:04.662202 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:04.662175 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g4lvm_0db386cd-2c26-442f-9aa1-2cf0dad4dff1/kube-rbac-proxy/0.log" May 20 17:42:04.777626 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:04.777597 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tg8m9_f664acff-5fc0-45b9-ac7e-e9cc03511eda/dns-node-resolver/0.log" May 20 17:42:05.230055 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:05.230021 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-599f8769dc-tgx8b_65511292-ed53-470e-b6d8-1f63298f72b1/registry/0.log" May 20 17:42:05.271282 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:05.271258 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h62bc_94bd6556-64ba-4f32-9512-69f0b4fe607c/node-ca/0.log" May 20 17:42:06.196408 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:06.196382 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-4fgw7_9293a14a-f5d1-4a7d-95b1-4cc7b3576fb1/discovery/0.log" May 20 17:42:06.215259 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:06.215237 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57795f5895-4xtqt_ec0dab7c-b00f-4eab-b1cb-5265da97ec28/kube-auth-proxy/0.log" May 20 17:42:06.405477 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:06.405451 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7fhqf_84ddc2b0-ea56-48a6-9e62-1a4909ed36a8/payload-processing/0.log" May 20 17:42:06.427202 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:06.427181 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9bd656cc6-7rtjg_dd0e91cd-ff0f-457c-b590-0cfd20195080/router/0.log" May 20 17:42:06.988420 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:06.988394 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qzhh4_ca9f9425-4e00-4c84-b300-986da4c1af18/serve-healthcheck-canary/0.log" May 20 17:42:07.588618 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:07.588589 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hhm9b_b3225f96-c165-4e94-a04e-c240136029e5/kube-rbac-proxy/0.log" May 20 17:42:07.608677 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:07.608656 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hhm9b_b3225f96-c165-4e94-a04e-c240136029e5/exporter/0.log" May 20 17:42:07.635735 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:07.635712 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hhm9b_b3225f96-c165-4e94-a04e-c240136029e5/extractor/0.log" May 20 17:42:09.272552 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:09.272510 2545 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wkmlc/perf-node-gather-daemonset-zd59m" May 20 17:42:09.540345 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:09.540263 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-w7757_23b46edf-8441-4442-b253-817e7667fd9f/manager/0.log" May 20 17:42:09.572424 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:09.572397 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-577fcc4c6f-796c7_903b1691-918c-49d7-9969-01957e8ef888/maas-api/0.log" May 20 17:42:09.705263 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:09.705237 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-gmkrz_1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4/manager/1.log" May 20 17:42:09.715742 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:09.715717 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-gmkrz_1a4d3d9d-6c2a-4e00-a4c3-c31ff5239cd4/manager/2.log" May 20 17:42:09.779745 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:09.779716 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c544869d7-pncmt_cc317bba-c171-4f90-87da-b255ca3c7307/manager/0.log" May 20 17:42:17.075072 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.075044 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msd8z_21556815-5e21-466a-b843-8f508e891694/kube-multus-additional-cni-plugins/0.log" May 20 17:42:17.146140 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.146113 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msd8z_21556815-5e21-466a-b843-8f508e891694/egress-router-binary-copy/0.log" May 20 17:42:17.184097 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.184074 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msd8z_21556815-5e21-466a-b843-8f508e891694/cni-plugins/0.log" May 20 17:42:17.223091 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.223068 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msd8z_21556815-5e21-466a-b843-8f508e891694/bond-cni-plugin/0.log" May 20 17:42:17.265077 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.265056 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msd8z_21556815-5e21-466a-b843-8f508e891694/routeoverride-cni/0.log" May 20 17:42:17.302003 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.301985 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msd8z_21556815-5e21-466a-b843-8f508e891694/whereabouts-cni-bincopy/0.log" May 20 17:42:17.342093 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.342029 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msd8z_21556815-5e21-466a-b843-8f508e891694/whereabouts-cni/0.log" May 20 17:42:17.669925 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.669896 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w6sll_c06ebdbb-4f39-40a4-9d0b-e26a377b4cf4/kube-multus/0.log" May 20 17:42:17.818756 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.818732 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vlk94_064653ee-ac31-45f8-9a7b-1cd046e1799d/network-metrics-daemon/0.log" May 20 17:42:17.839135 ip-10-0-135-136 kubenswrapper[2545]: I0520 17:42:17.839114 2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vlk94_064653ee-ac31-45f8-9a7b-1cd046e1799d/kube-rbac-proxy/0.log"