May 26 10:07:34.565720 ip-10-0-139-163 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 26 10:07:34.565732 ip-10-0-139-163 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 26 10:07:34.565742 ip-10-0-139-163 systemd[1]: kubelet.service: Failed with result 'resources'. May 26 10:07:34.566054 ip-10-0-139-163 systemd[1]: Failed to start Kubernetes Kubelet. May 26 10:07:45.902199 ip-10-0-139-163 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 26 10:07:45.902216 ip-10-0-139-163 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2224e3918c1b488d813e21c9bfcad443 -- May 26 10:10:10.075776 ip-10-0-139-163 systemd[1]: Starting Kubernetes Kubelet... May 26 10:10:10.582927 ip-10-0-139-163 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 10:10:10.582927 ip-10-0-139-163 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 10:10:10.582927 ip-10-0-139-163 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 10:10:10.582927 ip-10-0-139-163 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 10:10:10.582927 ip-10-0-139-163 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 10:10:10.585437 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.585353 2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 10:10:10.589350 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589335 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589351 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589356 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589359 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589363 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589366 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589369 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589372 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589375 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589378 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589385 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589388 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:10.589387 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589392 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589394 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589398 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589400 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589403 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589405 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589408 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589411 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589413 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589416 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589419 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589421 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589424 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589426 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589429 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589432 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589435 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589437 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589440 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589442 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:10.589695 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589445 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589447 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589450 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589452 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589455 2557 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589458 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589460 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589465 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589469 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589472 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589475 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589477 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589480 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589482 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589485 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589489 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589491 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589494 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589496 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589499 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:10.590159 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589502 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589504 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589519 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589522 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589524 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589529 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589533 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589536 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589538 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589541 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589543 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589546 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589549 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589551 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589554 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589557 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589560 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589562 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589565 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:10.590670 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589567 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589570 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589572 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589576 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589579 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589581 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589584 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589587 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589590 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589592 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589595 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589597 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589600 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589602 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589605 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589985 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589990 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589993 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589996 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.589998 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:10.591136 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590001 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590004 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590007 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590010 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590012 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590016 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590018 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590021 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590024 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590026 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590029 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590032 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590034 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590037 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590039 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590049 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590052 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590054 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590057 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590061 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:10.591631 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590063 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590066 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590068 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590070 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590073 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590076 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590078 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590081 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590083 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590087 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590091 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590093 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590096 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590098 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590102 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590105 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590108 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590110 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590113 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:10.592160 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590116 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590120 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590123 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590127 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590129 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590132 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590135 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590138 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590140 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590151 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590154 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590157 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590160 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590164 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590167 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590169 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590172 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590175 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590177 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:10.592652 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590180 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590182 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590185 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590188 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590190 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590194 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590196 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590199 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590201 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590204 2557 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590207 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590210 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590213 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590221 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590224 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590226 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590229 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590231 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590234 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:10.593122 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590237 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590239 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590242 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.590244 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.590968 2557 flags.go:64] FLAG: --address="0.0.0.0" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.590976 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.590985 2557 flags.go:64] FLAG: --anonymous-auth="true" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591001 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591006 2557 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591009 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591013 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591017 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591020 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591023 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591027 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591031 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591034 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591038 2557 flags.go:64] FLAG: --cgroup-root="" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591040 2557 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591043 2557 flags.go:64] FLAG: --client-ca-file="" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591046 2557 flags.go:64] FLAG: --cloud-config="" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591049 2557 flags.go:64] FLAG: --cloud-provider="external" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591052 2557 flags.go:64] FLAG: --cluster-dns="[]" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591060 2557 flags.go:64] FLAG: --cluster-domain="" May 26 10:10:10.593605 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591063 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591066 2557 flags.go:64] FLAG: --config-dir="" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591069 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591073 2557 flags.go:64] FLAG: --container-log-max-files="5" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591077 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591080 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591083 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591086 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591089 2557 flags.go:64] FLAG: --contention-profiling="false" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591092 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591095 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591098 2557 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591101 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591111 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591114 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591117 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591120 2557 flags.go:64] FLAG: --enable-load-reader="false" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591123 2557 flags.go:64] FLAG: --enable-server="true" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591126 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591132 2557 flags.go:64] FLAG: --event-burst="100" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591135 2557 flags.go:64] FLAG: --event-qps="50" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591138 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591155 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591160 2557 flags.go:64] FLAG: --eviction-hard="" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591164 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 10:10:10.594188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591167 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591171 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591174 2557 flags.go:64] FLAG: --eviction-soft="" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591178 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591180 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591184 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591187 2557 flags.go:64] FLAG: --experimental-mounter-path="" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591190 2557 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591193 2557 flags.go:64] FLAG: --fail-swap-on="true" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591195 2557 flags.go:64] FLAG: --feature-gates="" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591199 2557 flags.go:64] FLAG: --file-check-frequency="20s" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591202 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591205 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591208 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591212 2557 flags.go:64] FLAG: --healthz-port="10248" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591215 2557 flags.go:64] FLAG: --help="false" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591217 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-139-163.ec2.internal" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591221 2557 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591224 2557 flags.go:64] FLAG: --http-check-frequency="20s" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591227 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591230 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591239 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591242 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 10:10:10.594883 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591245 2557 flags.go:64] FLAG: --image-service-endpoint="" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591248 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591251 2557 flags.go:64] FLAG: --kube-api-burst="100" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591253 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591256 2557 flags.go:64] FLAG: --kube-api-qps="50" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591259 2557 flags.go:64] FLAG: --kube-reserved="" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591262 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591265 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591268 2557 flags.go:64] FLAG: --kubelet-cgroups="" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591271 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591273 2557 flags.go:64] FLAG: --lock-file="" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591276 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591280 2557 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591283 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591288 2557 flags.go:64] FLAG: --log-json-split-stream="false" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591291 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591294 2557 flags.go:64] FLAG: --log-text-split-stream="false" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591297 2557 flags.go:64] FLAG: --logging-format="text" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591300 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591303 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591306 2557 flags.go:64] FLAG: --manifest-url="" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591309 2557 flags.go:64] FLAG: --manifest-url-header="" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591314 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591317 2557 flags.go:64] FLAG: --max-open-files="1000000" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591321 2557 flags.go:64] FLAG: --max-pods="110" May 26 10:10:10.595449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591324 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591327 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591330 2557 flags.go:64] FLAG: --memory-manager-policy="None" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591332 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591335 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591338 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591348 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591355 2557 flags.go:64] FLAG: --node-status-max-images="50" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591359 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591362 2557 flags.go:64] FLAG: --oom-score-adj="-999" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591365 2557 flags.go:64] FLAG: --pod-cidr="" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591368 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591373 2557 flags.go:64] FLAG: --pod-manifest-path="" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591376 2557 flags.go:64] FLAG: --pod-max-pids="-1" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591379 2557 flags.go:64] FLAG: --pods-per-core="0" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591382 2557 flags.go:64] FLAG: --port="10250" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591385 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591388 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d09824774b4ae64" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591391 2557 flags.go:64] FLAG: --qos-reserved="" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591394 2557 flags.go:64] FLAG: --read-only-port="10255" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591397 2557 flags.go:64] FLAG: --register-node="true" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591400 2557 flags.go:64] FLAG: --register-schedulable="true" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591403 2557 flags.go:64] FLAG: --register-with-taints="" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591407 2557 flags.go:64] FLAG: --registry-burst="10" May 26 10:10:10.596070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591410 2557 flags.go:64] FLAG: --registry-qps="5" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591413 2557 flags.go:64] FLAG: --reserved-cpus="" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591415 2557 flags.go:64] FLAG: --reserved-memory="" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591419 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591423 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591426 2557 flags.go:64] FLAG: --rotate-certificates="false" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591428 2557 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591431 2557 flags.go:64] FLAG: --runonce="false" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591434 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591437 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591440 2557 flags.go:64] FLAG: --seccomp-default="false" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591443 2557 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591446 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591449 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591452 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591460 2557 flags.go:64] FLAG: --storage-driver-password="root" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591463 2557 flags.go:64] FLAG: --storage-driver-secure="false" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591467 2557 flags.go:64] FLAG: --storage-driver-table="stats" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591470 2557 flags.go:64] FLAG: --storage-driver-user="root" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591473 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591476 2557 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591479 2557 flags.go:64] FLAG: --system-cgroups="" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591481 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591487 2557 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591489 2557 flags.go:64] FLAG: --tls-cert-file="" May 26 10:10:10.596671 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591492 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591499 2557 flags.go:64] FLAG: --tls-min-version="" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591502 2557 flags.go:64] FLAG: --tls-private-key-file="" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591505 2557 flags.go:64] FLAG: --topology-manager-policy="none" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591520 2557 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591523 2557 flags.go:64] FLAG: --topology-manager-scope="container" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591526 2557 flags.go:64] FLAG: --v="2" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591530 2557 flags.go:64] FLAG: --version="false" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591535 2557 flags.go:64] FLAG: --vmodule="" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591539 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.591542 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591644 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591648 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591651 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591654 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591657 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591660 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591663 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591665 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591668 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591671 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591674 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:10.597291 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591677 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591687 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591690 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591693 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591695 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591697 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591700 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591702 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591705 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591708 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591710 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591713 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591719 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591721 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591730 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591734 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591737 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591740 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591742 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:10.597852 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591745 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591748 2557 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591751 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591754 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591757 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591759 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591762 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591765 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591767 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591770 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591772 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591775 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591777 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591780 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591782 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591786 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591788 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591791 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591793 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591796 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:10.598720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591799 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591801 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591804 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591807 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591809 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591813 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591816 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591820 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591822 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591825 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591827 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591830 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591833 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591835 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591838 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591842 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591846 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591848 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591851 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591853 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:10.599623 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591856 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591859 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591861 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591864 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591866 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591869 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591872 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591874 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591878 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591880 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591883 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591885 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591888 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591891 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591893 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.591895 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:10.600356 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.592574 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 10:10:10.600964 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.600946 2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 10:10:10.601019 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.600967 2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 10:10:10.603451 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603430 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:10.603451 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603448 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:10.603451 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603454 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603459 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603463 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603473 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603477 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603481 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603485 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603490 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603494 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603498 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603502 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603521 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603527 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603531 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603535 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603543 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603547 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603554 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603560 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:10.603785 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603565 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603570 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603574 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603578 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603583 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603587 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603591 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603595 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603600 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603608 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603612 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603616 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603619 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603624 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603628 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603633 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603637 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603641 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603646 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603650 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:10.604666 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603654 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603663 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603667 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603671 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603676 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603680 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603684 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603688 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603693 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603697 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603702 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603706 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603711 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603716 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603726 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603730 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603734 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603739 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603743 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603748 2557 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:10.605273 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603753 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603758 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603762 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603767 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603772 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603777 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603785 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603790 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603795 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603800 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603804 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603809 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603814 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603818 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603822 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603829 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603835 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603840 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603844 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603853 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:10.605784 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603858 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603862 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603866 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603871 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.603875 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.603884 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604219 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604228 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604233 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604238 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604243 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604248 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604252 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604256 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604261 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:10.606340 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604265 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604274 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604279 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604284 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604289 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604294 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604298 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604302 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604307 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604311 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604316 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604320 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604324 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604329 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604337 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604341 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604346 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604350 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604355 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:10.606837 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604359 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604365 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604371 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604376 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604380 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604386 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604407 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604417 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604422 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604427 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604432 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604437 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604441 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604445 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604450 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604456 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604460 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604465 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604470 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604474 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:10.607366 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604483 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604487 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604492 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604496 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604500 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604505 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604523 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604528 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604533 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604537 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604541 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604546 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604555 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604560 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604565 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604569 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604574 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604578 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604584 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:10.608124 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604591 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604597 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604602 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604607 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604611 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604615 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604624 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604629 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604633 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604638 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604642 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604647 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604651 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604655 2557 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604660 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604664 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604668 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604672 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:10.608985 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:10.604677 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:10.609637 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.604689 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 10:10:10.609637 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.605903 2557 server.go:962] "Client rotation is on, will bootstrap in background" May 26 10:10:10.610018 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.610003 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 10:10:10.611412 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.611398 2557 server.go:1019] "Starting client certificate rotation" May 26 10:10:10.611528 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.611500 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 10:10:10.611567 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.611552 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 10:10:10.640342 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.640321 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 10:10:10.644349 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.644326 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 10:10:10.659854 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.659840 2557 log.go:25] "Validated CRI v1 runtime API" May 26 10:10:10.666346 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.666330 2557 log.go:25] "Validated CRI v1 image API" May 26 10:10:10.668547 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.668531 2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 10:10:10.670911 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.670892 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 10:10:10.671130 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.671111 2557 fs.go:135] Filesystem UUIDs: map[46b504cd-1458-4ac3-92f6-7cbe089c02a7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9e28b4dc-456d-4a75-a375-80fa00aafe68:/dev/nvme0n1p3] May 26 10:10:10.671193 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.671132 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 10:10:10.676118 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.675996 2557 manager.go:217] Machine: {Timestamp:2026-05-26 10:10:10.675523572 +0000 UTC m=+0.467951591 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097217 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20689ca1cd8269dfd49905666aa249 SystemUUID:ec20689c-a1cd-8269-dfd4-9905666aa249 BootID:2224e391-8c1b-488d-813e-21c9bfcad443 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2f:45:bd:ca:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2f:45:bd:ca:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:3b:55:ae:18:ce Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 10:10:10.677079 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.677065 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 10:10:10.677193 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.677173 2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 10:10:10.681395 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.681373 2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 10:10:10.681570 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.681405 2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 10:10:10.681617 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.681579 2557 topology_manager.go:138] "Creating topology manager with none policy" May 26 10:10:10.681617 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.681588 2557 container_manager_linux.go:306] "Creating device plugin manager" May 26 10:10:10.681617 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.681595 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 10:10:10.682532 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.682522 2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 10:10:10.684426 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.684416 2557 state_mem.go:36] "Initialized new in-memory state store" May 26 10:10:10.684579 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.684569 2557 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 10:10:10.687381 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.687371 2557 kubelet.go:491] "Attempting to sync node with API server" May 26 10:10:10.687415 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.687389 2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 10:10:10.687415 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.687401 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 10:10:10.687415 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.687410 2557 kubelet.go:397] "Adding apiserver pod source" May 26 10:10:10.687565 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.687418 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 10:10:10.689018 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.688886 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 10:10:10.690677 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.690665 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 10:10:10.694997 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.694967 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffq8c" May 26 10:10:10.695228 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.695213 2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 10:10:10.697590 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.697577 2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 10:10:10.699774 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699761 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699777 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699783 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699789 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699798 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699804 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699809 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699815 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699821 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699827 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 10:10:10.699833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699835 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 10:10:10.700084 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.699841 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 10:10:10.700816 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.700807 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 10:10:10.700816 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.700816 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 10:10:10.701773 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.701747 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 10:10:10.701885 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.701861 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 10:10:10.701967 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.701949 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ffq8c" May 26 10:10:10.704002 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.703988 2557 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 10:10:10.704081 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.704025 2557 server.go:1295] "Started kubelet" May 26 10:10:10.704141 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.704097 2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 10:10:10.704178 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.704157 2557 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 10:10:10.704334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.704312 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 10:10:10.704778 ip-10-0-139-163 systemd[1]: Started Kubernetes Kubelet. May 26 10:10:10.705657 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.705591 2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 10:10:10.707299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.707283 2557 server.go:317] "Adding debug handlers to kubelet server" May 26 10:10:10.713551 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.713535 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 10:10:10.713655 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.713594 2557 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 10:10:10.713655 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.713607 2557 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 10:10:10.713785 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.713651 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 10:10:10.713785 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.713721 2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 10:10:10.713785 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.713781 2557 reconstruct.go:97] "Volume reconstruction finished" May 26 10:10:10.713973 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.713789 2557 reconciler.go:26] "Reconciler: start to sync state" May 26 10:10:10.714466 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.714444 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:10.715679 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.715657 2557 factory.go:55] Registering systemd factory May 26 10:10:10.715758 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.715683 2557 factory.go:223] Registration of the systemd container factory successfully May 26 10:10:10.716427 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.716413 2557 factory.go:153] Registering CRI-O factory May 26 10:10:10.716554 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.716542 2557 factory.go:223] Registration of the crio container factory successfully May 26 10:10:10.716681 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.716670 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 10:10:10.716778 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.716769 2557 factory.go:103] Registering Raw factory May 26 10:10:10.716844 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.716837 2557 manager.go:1196] Started watching for new ooms in manager May 26 10:10:10.717315 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.717302 2557 manager.go:319] Starting recovery of all containers May 26 10:10:10.718482 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.718463 2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:10.720606 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.720578 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-163.ec2.internal" not found May 26 10:10:10.720700 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.720643 2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-163.ec2.internal\" not found" node="ip-10-0-139-163.ec2.internal" May 26 10:10:10.728401 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.728382 2557 manager.go:324] Recovery completed May 26 10:10:10.732873 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.732855 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:10.734575 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.734560 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:10.734636 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.734587 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:10.734636 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.734597 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:10.735053 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.735036 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 10:10:10.735053 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.735051 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 10:10:10.735144 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.735068 2557 state_mem.go:36] "Initialized new in-memory state store" May 26 10:10:10.737187 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.737173 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-163.ec2.internal" not found May 26 10:10:10.738826 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.738814 2557 policy_none.go:49] "None policy: Start" May 26 10:10:10.738866 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.738830 2557 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 10:10:10.738866 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.738841 2557 state_mem.go:35] "Initializing new in-memory state store" May 26 10:10:10.783132 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.783114 2557 manager.go:341] "Starting Device Plugin manager" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.783140 2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.783151 2557 server.go:85] "Starting device plugin registration server" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.783443 2557 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.783462 2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.783560 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.783631 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.783640 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.784087 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.784119 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:10.809335 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.794210 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-163.ec2.internal" not found May 26 10:10:10.823291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.823264 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 10:10:10.824356 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.824336 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 10:10:10.824433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.824362 2557 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 10:10:10.824433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.824377 2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 10:10:10.824433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.824384 2557 kubelet.go:2451] "Starting kubelet main sync loop" May 26 10:10:10.824433 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.824415 2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 10:10:10.827311 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.827291 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:10.884631 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.884558 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:10.885398 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.885384 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:10.885471 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.885412 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:10.885471 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.885422 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:10.885471 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.885447 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-163.ec2.internal" May 26 10:10:10.898015 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.897997 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-163.ec2.internal" May 26 10:10:10.898069 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.898022 2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-163.ec2.internal\": node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:10.916134 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.916109 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:10.925214 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.925194 2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal"] May 26 10:10:10.925266 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.925253 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:10.926126 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.926113 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:10.926203 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.926138 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:10.926203 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.926150 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:10.927109 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927096 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:10.927280 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927265 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:10.927344 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927316 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:10.927754 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927738 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:10.927834 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927768 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:10.927834 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927742 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:10.927834 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927782 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:10.927834 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927800 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:10.927834 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.927811 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:10.929097 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.929082 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" May 26 10:10:10.929146 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.929113 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:10.929745 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.929729 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:10.929837 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.929755 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:10.929837 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:10.929767 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:10.953160 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.953145 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-163.ec2.internal\" not found" node="ip-10-0-139-163.ec2.internal" May 26 10:10:10.957654 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:10.957638 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-163.ec2.internal\" not found" node="ip-10-0-139-163.ec2.internal" May 26 10:10:11.014120 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.014091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90e056ecbdcc3de424d57c18080ebb8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal\" (UID: \"90e056ecbdcc3de424d57c18080ebb8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:11.014233 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.014123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e056ecbdcc3de424d57c18080ebb8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal\" (UID: \"90e056ecbdcc3de424d57c18080ebb8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:11.014233 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.014141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/108cb111ebc940df8584a4b6713a6b98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-163.ec2.internal\" (UID: \"108cb111ebc940df8584a4b6713a6b98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" May 26 10:10:11.017167 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.017145 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.114670 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.114635 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90e056ecbdcc3de424d57c18080ebb8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal\" (UID: \"90e056ecbdcc3de424d57c18080ebb8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:11.114799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.114682 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e056ecbdcc3de424d57c18080ebb8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal\" (UID: \"90e056ecbdcc3de424d57c18080ebb8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:11.114799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.114709 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/108cb111ebc940df8584a4b6713a6b98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-163.ec2.internal\" (UID: \"108cb111ebc940df8584a4b6713a6b98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" May 26 10:10:11.114799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.114718 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90e056ecbdcc3de424d57c18080ebb8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal\" (UID: \"90e056ecbdcc3de424d57c18080ebb8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:11.114799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.114740 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/108cb111ebc940df8584a4b6713a6b98-config\") pod \"kube-apiserver-proxy-ip-10-0-139-163.ec2.internal\" (UID: \"108cb111ebc940df8584a4b6713a6b98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" May 26 10:10:11.114799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.114792 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90e056ecbdcc3de424d57c18080ebb8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal\" (UID: \"90e056ecbdcc3de424d57c18080ebb8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:11.117740 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.117725 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.218500 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.218434 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.255614 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.255582 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:11.260206 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.260188 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" May 26 10:10:11.319193 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.319169 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.419659 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.419635 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.520176 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.520109 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.611353 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.611319 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 10:10:11.611858 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.611473 2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 10:10:11.611858 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.611473 2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 10:10:11.620775 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.620749 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.704420 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.704380 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 10:05:10 +0000 UTC" deadline="2028-02-25 10:03:23.10066738 +0000 UTC" May 26 10:10:11.704420 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.704414 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15359h53m11.396256512s" May 26 10:10:11.714563 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.714540 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 10:10:11.722087 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.722067 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.732617 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.732596 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 10:10:11.757302 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.757274 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s8msq" May 26 10:10:11.764460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.764441 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s8msq" May 26 10:10:11.778530 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:11.778460 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e056ecbdcc3de424d57c18080ebb8f.slice/crio-6ab8862486da29cc04bd9490aa8b8849ddc7a8b58b4f8bc8f64d1f5a0a10bbf1 WatchSource:0}: Error finding container 6ab8862486da29cc04bd9490aa8b8849ddc7a8b58b4f8bc8f64d1f5a0a10bbf1: Status 404 returned error can't find the container with id 6ab8862486da29cc04bd9490aa8b8849ddc7a8b58b4f8bc8f64d1f5a0a10bbf1 May 26 10:10:11.778736 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:11.778716 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108cb111ebc940df8584a4b6713a6b98.slice/crio-693036f5c36098da234de4a3e156408502b8bd5b6f9ff2d47387258850befd1b WatchSource:0}: Error finding container 693036f5c36098da234de4a3e156408502b8bd5b6f9ff2d47387258850befd1b: Status 404 returned error can't find the container with id 693036f5c36098da234de4a3e156408502b8bd5b6f9ff2d47387258850befd1b May 26 10:10:11.783328 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.783314 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:10:11.822554 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.822537 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.827305 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.827264 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" event={"ID":"90e056ecbdcc3de424d57c18080ebb8f","Type":"ContainerStarted","Data":"6ab8862486da29cc04bd9490aa8b8849ddc7a8b58b4f8bc8f64d1f5a0a10bbf1"} May 26 10:10:11.828131 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.828105 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" event={"ID":"108cb111ebc940df8584a4b6713a6b98","Type":"ContainerStarted","Data":"693036f5c36098da234de4a3e156408502b8bd5b6f9ff2d47387258850befd1b"} May 26 10:10:11.923595 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:11.923565 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-163.ec2.internal\" not found" May 26 10:10:11.944161 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.944140 2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:11.958309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:11.958286 2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:12.014481 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.014458 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" May 26 10:10:12.025470 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.025452 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 10:10:12.026676 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.026663 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" May 26 10:10:12.035955 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.035907 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 10:10:12.688570 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.688538 2557 apiserver.go:52] "Watching apiserver" May 26 10:10:12.700150 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.700123 2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 10:10:12.700501 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.700474 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-p9dlg","openshift-ovn-kubernetes/ovnkube-node-tdnl7","kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jzrn9","openshift-dns/node-resolver-x9rzz","openshift-image-registry/node-ca-786bz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal","openshift-multus/multus-27ld5","openshift-multus/multus-additional-cni-plugins-4j8bf","openshift-network-diagnostics/network-check-target-7hhkd","kube-system/konnectivity-agent-w62wm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx","openshift-multus/network-metrics-daemon-6dwkx"] May 26 10:10:12.705131 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.705105 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:12.705228 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:12.705185 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:12.706961 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.706939 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.709128 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.709106 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.709524 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.709495 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 10:10:12.709668 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.709612 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:12.709668 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.709663 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d6bpz\"" May 26 10:10:12.711161 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.711141 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.711656 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.711296 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-27ld5" May 26 10:10:12.711656 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.711318 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 10:10:12.711656 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.711423 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x6v6q\"" May 26 10:10:12.712085 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.712063 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 10:10:12.713391 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.713302 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 10:10:12.713391 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.713351 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.713557 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.713389 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 10:10:12.714175 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.713953 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 10:10:12.714175 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.714008 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 10:10:12.714677 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.714215 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 10:10:12.714677 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.714226 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xlthj\"" May 26 10:10:12.714677 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.714658 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 10:10:12.714887 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.714847 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 10:10:12.715044 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.715028 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kczdw\"" May 26 10:10:12.715502 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.715486 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.715650 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.715631 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 10:10:12.715735 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.715686 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 10:10:12.715977 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.715959 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6kjfx\"" May 26 10:10:12.717667 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.717649 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:12.717759 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.717731 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:12.718060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.718040 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 10:10:12.718168 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.718147 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 10:10:12.718283 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.718264 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t4gn9\"" May 26 10:10:12.720105 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.719996 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.720105 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.720085 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 10:10:12.720259 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.720111 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 10:10:12.720259 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.720168 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9v8jf\"" May 26 10:10:12.722287 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.722263 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:12.722382 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:12.722367 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:12.722895 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.722664 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 10:10:12.722895 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.722775 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 10:10:12.722895 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.722813 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 10:10:12.723228 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723207 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-conf-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.723306 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723243 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94e8656c-2263-4c65-9a3b-bd7bb835aefc-hosts-file\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.723306 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723274 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7566j\" (UniqueName: \"kubernetes.io/projected/94e8656c-2263-4c65-9a3b-bd7bb835aefc-kube-api-access-7566j\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.723411 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723305 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sc98\" (UniqueName: \"kubernetes.io/projected/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-kube-api-access-6sc98\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.723411 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723331 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82f439a-58a5-48db-856f-8150133b761c-cni-binary-copy\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.723411 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723356 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-cni-bin\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.723411 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723383 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-hostroot\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.723411 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723404 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8hb29\"" May 26 10:10:12.723659 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723408 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qknc5\" (UniqueName: \"kubernetes.io/projected/a82f439a-58a5-48db-856f-8150133b761c-kube-api-access-qknc5\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.723659 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723542 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ebe4a14-9e33-48c9-ba1c-7614570d4100-iptables-alerter-script\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.723659 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723577 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-cnibin\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.723659 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723644 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysconfig\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.723818 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-run\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.723818 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723744 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-socket-dir-parent\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.723818 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723776 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a82f439a-58a5-48db-856f-8150133b761c-multus-daemon-config\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.723818 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723813 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.723971 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723846 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysctl-d\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.723971 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysctl-conf\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.723971 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-systemd\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.723971 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723934 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-var-lib-kubelet\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.723971 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-os-release\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724168 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.723980 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-cni-multus\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724168 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724023 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.724168 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-kubernetes\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.724168 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724086 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-host\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.724168 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57adbec3-592d-4976-adfb-2fee89eee87f-host\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.724168 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-modprobe-d\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.724168 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724161 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-tmp\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.724436 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-system-cni-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724436 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724222 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-cnibin\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724436 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724253 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-kubelet\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724436 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724276 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ebe4a14-9e33-48c9-ba1c-7614570d4100-host-slash\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.724436 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:12.724436 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-tuned\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.724728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57adbec3-592d-4976-adfb-2fee89eee87f-serviceca\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.724728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-k8s-cni-cncf-io\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724487 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-netns\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724542 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6t2\" (UniqueName: \"kubernetes.io/projected/4ebe4a14-9e33-48c9-ba1c-7614570d4100-kube-api-access-mt6t2\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.724728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724567 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e8656c-2263-4c65-9a3b-bd7bb835aefc-tmp-dir\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.724728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724666 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-os-release\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.724977 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724803 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-cni-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724977 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-multus-certs\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724977 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-etc-kubernetes\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.724977 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.724919 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-system-cni-dir\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.725129 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.725020 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.725129 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.725026 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.725129 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.725060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.725129 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.725102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrbr\" (UniqueName: \"kubernetes.io/projected/12df8fdf-4e67-454b-9504-8037dd08195c-kube-api-access-lqrbr\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.725285 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.725179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-sys\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.725285 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.725219 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-lib-modules\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.726522 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.726044 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5vcg\" (UniqueName: \"kubernetes.io/projected/57adbec3-592d-4976-adfb-2fee89eee87f-kube-api-access-w5vcg\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.727701 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.727681 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-clwlh\"" May 26 10:10:12.728176 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.728125 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 10:10:12.728983 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.728961 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 10:10:12.729267 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.729250 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 10:10:12.729464 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.729447 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 10:10:12.729552 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.729490 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 10:10:12.729657 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.729639 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 10:10:12.765340 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.765309 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 10:05:11 +0000 UTC" deadline="2027-10-20 03:39:17.224811559 +0000 UTC" May 26 10:10:12.765340 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.765331 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12281h29m4.459482329s" May 26 10:10:12.814457 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.814420 2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 10:10:12.826464 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826434 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-sys\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.826609 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826473 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7566j\" (UniqueName: \"kubernetes.io/projected/94e8656c-2263-4c65-9a3b-bd7bb835aefc-kube-api-access-7566j\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.826609 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826505 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g56sj\" (UniqueName: \"kubernetes.io/projected/58e03672-af2a-4586-a12e-8648d2932bec-kube-api-access-g56sj\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.826609 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826550 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-sys\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.826609 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826569 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sc98\" (UniqueName: \"kubernetes.io/projected/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-kube-api-access-6sc98\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.826609 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826605 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82f439a-58a5-48db-856f-8150133b761c-cni-binary-copy\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826625 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-cni-bin\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826640 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qknc5\" (UniqueName: \"kubernetes.io/projected/a82f439a-58a5-48db-856f-8150133b761c-kube-api-access-qknc5\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826658 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-cnibin\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826684 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-ovn\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826708 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-socket-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-registration-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826765 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysconfig\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826777 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-cnibin\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826789 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-systemd-units\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.826842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-systemd\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-node-log\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826882 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-cni-bin\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826896 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-env-overrides\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826914 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysconfig\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.826958 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysctl-d\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827025 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-systemd\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827049 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-var-lib-kubelet\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827075 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-os-release\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827097 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-cni-multus\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827120 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57adbec3-592d-4976-adfb-2fee89eee87f-host\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827147 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-modprobe-d\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827208 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-system-cni-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827227 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-os-release\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827234 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ebe4a14-9e33-48c9-ba1c-7614570d4100-host-slash\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827274 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ebe4a14-9e33-48c9-ba1c-7614570d4100-host-slash\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827293 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:12.827309 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827312 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82f439a-58a5-48db-856f-8150133b761c-cni-binary-copy\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827356 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57adbec3-592d-4976-adfb-2fee89eee87f-host\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827320 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-cni-multus\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827420 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e8656c-2263-4c65-9a3b-bd7bb835aefc-tmp-dir\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827442 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-systemd\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827452 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-595dc\" (UniqueName: \"kubernetes.io/projected/c7f27adb-4e8c-4841-9ac8-6ece585e515b-kube-api-access-595dc\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827499 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-tuned\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-system-cni-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827541 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57adbec3-592d-4976-adfb-2fee89eee87f-serviceca\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827564 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-var-lib-kubelet\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827575 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-k8s-cni-cncf-io\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827467 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-modprobe-d\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-k8s-cni-cncf-io\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827641 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysctl-d\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827702 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827793 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94e8656c-2263-4c65-9a3b-bd7bb835aefc-tmp-dir\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-run-netns\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-cni-bin\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.828060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.827985 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-cni-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828008 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57adbec3-592d-4976-adfb-2fee89eee87f-serviceca\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828025 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-multus-certs\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828073 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-etc-kubernetes\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828080 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-cni-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828075 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-multus-certs\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828123 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-system-cni-dir\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828143 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-etc-kubernetes\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828175 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-system-cni-dir\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl86l\" (UniqueName: \"kubernetes.io/projected/9ebc88d7-bb80-4c64-b239-c1635d55af86-kube-api-access-tl86l\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828215 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/971ff43f-544e-45eb-90d6-63bc0d27c329-konnectivity-ca\") pod \"konnectivity-agent-w62wm\" (UID: \"971ff43f-544e-45eb-90d6-63bc0d27c329\") " pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828240 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-lib-modules\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828269 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5vcg\" (UniqueName: \"kubernetes.io/projected/57adbec3-592d-4976-adfb-2fee89eee87f-kube-api-access-w5vcg\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828260 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828359 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828403 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-conf-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.828848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828434 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94e8656c-2263-4c65-9a3b-bd7bb835aefc-hosts-file\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828463 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-var-lib-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828449 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-lib-modules\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovnkube-script-lib\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828535 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-hostroot\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828537 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94e8656c-2263-4c65-9a3b-bd7bb835aefc-hosts-file\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828561 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ebe4a14-9e33-48c9-ba1c-7614570d4100-iptables-alerter-script\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828586 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-cni-netd\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828580 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-conf-dir\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-sys-fs\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828627 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-hostroot\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828642 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-run\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828675 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-socket-dir-parent\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828706 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a82f439a-58a5-48db-856f-8150133b761c-multus-daemon-config\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828726 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-multus-socket-dir-parent\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828760 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828878 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-run\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.829460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828928 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-kubelet\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.828973 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovnkube-config\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829018 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/971ff43f-544e-45eb-90d6-63bc0d27c329-agent-certs\") pod \"konnectivity-agent-w62wm\" (UID: \"971ff43f-544e-45eb-90d6-63bc0d27c329\") " pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829087 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysctl-conf\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829116 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ebe4a14-9e33-48c9-ba1c-7614570d4100-iptables-alerter-script\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829127 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829183 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829208 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-kubernetes\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829223 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-host\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829227 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a82f439a-58a5-48db-856f-8150133b761c-multus-daemon-config\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829238 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-slash\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829272 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829271 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829283 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-sysctl-conf\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829303 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-tmp\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829330 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-kubernetes\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.830113 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829372 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-host\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829405 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-cnibin\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829449 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-kubelet\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829526 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-cnibin\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829574 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-var-lib-kubelet\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829632 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-netns\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829677 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a82f439a-58a5-48db-856f-8150133b761c-host-run-netns\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829683 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6t2\" (UniqueName: \"kubernetes.io/projected/4ebe4a14-9e33-48c9-ba1c-7614570d4100-kube-api-access-mt6t2\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829731 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-os-release\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829760 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-etc-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829775 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-os-release\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829799 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-log-socket\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829825 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovn-node-metrics-cert\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829862 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-device-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829888 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829919 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrbr\" (UniqueName: \"kubernetes.io/projected/12df8fdf-4e67-454b-9504-8037dd08195c-kube-api-access-lqrbr\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.830861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.829951 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-run-ovn-kubernetes\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.831632 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.830082 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12df8fdf-4e67-454b-9504-8037dd08195c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.831632 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.830372 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12df8fdf-4e67-454b-9504-8037dd08195c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.832326 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.832225 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-tmp\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.832400 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.832271 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-etc-tuned\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.833120 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:12.833095 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:12.833228 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:12.833131 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:12.833228 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:12.833148 2557 projected.go:194] Error preparing data for projected volume kube-api-access-6x2jg for pod openshift-network-diagnostics/network-check-target-7hhkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:12.833326 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:12.833231 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg podName:34fdc0ba-75ea-482b-98db-b28f7fe8da0d nodeName:}" failed. No retries permitted until 2026-05-26 10:10:13.333199822 +0000 UTC m=+3.125627824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6x2jg" (UniqueName: "kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg") pod "network-check-target-7hhkd" (UID: "34fdc0ba-75ea-482b-98db-b28f7fe8da0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:12.834872 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.834852 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qknc5\" (UniqueName: \"kubernetes.io/projected/a82f439a-58a5-48db-856f-8150133b761c-kube-api-access-qknc5\") pod \"multus-27ld5\" (UID: \"a82f439a-58a5-48db-856f-8150133b761c\") " pod="openshift-multus/multus-27ld5" May 26 10:10:12.835485 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.835334 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sc98\" (UniqueName: \"kubernetes.io/projected/b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11-kube-api-access-6sc98\") pod \"tuned-jzrn9\" (UID: \"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11\") " pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:12.835704 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.835680 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7566j\" (UniqueName: \"kubernetes.io/projected/94e8656c-2263-4c65-9a3b-bd7bb835aefc-kube-api-access-7566j\") pod \"node-resolver-x9rzz\" (UID: \"94e8656c-2263-4c65-9a3b-bd7bb835aefc\") " pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:12.836348 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.836316 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5vcg\" (UniqueName: \"kubernetes.io/projected/57adbec3-592d-4976-adfb-2fee89eee87f-kube-api-access-w5vcg\") pod \"node-ca-786bz\" (UID: \"57adbec3-592d-4976-adfb-2fee89eee87f\") " pod="openshift-image-registry/node-ca-786bz" May 26 10:10:12.837297 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.837281 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrbr\" (UniqueName: \"kubernetes.io/projected/12df8fdf-4e67-454b-9504-8037dd08195c-kube-api-access-lqrbr\") pod \"multus-additional-cni-plugins-4j8bf\" (UID: \"12df8fdf-4e67-454b-9504-8037dd08195c\") " pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:12.837729 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.837713 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6t2\" (UniqueName: \"kubernetes.io/projected/4ebe4a14-9e33-48c9-ba1c-7614570d4100-kube-api-access-mt6t2\") pod \"iptables-alerter-p9dlg\" (UID: \"4ebe4a14-9e33-48c9-ba1c-7614570d4100\") " pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:12.930662 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930629 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-run-ovn-kubernetes\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.930662 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930665 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g56sj\" (UniqueName: \"kubernetes.io/projected/58e03672-af2a-4586-a12e-8648d2932bec-kube-api-access-g56sj\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930692 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-ovn\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930720 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-socket-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930728 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-run-ovn-kubernetes\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930744 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-registration-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930771 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-systemd-units\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930781 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-ovn\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930798 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-systemd\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930822 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-node-log\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930824 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-systemd-units\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.930855 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930846 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-env-overrides\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930853 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-registration-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930868 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-socket-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930866 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-systemd\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930903 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-595dc\" (UniqueName: \"kubernetes.io/projected/c7f27adb-4e8c-4841-9ac8-6ece585e515b-kube-api-access-595dc\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930933 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-run-netns\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930930 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-node-log\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930951 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-cni-bin\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930979 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.930979 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-run-netns\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931000 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-cni-bin\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931008 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl86l\" (UniqueName: \"kubernetes.io/projected/9ebc88d7-bb80-4c64-b239-c1635d55af86-kube-api-access-tl86l\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931038 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/971ff43f-544e-45eb-90d6-63bc0d27c329-konnectivity-ca\") pod \"konnectivity-agent-w62wm\" (UID: \"971ff43f-544e-45eb-90d6-63bc0d27c329\") " pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931057 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-var-lib-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931072 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovnkube-script-lib\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931035 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931099 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-cni-netd\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931312 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931123 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-sys-fs\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931139 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-var-lib-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931153 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-kubelet\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931177 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovnkube-config\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931185 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-cni-netd\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931209 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/971ff43f-544e-45eb-90d6-63bc0d27c329-agent-certs\") pod \"konnectivity-agent-w62wm\" (UID: \"971ff43f-544e-45eb-90d6-63bc0d27c329\") " pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931235 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931241 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-sys-fs\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931244 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-env-overrides\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931259 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931286 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-slash\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931291 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-kubelet\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931312 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931339 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931362 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-etc-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-host-slash\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:12.931380 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931409 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-etc-selinux\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.931954 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-etc-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931441 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931445 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-log-socket\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931458 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-run-openvswitch\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931382 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ebc88d7-bb80-4c64-b239-c1635d55af86-log-socket\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:12.931477 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs podName:c7f27adb-4e8c-4841-9ac8-6ece585e515b nodeName:}" failed. No retries permitted until 2026-05-26 10:10:13.431458016 +0000 UTC m=+3.223886023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs") pod "network-metrics-daemon-6dwkx" (UID: "c7f27adb-4e8c-4841-9ac8-6ece585e515b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931552 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/971ff43f-544e-45eb-90d6-63bc0d27c329-konnectivity-ca\") pod \"konnectivity-agent-w62wm\" (UID: \"971ff43f-544e-45eb-90d6-63bc0d27c329\") " pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931565 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovn-node-metrics-cert\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931594 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-device-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931629 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovnkube-script-lib\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931662 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58e03672-af2a-4586-a12e-8648d2932bec-device-dir\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.932578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.931817 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovnkube-config\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.933559 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.933541 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/971ff43f-544e-45eb-90d6-63bc0d27c329-agent-certs\") pod \"konnectivity-agent-w62wm\" (UID: \"971ff43f-544e-45eb-90d6-63bc0d27c329\") " pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:12.933772 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.933753 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ebc88d7-bb80-4c64-b239-c1635d55af86-ovn-node-metrics-cert\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.939260 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.939166 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g56sj\" (UniqueName: \"kubernetes.io/projected/58e03672-af2a-4586-a12e-8648d2932bec-kube-api-access-g56sj\") pod \"aws-ebs-csi-driver-node-ccgrx\" (UID: \"58e03672-af2a-4586-a12e-8648d2932bec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:12.940861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.940837 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl86l\" (UniqueName: \"kubernetes.io/projected/9ebc88d7-bb80-4c64-b239-c1635d55af86-kube-api-access-tl86l\") pod \"ovnkube-node-tdnl7\" (UID: \"9ebc88d7-bb80-4c64-b239-c1635d55af86\") " pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:12.941775 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:12.941758 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-595dc\" (UniqueName: \"kubernetes.io/projected/c7f27adb-4e8c-4841-9ac8-6ece585e515b-kube-api-access-595dc\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:13.005613 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.005586 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:13.013350 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.013326 2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:13.018530 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.018500 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" May 26 10:10:13.027188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.027162 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x9rzz" May 26 10:10:13.038963 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.038944 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-786bz" May 26 10:10:13.043041 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.043025 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-27ld5" May 26 10:10:13.050596 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.050579 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" May 26 10:10:13.059129 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.059110 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p9dlg" May 26 10:10:13.066673 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.066657 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:13.074139 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.074120 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" May 26 10:10:13.080706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.080688 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:13.333690 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.333625 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:13.333802 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:13.333784 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:13.333843 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:13.333803 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:13.333843 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:13.333812 2557 projected.go:194] Error preparing data for projected volume kube-api-access-6x2jg for pod openshift-network-diagnostics/network-check-target-7hhkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:13.333901 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:13.333864 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg podName:34fdc0ba-75ea-482b-98db-b28f7fe8da0d nodeName:}" failed. No retries permitted until 2026-05-26 10:10:14.3338494 +0000 UTC m=+4.126277389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x2jg" (UniqueName: "kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg") pod "network-check-target-7hhkd" (UID: "34fdc0ba-75ea-482b-98db-b28f7fe8da0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:13.387922 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.387891 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82f439a_58a5_48db_856f_8150133b761c.slice/crio-a2f4a997497aa1cb24da5b91566a5eb414dfa608ce8b3083e902ca7cf6379c3d WatchSource:0}: Error finding container a2f4a997497aa1cb24da5b91566a5eb414dfa608ce8b3083e902ca7cf6379c3d: Status 404 returned error can't find the container with id a2f4a997497aa1cb24da5b91566a5eb414dfa608ce8b3083e902ca7cf6379c3d May 26 10:10:13.390950 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.390896 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ebc88d7_bb80_4c64_b239_c1635d55af86.slice/crio-c06b1e4a827b4f5fdce40affc392c217ad0b9f1a28fe43c5d7f16c38c9c786c8 WatchSource:0}: Error finding container c06b1e4a827b4f5fdce40affc392c217ad0b9f1a28fe43c5d7f16c38c9c786c8: Status 404 returned error can't find the container with id c06b1e4a827b4f5fdce40affc392c217ad0b9f1a28fe43c5d7f16c38c9c786c8 May 26 10:10:13.392465 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.392384 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1cdeaf3_39f0_4f4b_ba8f_f947d33c8b11.slice/crio-67f320e579619ecdae8d45dfb5e59af6c1be7088faf798933d5c2ac612784cf6 WatchSource:0}: Error finding container 67f320e579619ecdae8d45dfb5e59af6c1be7088faf798933d5c2ac612784cf6: Status 404 returned error can't find the container with id 67f320e579619ecdae8d45dfb5e59af6c1be7088faf798933d5c2ac612784cf6 May 26 10:10:13.394424 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.394390 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971ff43f_544e_45eb_90d6_63bc0d27c329.slice/crio-48c69a48b8bec277f6763d5bdc9a0cd566bf4e64895c890e0df5ecbc75b982ad WatchSource:0}: Error finding container 48c69a48b8bec277f6763d5bdc9a0cd566bf4e64895c890e0df5ecbc75b982ad: Status 404 returned error can't find the container with id 48c69a48b8bec277f6763d5bdc9a0cd566bf4e64895c890e0df5ecbc75b982ad May 26 10:10:13.394701 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.394676 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e03672_af2a_4586_a12e_8648d2932bec.slice/crio-ca40a3772a03783f972b9dd571b68f6c0f255a21176533706827fdd44d97b794 WatchSource:0}: Error finding container ca40a3772a03783f972b9dd571b68f6c0f255a21176533706827fdd44d97b794: Status 404 returned error can't find the container with id ca40a3772a03783f972b9dd571b68f6c0f255a21176533706827fdd44d97b794 May 26 10:10:13.395704 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.395680 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e8656c_2263_4c65_9a3b_bd7bb835aefc.slice/crio-8a4fb7493c1232cd06dab356abe28e91c4927996ae1fa9db9ad14810e4b68e4c WatchSource:0}: Error finding container 8a4fb7493c1232cd06dab356abe28e91c4927996ae1fa9db9ad14810e4b68e4c: Status 404 returned error can't find the container with id 8a4fb7493c1232cd06dab356abe28e91c4927996ae1fa9db9ad14810e4b68e4c May 26 10:10:13.396072 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.396053 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57adbec3_592d_4976_adfb_2fee89eee87f.slice/crio-8fe02f993c958ae10efd11e241ac661072ad4150eb86304e29faaf7c70301afa WatchSource:0}: Error finding container 8fe02f993c958ae10efd11e241ac661072ad4150eb86304e29faaf7c70301afa: Status 404 returned error can't find the container with id 8fe02f993c958ae10efd11e241ac661072ad4150eb86304e29faaf7c70301afa May 26 10:10:13.397890 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.397603 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebe4a14_9e33_48c9_ba1c_7614570d4100.slice/crio-f00bec20af5eeeb8b9f7500a22c934b37d4e50509fdfbf9c5bbec381ebf58eea WatchSource:0}: Error finding container f00bec20af5eeeb8b9f7500a22c934b37d4e50509fdfbf9c5bbec381ebf58eea: Status 404 returned error can't find the container with id f00bec20af5eeeb8b9f7500a22c934b37d4e50509fdfbf9c5bbec381ebf58eea May 26 10:10:13.398807 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:13.398615 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12df8fdf_4e67_454b_9504_8037dd08195c.slice/crio-cdea37cf93ed394f8274584b0b015be78b18807849a29377ff4c25a0a5087a6f WatchSource:0}: Error finding container cdea37cf93ed394f8274584b0b015be78b18807849a29377ff4c25a0a5087a6f: Status 404 returned error can't find the container with id cdea37cf93ed394f8274584b0b015be78b18807849a29377ff4c25a0a5087a6f May 26 10:10:13.434524 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.434492 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:13.434630 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:13.434614 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:13.434675 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:13.434666 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs podName:c7f27adb-4e8c-4841-9ac8-6ece585e515b nodeName:}" failed. No retries permitted until 2026-05-26 10:10:14.434653176 +0000 UTC m=+4.227081165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs") pod "network-metrics-daemon-6dwkx" (UID: "c7f27adb-4e8c-4841-9ac8-6ece585e515b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:13.766153 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.766089 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 10:05:11 +0000 UTC" deadline="2027-12-02 06:43:31.136019846 +0000 UTC" May 26 10:10:13.766153 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.766124 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13316h33m17.369901195s" May 26 10:10:13.825664 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.825250 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:13.825664 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:13.825369 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:13.840326 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.839638 2557 generic.go:358] "Generic (PLEG): container finished" podID="90e056ecbdcc3de424d57c18080ebb8f" containerID="ded6b6bffd54f55244ee2e4594c6fc5d30be2839d62eaebeb1e3d57833048dff" exitCode=0 May 26 10:10:13.840326 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.839714 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" event={"ID":"90e056ecbdcc3de424d57c18080ebb8f","Type":"ContainerDied","Data":"ded6b6bffd54f55244ee2e4594c6fc5d30be2839d62eaebeb1e3d57833048dff"} May 26 10:10:13.847560 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.847489 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" event={"ID":"108cb111ebc940df8584a4b6713a6b98","Type":"ContainerStarted","Data":"b180f84a8bfc52ce8b53a00aef872d69fe160490a08a5b07e1a30f17be7cee41"} May 26 10:10:13.857650 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.857603 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-786bz" event={"ID":"57adbec3-592d-4976-adfb-2fee89eee87f","Type":"ContainerStarted","Data":"8fe02f993c958ae10efd11e241ac661072ad4150eb86304e29faaf7c70301afa"} May 26 10:10:13.865062 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.865030 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" event={"ID":"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11","Type":"ContainerStarted","Data":"67f320e579619ecdae8d45dfb5e59af6c1be7088faf798933d5c2ac612784cf6"} May 26 10:10:13.871212 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.871051 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"c06b1e4a827b4f5fdce40affc392c217ad0b9f1a28fe43c5d7f16c38c9c786c8"} May 26 10:10:13.876412 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.876380 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerStarted","Data":"cdea37cf93ed394f8274584b0b015be78b18807849a29377ff4c25a0a5087a6f"} May 26 10:10:13.880586 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.880541 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-163.ec2.internal" podStartSLOduration=1.880527339 podStartE2EDuration="1.880527339s" podCreationTimestamp="2026-05-26 10:10:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:10:13.879655662 +0000 UTC m=+3.672083674" watchObservedRunningTime="2026-05-26 10:10:13.880527339 +0000 UTC m=+3.672955348" May 26 10:10:13.888424 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.888398 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p9dlg" event={"ID":"4ebe4a14-9e33-48c9-ba1c-7614570d4100","Type":"ContainerStarted","Data":"f00bec20af5eeeb8b9f7500a22c934b37d4e50509fdfbf9c5bbec381ebf58eea"} May 26 10:10:13.898363 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.898306 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x9rzz" event={"ID":"94e8656c-2263-4c65-9a3b-bd7bb835aefc","Type":"ContainerStarted","Data":"8a4fb7493c1232cd06dab356abe28e91c4927996ae1fa9db9ad14810e4b68e4c"} May 26 10:10:13.912819 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.912766 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" event={"ID":"58e03672-af2a-4586-a12e-8648d2932bec","Type":"ContainerStarted","Data":"ca40a3772a03783f972b9dd571b68f6c0f255a21176533706827fdd44d97b794"} May 26 10:10:13.914882 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.914815 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w62wm" event={"ID":"971ff43f-544e-45eb-90d6-63bc0d27c329","Type":"ContainerStarted","Data":"48c69a48b8bec277f6763d5bdc9a0cd566bf4e64895c890e0df5ecbc75b982ad"} May 26 10:10:13.918286 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:13.918263 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-27ld5" event={"ID":"a82f439a-58a5-48db-856f-8150133b761c","Type":"ContainerStarted","Data":"a2f4a997497aa1cb24da5b91566a5eb414dfa608ce8b3083e902ca7cf6379c3d"} May 26 10:10:14.343219 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:14.343084 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:14.343373 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:14.343257 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:14.343373 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:14.343279 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:14.343373 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:14.343291 2557 projected.go:194] Error preparing data for projected volume kube-api-access-6x2jg for pod openshift-network-diagnostics/network-check-target-7hhkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:14.343373 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:14.343350 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg podName:34fdc0ba-75ea-482b-98db-b28f7fe8da0d nodeName:}" failed. No retries permitted until 2026-05-26 10:10:16.343332619 +0000 UTC m=+6.135760611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x2jg" (UniqueName: "kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg") pod "network-check-target-7hhkd" (UID: "34fdc0ba-75ea-482b-98db-b28f7fe8da0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:14.444929 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:14.444246 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:14.444929 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:14.444404 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:14.444929 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:14.444464 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs podName:c7f27adb-4e8c-4841-9ac8-6ece585e515b nodeName:}" failed. No retries permitted until 2026-05-26 10:10:16.444444671 +0000 UTC m=+6.236872677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs") pod "network-metrics-daemon-6dwkx" (UID: "c7f27adb-4e8c-4841-9ac8-6ece585e515b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:14.825629 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:14.825557 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:14.826183 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:14.825686 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:14.939434 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:14.939315 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" event={"ID":"90e056ecbdcc3de424d57c18080ebb8f","Type":"ContainerStarted","Data":"3e59c6989ce45fe3c3a01e115911d3e097b5d254f69584f8441e7175224436ce"} May 26 10:10:15.824805 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:15.824769 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:15.825071 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:15.824910 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:16.359068 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.359015 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:16.359540 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.359188 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:16.359540 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.359208 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:16.359540 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.359222 2557 projected.go:194] Error preparing data for projected volume kube-api-access-6x2jg for pod openshift-network-diagnostics/network-check-target-7hhkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:16.359540 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.359281 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg podName:34fdc0ba-75ea-482b-98db-b28f7fe8da0d nodeName:}" failed. No retries permitted until 2026-05-26 10:10:20.35926177 +0000 UTC m=+10.151689762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x2jg" (UniqueName: "kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg") pod "network-check-target-7hhkd" (UID: "34fdc0ba-75ea-482b-98db-b28f7fe8da0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:16.460470 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.460432 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:16.460647 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.460590 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:16.460711 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.460669 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs podName:c7f27adb-4e8c-4841-9ac8-6ece585e515b nodeName:}" failed. No retries permitted until 2026-05-26 10:10:20.460648343 +0000 UTC m=+10.253076333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs") pod "network-metrics-daemon-6dwkx" (UID: "c7f27adb-4e8c-4841-9ac8-6ece585e515b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:16.797241 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.797144 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-163.ec2.internal" podStartSLOduration=4.797122803 podStartE2EDuration="4.797122803s" podCreationTimestamp="2026-05-26 10:10:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:10:14.958450745 +0000 UTC m=+4.750878757" watchObservedRunningTime="2026-05-26 10:10:16.797122803 +0000 UTC m=+6.589550816" May 26 10:10:16.798190 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.798166 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-t6kkd"] May 26 10:10:16.801357 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.801330 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:16.801441 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.801417 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:16.827234 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.827208 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:16.827373 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.827323 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:16.863085 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.863055 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a3d5778-8c69-4b79-a97e-eb71b818caf2-kubelet-config\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:16.863221 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.863116 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a3d5778-8c69-4b79-a97e-eb71b818caf2-dbus\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:16.863221 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.863191 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:16.963753 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.963709 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a3d5778-8c69-4b79-a97e-eb71b818caf2-kubelet-config\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:16.963923 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.963770 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a3d5778-8c69-4b79-a97e-eb71b818caf2-dbus\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:16.963923 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.963836 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a3d5778-8c69-4b79-a97e-eb71b818caf2-kubelet-config\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:16.963923 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.963854 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:16.964083 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.963956 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:16.964083 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:16.964012 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret podName:0a3d5778-8c69-4b79-a97e-eb71b818caf2 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:17.463996773 +0000 UTC m=+7.256424763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret") pod "global-pull-secret-syncer-t6kkd" (UID: "0a3d5778-8c69-4b79-a97e-eb71b818caf2") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:16.964083 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:16.964075 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a3d5778-8c69-4b79-a97e-eb71b818caf2-dbus\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:17.468340 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:17.468291 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:17.468902 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:17.468464 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:17.468902 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:17.468551 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret podName:0a3d5778-8c69-4b79-a97e-eb71b818caf2 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:18.468530293 +0000 UTC m=+8.260958298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret") pod "global-pull-secret-syncer-t6kkd" (UID: "0a3d5778-8c69-4b79-a97e-eb71b818caf2") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:17.825180 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:17.825088 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:17.825331 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:17.825237 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:18.475835 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:18.475798 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:18.476285 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:18.475950 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:18.476285 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:18.476059 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret podName:0a3d5778-8c69-4b79-a97e-eb71b818caf2 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:20.47599954 +0000 UTC m=+10.268427546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret") pod "global-pull-secret-syncer-t6kkd" (UID: "0a3d5778-8c69-4b79-a97e-eb71b818caf2") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:18.825696 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:18.825626 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:18.825836 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:18.825626 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:18.825836 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:18.825764 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:18.825949 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:18.825864 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:19.825585 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:19.825553 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:19.826021 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:19.825705 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:20.388995 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:20.388937 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:20.389183 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.389126 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:20.389183 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.389149 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:20.389183 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.389161 2557 projected.go:194] Error preparing data for projected volume kube-api-access-6x2jg for pod openshift-network-diagnostics/network-check-target-7hhkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:20.389340 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.389226 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg podName:34fdc0ba-75ea-482b-98db-b28f7fe8da0d nodeName:}" failed. No retries permitted until 2026-05-26 10:10:28.389208358 +0000 UTC m=+18.181636368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x2jg" (UniqueName: "kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg") pod "network-check-target-7hhkd" (UID: "34fdc0ba-75ea-482b-98db-b28f7fe8da0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:20.489992 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:20.489837 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:20.489992 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:20.489897 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:20.490340 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.490003 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:20.490340 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.490019 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:20.490340 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.490078 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs podName:c7f27adb-4e8c-4841-9ac8-6ece585e515b nodeName:}" failed. No retries permitted until 2026-05-26 10:10:28.490057339 +0000 UTC m=+18.282485328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs") pod "network-metrics-daemon-6dwkx" (UID: "c7f27adb-4e8c-4841-9ac8-6ece585e515b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:20.490340 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.490101 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret podName:0a3d5778-8c69-4b79-a97e-eb71b818caf2 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:24.490089885 +0000 UTC m=+14.282517889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret") pod "global-pull-secret-syncer-t6kkd" (UID: "0a3d5778-8c69-4b79-a97e-eb71b818caf2") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:20.827294 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:20.826607 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:20.827294 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.826722 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:20.827294 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:20.827111 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:20.827294 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:20.827203 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:21.825313 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:21.824811 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:21.825313 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:21.824948 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:22.825209 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:22.825174 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:22.825612 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:22.825300 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:22.825612 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:22.825368 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:22.825612 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:22.825469 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:23.825583 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:23.825550 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:23.825991 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:23.825688 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:24.519928 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:24.519888 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:24.520238 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:24.520073 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:24.520238 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:24.520151 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret podName:0a3d5778-8c69-4b79-a97e-eb71b818caf2 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:32.520129246 +0000 UTC m=+22.312557247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret") pod "global-pull-secret-syncer-t6kkd" (UID: "0a3d5778-8c69-4b79-a97e-eb71b818caf2") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:24.824808 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:24.824723 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:24.824955 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:24.824849 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:24.824955 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:24.824902 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:24.825064 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:24.825010 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:25.824627 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:25.824583 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:25.825063 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:25.824723 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:26.825325 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:26.825231 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:26.825789 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:26.825371 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:26.825789 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:26.825398 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:26.825789 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:26.825542 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:27.825135 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:27.825102 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:27.825293 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:27.825242 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:28.448174 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:28.448146 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:28.448595 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:28.448278 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:28.448595 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:28.448297 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:28.448595 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:28.448310 2557 projected.go:194] Error preparing data for projected volume kube-api-access-6x2jg for pod openshift-network-diagnostics/network-check-target-7hhkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:28.448595 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:28.448364 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg podName:34fdc0ba-75ea-482b-98db-b28f7fe8da0d nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.448348995 +0000 UTC m=+34.240776997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x2jg" (UniqueName: "kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg") pod "network-check-target-7hhkd" (UID: "34fdc0ba-75ea-482b-98db-b28f7fe8da0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:28.549523 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:28.549474 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:28.549695 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:28.549629 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:28.549766 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:28.549703 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs podName:c7f27adb-4e8c-4841-9ac8-6ece585e515b nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.549682355 +0000 UTC m=+34.342110351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs") pod "network-metrics-daemon-6dwkx" (UID: "c7f27adb-4e8c-4841-9ac8-6ece585e515b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:28.825374 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:28.825296 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:28.825546 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:28.825296 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:28.825546 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:28.825428 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:28.825546 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:28.825522 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:29.824667 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:29.824630 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:29.825074 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:29.824765 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:30.826125 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:30.826090 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:30.826562 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:30.826172 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:30.826562 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:30.826266 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:30.826562 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:30.826389 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:31.825160 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.825138 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:31.825262 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:31.825239 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:31.966153 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.966083 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:10:31.966792 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.966406 2557 generic.go:358] "Generic (PLEG): container finished" podID="9ebc88d7-bb80-4c64-b239-c1635d55af86" containerID="bc569dd0819cb4456c058ee93dad662b3084954d78a7728a5e2b03d02534be96" exitCode=1 May 26 10:10:31.966792 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.966469 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"77456ba5f53794d3871557a718f47047d16c728cc5fce0638922f8074a3be8eb"} May 26 10:10:31.966792 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.966497 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"ea26f630484b9f990ecf068ed7f59a046be5ef5bbd088979332486458ace2269"} May 26 10:10:31.966792 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.966526 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"4f56bd77da2942199055034f3bb7de91399d55bfb2a9f26fa4a2eeb6131f5522"} May 26 10:10:31.966792 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.966539 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"1d1a1b3f03b30b84420f22edad0da02babac1bed1bd507fb044c612d0c283e6b"} May 26 10:10:31.966792 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.966547 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerDied","Data":"bc569dd0819cb4456c058ee93dad662b3084954d78a7728a5e2b03d02534be96"} May 26 10:10:31.966792 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.966563 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"d12a70ec62bb37e54270e13686143fe445fd4b09b201cc70946b0a676c644234"} May 26 10:10:31.967934 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.967910 2557 generic.go:358] "Generic (PLEG): container finished" podID="12df8fdf-4e67-454b-9504-8037dd08195c" containerID="22ec4a746ddcf0b262bd878f252fc48a2cbadeb2d5af2f6fa5adfbd8cc9c0cc4" exitCode=0 May 26 10:10:31.968038 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.967973 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerDied","Data":"22ec4a746ddcf0b262bd878f252fc48a2cbadeb2d5af2f6fa5adfbd8cc9c0cc4"} May 26 10:10:31.969445 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.969312 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x9rzz" event={"ID":"94e8656c-2263-4c65-9a3b-bd7bb835aefc","Type":"ContainerStarted","Data":"779468c415341e8746b7239d595672f90b8ce84f9b9851896fc202ad8a9f86a1"} May 26 10:10:31.970679 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.970659 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" event={"ID":"58e03672-af2a-4586-a12e-8648d2932bec","Type":"ContainerStarted","Data":"fcdcaf7e0589d9e632aac0ecdaf6d96db8ca3722703045cbc9e1560d3ba4ad86"} May 26 10:10:31.972010 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.971976 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w62wm" event={"ID":"971ff43f-544e-45eb-90d6-63bc0d27c329","Type":"ContainerStarted","Data":"f23765cdb4c5abf8d9b4a2d1a65f4423c3c47b328669aec811c61f7c0a7150f7"} May 26 10:10:31.973308 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.973288 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-27ld5" event={"ID":"a82f439a-58a5-48db-856f-8150133b761c","Type":"ContainerStarted","Data":"0e5e6cf57b1f32cf1e1a552764532bc45d70a8dfb6335879272bd64f5e206038"} May 26 10:10:31.975006 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.974976 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-786bz" event={"ID":"57adbec3-592d-4976-adfb-2fee89eee87f","Type":"ContainerStarted","Data":"9411a2d4bf40e572d01f88e6402b52d01f459711e96620f4d2102839e39c08ce"} May 26 10:10:31.976210 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:31.976188 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" event={"ID":"b1cdeaf3-39f0-4f4b-ba8f-f947d33c8b11","Type":"ContainerStarted","Data":"10a83ceb947f7c06229c2bcfe855863b228427adbd1611f60c6a1662f9f6ebad"} May 26 10:10:32.014275 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.014229 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-786bz" podStartSLOduration=8.886092579 podStartE2EDuration="22.014215904s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.398901338 +0000 UTC m=+3.191329330" lastFinishedPulling="2026-05-26 10:10:26.527024667 +0000 UTC m=+16.319452655" observedRunningTime="2026-05-26 10:10:32.014031693 +0000 UTC m=+21.806459705" watchObservedRunningTime="2026-05-26 10:10:32.014215904 +0000 UTC m=+21.806643914" May 26 10:10:32.031598 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.031538 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-27ld5" podStartSLOduration=4.305266909 podStartE2EDuration="22.031505387s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.389795619 +0000 UTC m=+3.182223625" lastFinishedPulling="2026-05-26 10:10:31.116034099 +0000 UTC m=+20.908462103" observedRunningTime="2026-05-26 10:10:32.031371842 +0000 UTC m=+21.823799853" watchObservedRunningTime="2026-05-26 10:10:32.031505387 +0000 UTC m=+21.823933397" May 26 10:10:32.048150 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.048108 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w62wm" podStartSLOduration=4.489875437 podStartE2EDuration="22.048095296s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.39588531 +0000 UTC m=+3.188313313" lastFinishedPulling="2026-05-26 10:10:30.954105168 +0000 UTC m=+20.746533172" observedRunningTime="2026-05-26 10:10:32.047993571 +0000 UTC m=+21.840421582" watchObservedRunningTime="2026-05-26 10:10:32.048095296 +0000 UTC m=+21.840523307" May 26 10:10:32.075615 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.075566 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jzrn9" podStartSLOduration=4.35331661 podStartE2EDuration="22.075546341s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.393968126 +0000 UTC m=+3.186396115" lastFinishedPulling="2026-05-26 10:10:31.116197857 +0000 UTC m=+20.908625846" observedRunningTime="2026-05-26 10:10:32.07523649 +0000 UTC m=+21.867664501" watchObservedRunningTime="2026-05-26 10:10:32.075546341 +0000 UTC m=+21.867974349" May 26 10:10:32.356694 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.356612 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:32.357315 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.357297 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:32.374374 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.374330 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-x9rzz" podStartSLOduration=4.805193916 podStartE2EDuration="22.374317719s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.397094818 +0000 UTC m=+3.189522822" lastFinishedPulling="2026-05-26 10:10:30.966218625 +0000 UTC m=+20.758646625" observedRunningTime="2026-05-26 10:10:32.094331372 +0000 UTC m=+21.886759381" watchObservedRunningTime="2026-05-26 10:10:32.374317719 +0000 UTC m=+22.166745730" May 26 10:10:32.581049 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.581026 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:32.581151 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:32.581139 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:32.581210 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:32.581200 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret podName:0a3d5778-8c69-4b79-a97e-eb71b818caf2 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:48.581176243 +0000 UTC m=+38.373604232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret") pod "global-pull-secret-syncer-t6kkd" (UID: "0a3d5778-8c69-4b79-a97e-eb71b818caf2") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:32.718822 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.718617 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 10:10:32.794290 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.794185 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T10:10:32.71880901Z","UUID":"b16ffd3b-1aed-4ca4-911b-ba78c68bb59d","Handler":null,"Name":"","Endpoint":""} May 26 10:10:32.797557 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.797532 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 10:10:32.797699 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.797565 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 10:10:32.824751 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.824598 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:32.824751 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.824639 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:32.824751 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:32.824724 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:32.825071 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:32.824859 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:32.979283 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.979240 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p9dlg" event={"ID":"4ebe4a14-9e33-48c9-ba1c-7614570d4100","Type":"ContainerStarted","Data":"26132d34ce283eb1ec7b9a84ec24f22b60099a7f2957847ba549b04bc8218c8b"} May 26 10:10:32.981240 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.981207 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" event={"ID":"58e03672-af2a-4586-a12e-8648d2932bec","Type":"ContainerStarted","Data":"e2c4f4361e737fb02c3fc3251b5c4ea486bac3d744ec99a20bacd240f7db2000"} May 26 10:10:32.981738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.981703 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:32.982288 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:32.982268 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w62wm" May 26 10:10:33.007862 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:33.007818 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p9dlg" podStartSLOduration=5.440782475 podStartE2EDuration="23.007806286s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.399178929 +0000 UTC m=+3.191606932" lastFinishedPulling="2026-05-26 10:10:30.966202742 +0000 UTC m=+20.758630743" observedRunningTime="2026-05-26 10:10:33.007403563 +0000 UTC m=+22.799831575" watchObservedRunningTime="2026-05-26 10:10:33.007806286 +0000 UTC m=+22.800234296" May 26 10:10:33.825542 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:33.825502 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:33.825721 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:33.825624 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:34.824951 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:34.824919 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:34.825394 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:34.825039 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:34.825394 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:34.825118 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:34.825394 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:34.825196 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:34.987066 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:34.987025 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" event={"ID":"58e03672-af2a-4586-a12e-8648d2932bec","Type":"ContainerStarted","Data":"7b2ece0626c949afd84a7b08f7d5c402e424314cfb9a177e9f90b2a58f5b17f3"} May 26 10:10:34.992976 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:34.992954 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:10:34.993377 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:34.993339 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"ea6208ef5e0eeafd8d83459c196bf9e47454d523e531a381d1ea01fd4723f36b"} May 26 10:10:35.011034 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:35.010994 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ccgrx" podStartSLOduration=4.297545713 podStartE2EDuration="25.010981474s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.39686092 +0000 UTC m=+3.189288912" lastFinishedPulling="2026-05-26 10:10:34.110296684 +0000 UTC m=+23.902724673" observedRunningTime="2026-05-26 10:10:35.010428211 +0000 UTC m=+24.802856222" watchObservedRunningTime="2026-05-26 10:10:35.010981474 +0000 UTC m=+24.803409495" May 26 10:10:35.825164 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:35.825135 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:35.825557 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:35.825238 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:36.825374 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:36.825154 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:36.825824 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:36.825154 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:36.825824 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:36.825456 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:36.825824 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:36.825564 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:36.999044 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:36.999014 2557 generic.go:358] "Generic (PLEG): container finished" podID="12df8fdf-4e67-454b-9504-8037dd08195c" containerID="c45c09aeee29ef841b466bf3e49833153356c06e0b583eb98c5ef0f6536bed2b" exitCode=0 May 26 10:10:36.999204 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:36.999096 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerDied","Data":"c45c09aeee29ef841b466bf3e49833153356c06e0b583eb98c5ef0f6536bed2b"} May 26 10:10:37.001963 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:37.001946 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:10:37.002268 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:37.002246 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"d624842751acc2f14a600e2a58310f993a8fada5606d2e596932e0cb17353ab0"} May 26 10:10:37.002607 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:37.002592 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:37.002607 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:37.002608 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:37.002769 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:37.002753 2557 scope.go:117] "RemoveContainer" containerID="bc569dd0819cb4456c058ee93dad662b3084954d78a7728a5e2b03d02534be96" May 26 10:10:37.017907 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:37.017888 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:37.825015 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:37.824981 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:37.825174 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:37.825116 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:38.008949 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.008924 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:10:38.009602 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.009344 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" event={"ID":"9ebc88d7-bb80-4c64-b239-c1635d55af86","Type":"ContainerStarted","Data":"f8f78f1777d636726a68359a63cc47ce93f499ef584070c0137f742791a52473"} May 26 10:10:38.009745 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.009719 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:38.012110 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.012077 2557 generic.go:358] "Generic (PLEG): container finished" podID="12df8fdf-4e67-454b-9504-8037dd08195c" containerID="41bee107a2cbcfb9d14f5a8bfcb3d375486ce15c34af205fa62431c694b2a820" exitCode=0 May 26 10:10:38.012209 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.012141 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerDied","Data":"41bee107a2cbcfb9d14f5a8bfcb3d375486ce15c34af205fa62431c694b2a820"} May 26 10:10:38.026024 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.026002 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:10:38.042355 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.042275 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" podStartSLOduration=9.264216504 podStartE2EDuration="27.042259865s" podCreationTimestamp="2026-05-26 10:10:11 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.392668479 +0000 UTC m=+3.185096468" lastFinishedPulling="2026-05-26 10:10:31.17071184 +0000 UTC m=+20.963139829" observedRunningTime="2026-05-26 10:10:38.041264878 +0000 UTC m=+27.833692890" watchObservedRunningTime="2026-05-26 10:10:38.042259865 +0000 UTC m=+27.834687878" May 26 10:10:38.250093 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.250061 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t6kkd"] May 26 10:10:38.250266 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.250180 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:38.250324 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:38.250292 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:38.253019 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.252994 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7hhkd"] May 26 10:10:38.253124 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.253088 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:38.253191 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:38.253170 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:38.253544 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.253505 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6dwkx"] May 26 10:10:38.253667 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:38.253611 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:38.253746 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:38.253723 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:39.016339 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:39.016158 2557 generic.go:358] "Generic (PLEG): container finished" podID="12df8fdf-4e67-454b-9504-8037dd08195c" containerID="525f883b15d974c5bf63dc12fa3bffd88904619be2496b85a58de164d102d394" exitCode=0 May 26 10:10:39.016827 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:39.016220 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerDied","Data":"525f883b15d974c5bf63dc12fa3bffd88904619be2496b85a58de164d102d394"} May 26 10:10:39.824653 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:39.824618 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:39.824832 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:39.824658 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:39.824832 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:39.824635 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:39.824832 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:39.824733 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:39.825007 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:39.824826 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:39.825007 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:39.824882 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:41.825482 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:41.825447 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:41.825915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:41.825461 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:41.825915 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:41.825576 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:41.825915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:41.825460 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:41.825915 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:41.825645 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:41.825915 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:41.825727 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:43.825604 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:43.825567 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:43.826090 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:43.825567 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:43.826090 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:43.825716 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dwkx" podUID="c7f27adb-4e8c-4841-9ac8-6ece585e515b" May 26 10:10:43.826090 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:43.825807 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6kkd" podUID="0a3d5778-8c69-4b79-a97e-eb71b818caf2" May 26 10:10:43.826090 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:43.825578 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:43.826090 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:43.825909 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hhkd" podUID="34fdc0ba-75ea-482b-98db-b28f7fe8da0d" May 26 10:10:44.046022 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.045941 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-163.ec2.internal" event="NodeReady" May 26 10:10:44.046171 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.046084 2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 10:10:44.118208 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.118177 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f5745d4c6-2hg44"] May 26 10:10:44.180409 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.180376 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mz82c"] May 26 10:10:44.180596 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.180452 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.183091 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.183059 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 26 10:10:44.183328 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.183297 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 26 10:10:44.183852 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.183706 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-smbnk\"" May 26 10:10:44.183852 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.183735 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 26 10:10:44.189704 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.189344 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 26 10:10:44.191149 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.191129 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mp8fz"] May 26 10:10:44.191303 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.191286 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:44.193851 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.193830 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 10:10:44.194160 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.194019 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 10:10:44.194160 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.194025 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 10:10:44.194160 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.194052 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lb2l8\"" May 26 10:10:44.206294 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.206228 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f5745d4c6-2hg44"] May 26 10:10:44.206294 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.206259 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mz82c"] May 26 10:10:44.206294 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.206272 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mp8fz"] May 26 10:10:44.206473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.206358 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.208962 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.208940 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 10:10:44.209061 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.208940 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mm9pv\"" May 26 10:10:44.209061 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.208942 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 10:10:44.269032 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.268989 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-trusted-ca\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.269193 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-image-registry-private-configuration\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.269193 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwp4l\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-kube-api-access-xwp4l\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.269193 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36c19326-213b-40b3-a81a-225a4701233c-ca-trust-extracted\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.269193 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269138 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-installation-pull-secrets\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.269193 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269174 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-bound-sa-token\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.269453 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269260 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:44.269453 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-registry-certificates\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.269453 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lchdt\" (UniqueName: \"kubernetes.io/projected/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-kube-api-access-lchdt\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:44.269453 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.269339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.370343 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370264 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lchdt\" (UniqueName: \"kubernetes.io/projected/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-kube-api-access-lchdt\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:44.370343 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370321 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.370574 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370353 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-trusted-ca\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.370574 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370389 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.370574 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370426 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-image-registry-private-configuration\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.370574 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.370465 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:44.370574 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370475 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwp4l\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-kube-api-access-xwp4l\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.370574 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.370488 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f5745d4c6-2hg44: secret "image-registry-tls" not found May 26 10:10:44.370574 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370565 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36c19326-213b-40b3-a81a-225a4701233c-ca-trust-extracted\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.370898 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.370589 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls podName:36c19326-213b-40b3-a81a-225a4701233c nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.870567391 +0000 UTC m=+34.662995407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls") pod "image-registry-5f5745d4c6-2hg44" (UID: "36c19326-213b-40b3-a81a-225a4701233c") : secret "image-registry-tls" not found May 26 10:10:44.370898 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370622 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46451e3e-b7ae-4254-8244-989b34d47910-tmp-dir\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.370898 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370650 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jpg5\" (UniqueName: \"kubernetes.io/projected/46451e3e-b7ae-4254-8244-989b34d47910-kube-api-access-4jpg5\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.370898 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370683 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46451e3e-b7ae-4254-8244-989b34d47910-config-volume\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.370898 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370726 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-installation-pull-secrets\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.370898 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370753 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-bound-sa-token\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.370898 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370825 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:44.371238 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370968 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36c19326-213b-40b3-a81a-225a4701233c-ca-trust-extracted\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.371238 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.370999 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-registry-certificates\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.371238 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.371057 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:44.371238 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.371127 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert podName:d9180998-ae3a-41d2-9c8b-a46fa4de2a3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.871110757 +0000 UTC m=+34.663538763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert") pod "ingress-canary-mz82c" (UID: "d9180998-ae3a-41d2-9c8b-a46fa4de2a3e") : secret "canary-serving-cert" not found May 26 10:10:44.371504 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.371479 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-trusted-ca\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.371592 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.371502 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-registry-certificates\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.375261 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.375234 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-installation-pull-secrets\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.375261 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.375242 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-image-registry-private-configuration\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.383463 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.383443 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-bound-sa-token\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.383620 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.383594 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lchdt\" (UniqueName: \"kubernetes.io/projected/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-kube-api-access-lchdt\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:44.383678 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.383622 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwp4l\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-kube-api-access-xwp4l\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.471864 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.471827 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:44.472052 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.471894 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.472052 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.471980 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46451e3e-b7ae-4254-8244-989b34d47910-tmp-dir\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.472052 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.471996 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:44.472052 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.472007 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jpg5\" (UniqueName: \"kubernetes.io/projected/46451e3e-b7ae-4254-8244-989b34d47910-kube-api-access-4jpg5\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.472052 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.472018 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:44.472052 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.472027 2557 projected.go:194] Error preparing data for projected volume kube-api-access-6x2jg for pod openshift-network-diagnostics/network-check-target-7hhkd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:44.472052 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.472031 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:44.472384 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.472033 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46451e3e-b7ae-4254-8244-989b34d47910-config-volume\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.472384 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.472104 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls podName:46451e3e-b7ae-4254-8244-989b34d47910 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.972089498 +0000 UTC m=+34.764517487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls") pod "dns-default-mp8fz" (UID: "46451e3e-b7ae-4254-8244-989b34d47910") : secret "dns-default-metrics-tls" not found May 26 10:10:44.472384 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.472169 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg podName:34fdc0ba-75ea-482b-98db-b28f7fe8da0d nodeName:}" failed. No retries permitted until 2026-05-26 10:11:16.472139612 +0000 UTC m=+66.264567601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x2jg" (UniqueName: "kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg") pod "network-check-target-7hhkd" (UID: "34fdc0ba-75ea-482b-98db-b28f7fe8da0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:44.472384 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.472363 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46451e3e-b7ae-4254-8244-989b34d47910-tmp-dir\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.472645 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.472627 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46451e3e-b7ae-4254-8244-989b34d47910-config-volume\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.480208 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.480183 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jpg5\" (UniqueName: \"kubernetes.io/projected/46451e3e-b7ae-4254-8244-989b34d47910-kube-api-access-4jpg5\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.572563 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.572531 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:44.572668 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.572616 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:44.572705 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.572694 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs podName:c7f27adb-4e8c-4841-9ac8-6ece585e515b nodeName:}" failed. No retries permitted until 2026-05-26 10:11:16.572679465 +0000 UTC m=+66.365107457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs") pod "network-metrics-daemon-6dwkx" (UID: "c7f27adb-4e8c-4841-9ac8-6ece585e515b") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:44.875937 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.875910 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:44.876276 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.875974 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:44.876276 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.876060 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:44.876276 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.876064 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:44.876276 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.876081 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f5745d4c6-2hg44: secret "image-registry-tls" not found May 26 10:10:44.876276 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.876108 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert podName:d9180998-ae3a-41d2-9c8b-a46fa4de2a3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:45.876094738 +0000 UTC m=+35.668522727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert") pod "ingress-canary-mz82c" (UID: "d9180998-ae3a-41d2-9c8b-a46fa4de2a3e") : secret "canary-serving-cert" not found May 26 10:10:44.876276 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.876120 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls podName:36c19326-213b-40b3-a81a-225a4701233c nodeName:}" failed. No retries permitted until 2026-05-26 10:10:45.876114772 +0000 UTC m=+35.668542761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls") pod "image-registry-5f5745d4c6-2hg44" (UID: "36c19326-213b-40b3-a81a-225a4701233c") : secret "image-registry-tls" not found May 26 10:10:44.976504 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:44.976476 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:44.976681 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.976616 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:44.976743 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:44.976683 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls podName:46451e3e-b7ae-4254-8244-989b34d47910 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:45.976663421 +0000 UTC m=+35.769091415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls") pod "dns-default-mp8fz" (UID: "46451e3e-b7ae-4254-8244-989b34d47910") : secret "dns-default-metrics-tls" not found May 26 10:10:45.031669 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.031479 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerStarted","Data":"7185001af231633642f69743752364affc15c03979cf9159f18bbcee08c410a6"} May 26 10:10:45.824609 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.824572 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:45.824807 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.824572 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:10:45.824807 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.824572 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:10:45.828857 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.828836 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 10:10:45.828974 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.828931 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sn4kp\"" May 26 10:10:45.828974 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.828968 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 10:10:45.829109 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.828984 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dpb8v\"" May 26 10:10:45.829109 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.828970 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 10:10:45.829109 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.829039 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 10:10:45.883929 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.883906 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:45.884249 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.883956 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:45.884249 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:45.884043 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:45.884249 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:45.884062 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:45.884249 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:45.884076 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f5745d4c6-2hg44: secret "image-registry-tls" not found May 26 10:10:45.884249 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:45.884104 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert podName:d9180998-ae3a-41d2-9c8b-a46fa4de2a3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:47.884086769 +0000 UTC m=+37.676514758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert") pod "ingress-canary-mz82c" (UID: "d9180998-ae3a-41d2-9c8b-a46fa4de2a3e") : secret "canary-serving-cert" not found May 26 10:10:45.884249 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:45.884118 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls podName:36c19326-213b-40b3-a81a-225a4701233c nodeName:}" failed. No retries permitted until 2026-05-26 10:10:47.884112118 +0000 UTC m=+37.676540107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls") pod "image-registry-5f5745d4c6-2hg44" (UID: "36c19326-213b-40b3-a81a-225a4701233c") : secret "image-registry-tls" not found May 26 10:10:45.984869 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:45.984834 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:45.985029 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:45.985005 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:45.985093 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:45.985080 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls podName:46451e3e-b7ae-4254-8244-989b34d47910 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:47.985060536 +0000 UTC m=+37.777488525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls") pod "dns-default-mp8fz" (UID: "46451e3e-b7ae-4254-8244-989b34d47910") : secret "dns-default-metrics-tls" not found May 26 10:10:46.035879 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:46.035849 2557 generic.go:358] "Generic (PLEG): container finished" podID="12df8fdf-4e67-454b-9504-8037dd08195c" containerID="7185001af231633642f69743752364affc15c03979cf9159f18bbcee08c410a6" exitCode=0 May 26 10:10:46.036023 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:46.035899 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerDied","Data":"7185001af231633642f69743752364affc15c03979cf9159f18bbcee08c410a6"} May 26 10:10:47.040205 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:47.040170 2557 generic.go:358] "Generic (PLEG): container finished" podID="12df8fdf-4e67-454b-9504-8037dd08195c" containerID="743a59729f5867f6a9cf8a1085f34356a8f3124ae01d8042c68beb8c9c870625" exitCode=0 May 26 10:10:47.040761 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:47.040220 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerDied","Data":"743a59729f5867f6a9cf8a1085f34356a8f3124ae01d8042c68beb8c9c870625"} May 26 10:10:47.899467 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:47.899429 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:47.899650 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:47.899542 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:47.899650 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:47.899591 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:47.899650 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:47.899610 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f5745d4c6-2hg44: secret "image-registry-tls" not found May 26 10:10:47.899650 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:47.899643 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:47.899808 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:47.899662 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls podName:36c19326-213b-40b3-a81a-225a4701233c nodeName:}" failed. No retries permitted until 2026-05-26 10:10:51.899648284 +0000 UTC m=+41.692076273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls") pod "image-registry-5f5745d4c6-2hg44" (UID: "36c19326-213b-40b3-a81a-225a4701233c") : secret "image-registry-tls" not found May 26 10:10:47.899808 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:47.899693 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert podName:d9180998-ae3a-41d2-9c8b-a46fa4de2a3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:51.899677368 +0000 UTC m=+41.692105366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert") pod "ingress-canary-mz82c" (UID: "d9180998-ae3a-41d2-9c8b-a46fa4de2a3e") : secret "canary-serving-cert" not found May 26 10:10:48.000797 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:48.000764 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:48.000937 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:48.000902 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:48.000985 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:48.000961 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls podName:46451e3e-b7ae-4254-8244-989b34d47910 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:52.000946994 +0000 UTC m=+41.793374984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls") pod "dns-default-mp8fz" (UID: "46451e3e-b7ae-4254-8244-989b34d47910") : secret "dns-default-metrics-tls" not found May 26 10:10:48.044796 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:48.044728 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" event={"ID":"12df8fdf-4e67-454b-9504-8037dd08195c","Type":"ContainerStarted","Data":"f4526e5e687f76521d8ce87dde62e54d0fe82729a956b3f2c67fdf8d1aaf46a3"} May 26 10:10:48.074020 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:48.073874 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4j8bf" podStartSLOduration=6.578875546 podStartE2EDuration="38.07386032s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:13.400874245 +0000 UTC m=+3.193302234" lastFinishedPulling="2026-05-26 10:10:44.895859005 +0000 UTC m=+34.688287008" observedRunningTime="2026-05-26 10:10:48.072200371 +0000 UTC m=+37.864628406" watchObservedRunningTime="2026-05-26 10:10:48.07386032 +0000 UTC m=+37.866288331" May 26 10:10:48.604689 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:48.604652 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:48.607788 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:48.607757 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a3d5778-8c69-4b79-a97e-eb71b818caf2-original-pull-secret\") pod \"global-pull-secret-syncer-t6kkd\" (UID: \"0a3d5778-8c69-4b79-a97e-eb71b818caf2\") " pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:48.833669 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:48.833643 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6kkd" May 26 10:10:49.000810 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:49.000618 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t6kkd"] May 26 10:10:49.004505 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:10:49.004473 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3d5778_8c69_4b79_a97e_eb71b818caf2.slice/crio-984469698fcd0873d1a2ebcf987102e2cf56a62427df5f692587ed1e56944e02 WatchSource:0}: Error finding container 984469698fcd0873d1a2ebcf987102e2cf56a62427df5f692587ed1e56944e02: Status 404 returned error can't find the container with id 984469698fcd0873d1a2ebcf987102e2cf56a62427df5f692587ed1e56944e02 May 26 10:10:49.047718 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:49.047687 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t6kkd" event={"ID":"0a3d5778-8c69-4b79-a97e-eb71b818caf2","Type":"ContainerStarted","Data":"984469698fcd0873d1a2ebcf987102e2cf56a62427df5f692587ed1e56944e02"} May 26 10:10:51.933405 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:51.933369 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:51.933867 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:51.933439 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:51.933867 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:51.933547 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:51.933867 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:51.933576 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:51.933867 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:51.933592 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f5745d4c6-2hg44: secret "image-registry-tls" not found May 26 10:10:51.933867 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:51.933619 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert podName:d9180998-ae3a-41d2-9c8b-a46fa4de2a3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:59.933602101 +0000 UTC m=+49.726030090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert") pod "ingress-canary-mz82c" (UID: "d9180998-ae3a-41d2-9c8b-a46fa4de2a3e") : secret "canary-serving-cert" not found May 26 10:10:51.933867 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:51.933646 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls podName:36c19326-213b-40b3-a81a-225a4701233c nodeName:}" failed. No retries permitted until 2026-05-26 10:10:59.933628721 +0000 UTC m=+49.726056711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls") pod "image-registry-5f5745d4c6-2hg44" (UID: "36c19326-213b-40b3-a81a-225a4701233c") : secret "image-registry-tls" not found May 26 10:10:52.034650 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:52.034614 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:10:52.034805 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:52.034761 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:52.034887 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:52.034835 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls podName:46451e3e-b7ae-4254-8244-989b34d47910 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:00.034816462 +0000 UTC m=+49.827244451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls") pod "dns-default-mp8fz" (UID: "46451e3e-b7ae-4254-8244-989b34d47910") : secret "dns-default-metrics-tls" not found May 26 10:10:53.056232 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:53.056144 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t6kkd" event={"ID":"0a3d5778-8c69-4b79-a97e-eb71b818caf2","Type":"ContainerStarted","Data":"431c8cb1da5ba45f3295b1b3f91504e8cfd11701f0bd8904c039761b0a8e7495"} May 26 10:10:53.072781 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:53.072739 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t6kkd" podStartSLOduration=33.335390859 podStartE2EDuration="37.072726823s" podCreationTimestamp="2026-05-26 10:10:16 +0000 UTC" firstStartedPulling="2026-05-26 10:10:49.006260804 +0000 UTC m=+38.798688792" lastFinishedPulling="2026-05-26 10:10:52.743596768 +0000 UTC m=+42.536024756" observedRunningTime="2026-05-26 10:10:53.072250463 +0000 UTC m=+42.864678476" watchObservedRunningTime="2026-05-26 10:10:53.072726823 +0000 UTC m=+42.865154898" May 26 10:10:59.992191 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:59.992147 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:10:59.992667 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:10:59.992214 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:10:59.992667 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:59.992310 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:59.992667 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:59.992327 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:59.992667 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:59.992338 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f5745d4c6-2hg44: secret "image-registry-tls" not found May 26 10:10:59.992667 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:59.992378 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls podName:36c19326-213b-40b3-a81a-225a4701233c nodeName:}" failed. No retries permitted until 2026-05-26 10:11:15.992364861 +0000 UTC m=+65.784792850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls") pod "image-registry-5f5745d4c6-2hg44" (UID: "36c19326-213b-40b3-a81a-225a4701233c") : secret "image-registry-tls" not found May 26 10:10:59.992667 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:10:59.992390 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert podName:d9180998-ae3a-41d2-9c8b-a46fa4de2a3e nodeName:}" failed. No retries permitted until 2026-05-26 10:11:15.99238435 +0000 UTC m=+65.784812339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert") pod "ingress-canary-mz82c" (UID: "d9180998-ae3a-41d2-9c8b-a46fa4de2a3e") : secret "canary-serving-cert" not found May 26 10:11:00.092703 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:00.092668 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:11:00.092867 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:11:00.092797 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:11:00.092867 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:11:00.092854 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls podName:46451e3e-b7ae-4254-8244-989b34d47910 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:16.092840186 +0000 UTC m=+65.885268175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls") pod "dns-default-mp8fz" (UID: "46451e3e-b7ae-4254-8244-989b34d47910") : secret "dns-default-metrics-tls" not found May 26 10:11:02.686621 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:02.686590 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x9rzz_94e8656c-2263-4c65-9a3b-bd7bb835aefc/dns-node-resolver/0.log" May 26 10:11:03.208879 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.208843 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-5jghc"] May 26 10:11:03.258584 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.258553 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-5jghc"] May 26 10:11:03.258751 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.258671 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.261347 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.261328 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 26 10:11:03.262597 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.262573 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 26 10:11:03.262597 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.262585 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 26 10:11:03.262737 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.262604 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 26 10:11:03.262737 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.262640 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xw58q\"" May 26 10:11:03.286941 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.286919 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-786bz_57adbec3-592d-4976-adfb-2fee89eee87f/node-ca/0.log" May 26 10:11:03.417913 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.417872 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-signing-key\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.418092 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.417934 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-signing-cabundle\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.418092 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.418021 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5xph\" (UniqueName: \"kubernetes.io/projected/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-kube-api-access-g5xph\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.518744 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.518663 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5xph\" (UniqueName: \"kubernetes.io/projected/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-kube-api-access-g5xph\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.518744 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.518728 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-signing-key\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.518969 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.518767 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-signing-cabundle\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.519360 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.519342 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-signing-cabundle\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.521844 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.521825 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-signing-key\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.527805 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.527786 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5xph\" (UniqueName: \"kubernetes.io/projected/5ebc3217-bc0e-4af8-b81e-a70fb00aec20-kube-api-access-g5xph\") pod \"service-ca-67d667c7d-5jghc\" (UID: \"5ebc3217-bc0e-4af8-b81e-a70fb00aec20\") " pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.566881 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.566855 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-5jghc" May 26 10:11:03.700096 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:03.700062 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-5jghc"] May 26 10:11:03.703754 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:03.703727 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ebc3217_bc0e_4af8_b81e_a70fb00aec20.slice/crio-0951b7b7a02d323454929c9dd389b399544465220fd2f8b88498c28d647a9b35 WatchSource:0}: Error finding container 0951b7b7a02d323454929c9dd389b399544465220fd2f8b88498c28d647a9b35: Status 404 returned error can't find the container with id 0951b7b7a02d323454929c9dd389b399544465220fd2f8b88498c28d647a9b35 May 26 10:11:04.076575 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:04.076542 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-5jghc" event={"ID":"5ebc3217-bc0e-4af8-b81e-a70fb00aec20","Type":"ContainerStarted","Data":"0951b7b7a02d323454929c9dd389b399544465220fd2f8b88498c28d647a9b35"} May 26 10:11:07.083602 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:07.083547 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-5jghc" event={"ID":"5ebc3217-bc0e-4af8-b81e-a70fb00aec20","Type":"ContainerStarted","Data":"54987a1b8ce70df562d006e06894a7ac01f861539aee1ece7fc7efbc55de641d"} May 26 10:11:07.100829 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:07.100782 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-5jghc" podStartSLOduration=1.7442280559999999 podStartE2EDuration="4.100767569s" podCreationTimestamp="2026-05-26 10:11:03 +0000 UTC" firstStartedPulling="2026-05-26 10:11:03.70556547 +0000 UTC m=+53.497993462" lastFinishedPulling="2026-05-26 10:11:06.062104974 +0000 UTC m=+55.854532975" observedRunningTime="2026-05-26 10:11:07.100102436 +0000 UTC m=+56.892530446" watchObservedRunningTime="2026-05-26 10:11:07.100767569 +0000 UTC m=+56.893195580" May 26 10:11:10.029455 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:10.029427 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tdnl7" May 26 10:11:16.012257 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.012224 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:11:16.012728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.012279 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:11:16.014664 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.014632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9180998-ae3a-41d2-9c8b-a46fa4de2a3e-cert\") pod \"ingress-canary-mz82c\" (UID: \"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e\") " pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:11:16.014781 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.014698 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"image-registry-5f5745d4c6-2hg44\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:11:16.112604 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.112569 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:11:16.114721 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.114696 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46451e3e-b7ae-4254-8244-989b34d47910-metrics-tls\") pod \"dns-default-mp8fz\" (UID: \"46451e3e-b7ae-4254-8244-989b34d47910\") " pod="openshift-dns/dns-default-mp8fz" May 26 10:11:16.294594 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.294502 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-smbnk\"" May 26 10:11:16.302659 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.302638 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:11:16.302810 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.302788 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lb2l8\"" May 26 10:11:16.310955 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.310930 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mz82c" May 26 10:11:16.318296 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.318276 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mm9pv\"" May 26 10:11:16.326401 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.326369 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mp8fz" May 26 10:11:16.461847 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.461813 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mz82c"] May 26 10:11:16.464721 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.464697 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f5745d4c6-2hg44"] May 26 10:11:16.467384 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:16.465188 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9180998_ae3a_41d2_9c8b_a46fa4de2a3e.slice/crio-69f9ed8e24c24d79de131b65bd3d4aa5f473af61247d38e1ed0e1f92ae9f7644 WatchSource:0}: Error finding container 69f9ed8e24c24d79de131b65bd3d4aa5f473af61247d38e1ed0e1f92ae9f7644: Status 404 returned error can't find the container with id 69f9ed8e24c24d79de131b65bd3d4aa5f473af61247d38e1ed0e1f92ae9f7644 May 26 10:11:16.468951 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:16.468839 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c19326_213b_40b3_a81a_225a4701233c.slice/crio-9b683fb4e6c0a7d161b3e239e286c17814a36d698a6c63cb8790a5ac90e1f02f WatchSource:0}: Error finding container 9b683fb4e6c0a7d161b3e239e286c17814a36d698a6c63cb8790a5ac90e1f02f: Status 404 returned error can't find the container with id 9b683fb4e6c0a7d161b3e239e286c17814a36d698a6c63cb8790a5ac90e1f02f May 26 10:11:16.480359 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.480338 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mp8fz"] May 26 10:11:16.482720 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:16.482697 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46451e3e_b7ae_4254_8244_989b34d47910.slice/crio-9332dbb3f6c669dc5c62595e09cb2880a4ce7e0418c50965b799b6ccbf649a26 WatchSource:0}: Error finding container 9332dbb3f6c669dc5c62595e09cb2880a4ce7e0418c50965b799b6ccbf649a26: Status 404 returned error can't find the container with id 9332dbb3f6c669dc5c62595e09cb2880a4ce7e0418c50965b799b6ccbf649a26 May 26 10:11:16.515598 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.515577 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:11:16.518371 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.518353 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 10:11:16.528712 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.528691 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 10:11:16.539074 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.539053 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x2jg\" (UniqueName: \"kubernetes.io/projected/34fdc0ba-75ea-482b-98db-b28f7fe8da0d-kube-api-access-6x2jg\") pod \"network-check-target-7hhkd\" (UID: \"34fdc0ba-75ea-482b-98db-b28f7fe8da0d\") " pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:11:16.616343 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.616312 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:11:16.619001 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.618976 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 10:11:16.629187 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.629163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7f27adb-4e8c-4841-9ac8-6ece585e515b-metrics-certs\") pod \"network-metrics-daemon-6dwkx\" (UID: \"c7f27adb-4e8c-4841-9ac8-6ece585e515b\") " pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:11:16.742274 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.742244 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sn4kp\"" May 26 10:11:16.746586 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.746558 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dpb8v\"" May 26 10:11:16.749582 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.749506 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:11:16.754416 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.754395 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dwkx" May 26 10:11:16.893120 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.893088 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6dwkx"] May 26 10:11:16.915896 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:16.915855 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7hhkd"] May 26 10:11:16.920130 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:16.920100 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fdc0ba_75ea_482b_98db_b28f7fe8da0d.slice/crio-e0290fa19090605df1542236928470dfdc04fa7866fd96a5f029555e0fea6ef0 WatchSource:0}: Error finding container e0290fa19090605df1542236928470dfdc04fa7866fd96a5f029555e0fea6ef0: Status 404 returned error can't find the container with id e0290fa19090605df1542236928470dfdc04fa7866fd96a5f029555e0fea6ef0 May 26 10:11:17.106290 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:17.106156 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mp8fz" event={"ID":"46451e3e-b7ae-4254-8244-989b34d47910","Type":"ContainerStarted","Data":"9332dbb3f6c669dc5c62595e09cb2880a4ce7e0418c50965b799b6ccbf649a26"} May 26 10:11:17.109583 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:17.109533 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dwkx" event={"ID":"c7f27adb-4e8c-4841-9ac8-6ece585e515b","Type":"ContainerStarted","Data":"da7ea760b1bb6bb4831101e810926b78f5aee6049fe021f1e2031ef41362fb7e"} May 26 10:11:17.111192 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:17.111161 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" event={"ID":"36c19326-213b-40b3-a81a-225a4701233c","Type":"ContainerStarted","Data":"a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2"} May 26 10:11:17.111192 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:17.111189 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" event={"ID":"36c19326-213b-40b3-a81a-225a4701233c","Type":"ContainerStarted","Data":"9b683fb4e6c0a7d161b3e239e286c17814a36d698a6c63cb8790a5ac90e1f02f"} May 26 10:11:17.111958 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:17.111884 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:11:17.112842 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:17.112818 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7hhkd" event={"ID":"34fdc0ba-75ea-482b-98db-b28f7fe8da0d","Type":"ContainerStarted","Data":"e0290fa19090605df1542236928470dfdc04fa7866fd96a5f029555e0fea6ef0"} May 26 10:11:17.113706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:17.113685 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mz82c" event={"ID":"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e","Type":"ContainerStarted","Data":"69f9ed8e24c24d79de131b65bd3d4aa5f473af61247d38e1ed0e1f92ae9f7644"} May 26 10:11:17.141618 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:17.141551 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" podStartSLOduration=34.141535985 podStartE2EDuration="34.141535985s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:11:17.140865872 +0000 UTC m=+66.933293885" watchObservedRunningTime="2026-05-26 10:11:17.141535985 +0000 UTC m=+66.933963999" May 26 10:11:19.121050 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.120949 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mz82c" event={"ID":"d9180998-ae3a-41d2-9c8b-a46fa4de2a3e","Type":"ContainerStarted","Data":"54bb55e204272c091ee0b7e31171abb84eb271b05120d690d1b0d8c6b8208bb3"} May 26 10:11:19.122813 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.122767 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mp8fz" event={"ID":"46451e3e-b7ae-4254-8244-989b34d47910","Type":"ContainerStarted","Data":"39115364a96b9a173ccda72091ef2cd354da0c4fd16d8d5c42d2161070cc4d25"} May 26 10:11:19.122813 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.122801 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mp8fz" event={"ID":"46451e3e-b7ae-4254-8244-989b34d47910","Type":"ContainerStarted","Data":"5c29e42d56e083308aab069a4c8d689ea394680f6806077c35112da4c801e08e"} May 26 10:11:19.122994 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.122894 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mp8fz" May 26 10:11:19.127045 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.126962 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dwkx" event={"ID":"c7f27adb-4e8c-4841-9ac8-6ece585e515b","Type":"ContainerStarted","Data":"dd2c5cbb360d85685a3e1251364389d85677c62c4335602e81e368f28f145788"} May 26 10:11:19.127045 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.127007 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dwkx" event={"ID":"c7f27adb-4e8c-4841-9ac8-6ece585e515b","Type":"ContainerStarted","Data":"31de8e43c744e04b75d20c94208ed3231f534fdf3f88b57d337377fd0d2aceb6"} May 26 10:11:19.139603 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.139550 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mz82c" podStartSLOduration=32.748457908 podStartE2EDuration="35.139534259s" podCreationTimestamp="2026-05-26 10:10:44 +0000 UTC" firstStartedPulling="2026-05-26 10:11:16.46921595 +0000 UTC m=+66.261643954" lastFinishedPulling="2026-05-26 10:11:18.860292299 +0000 UTC m=+68.652720305" observedRunningTime="2026-05-26 10:11:19.138388079 +0000 UTC m=+68.930816091" watchObservedRunningTime="2026-05-26 10:11:19.139534259 +0000 UTC m=+68.931962264" May 26 10:11:19.163922 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.163827 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-mp8fz" podStartSLOduration=32.793829363 podStartE2EDuration="35.163809931s" podCreationTimestamp="2026-05-26 10:10:44 +0000 UTC" firstStartedPulling="2026-05-26 10:11:16.484350419 +0000 UTC m=+66.276778419" lastFinishedPulling="2026-05-26 10:11:18.854330985 +0000 UTC m=+68.646758987" observedRunningTime="2026-05-26 10:11:19.162692936 +0000 UTC m=+68.955120948" watchObservedRunningTime="2026-05-26 10:11:19.163809931 +0000 UTC m=+68.956237943" May 26 10:11:19.182376 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:19.182327 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6dwkx" podStartSLOduration=67.226365703 podStartE2EDuration="1m9.182314667s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:11:16.900180372 +0000 UTC m=+66.692608374" lastFinishedPulling="2026-05-26 10:11:18.856129346 +0000 UTC m=+68.648557338" observedRunningTime="2026-05-26 10:11:19.180681067 +0000 UTC m=+68.973109077" watchObservedRunningTime="2026-05-26 10:11:19.182314667 +0000 UTC m=+68.974742707" May 26 10:11:21.132787 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:21.132748 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7hhkd" event={"ID":"34fdc0ba-75ea-482b-98db-b28f7fe8da0d","Type":"ContainerStarted","Data":"95c69428498e61d5809c0fe1bae8788b8d104124a588c7758a903d00ad39d4b5"} May 26 10:11:21.133176 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:21.132926 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:11:21.148729 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:21.148681 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7hhkd" podStartSLOduration=67.865589113 podStartE2EDuration="1m11.148668295s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:11:16.922411549 +0000 UTC m=+66.714839542" lastFinishedPulling="2026-05-26 10:11:20.205490727 +0000 UTC m=+69.997918724" observedRunningTime="2026-05-26 10:11:21.147873671 +0000 UTC m=+70.940301682" watchObservedRunningTime="2026-05-26 10:11:21.148668295 +0000 UTC m=+70.941096305" May 26 10:11:24.057488 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.057378 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zpqlv"] May 26 10:11:24.059945 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.059924 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.062525 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.062487 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 10:11:24.063705 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.063686 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 10:11:24.063796 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.063760 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 10:11:24.063796 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.063781 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x2tcm\"" May 26 10:11:24.063796 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.063781 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 10:11:24.075469 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.075450 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zpqlv"] May 26 10:11:24.128974 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.128938 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f5745d4c6-2hg44"] May 26 10:11:24.176934 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.176906 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c0038da-6753-430f-9467-084fa830c07d-data-volume\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.177086 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.176941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0038da-6753-430f-9467-084fa830c07d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.177086 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.176967 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0038da-6753-430f-9467-084fa830c07d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.177086 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.177022 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htl8f\" (UniqueName: \"kubernetes.io/projected/0c0038da-6753-430f-9467-084fa830c07d-kube-api-access-htl8f\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.177086 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.177079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c0038da-6753-430f-9467-084fa830c07d-crio-socket\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.278299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.278270 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0038da-6753-430f-9467-084fa830c07d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.278299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.278301 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htl8f\" (UniqueName: \"kubernetes.io/projected/0c0038da-6753-430f-9467-084fa830c07d-kube-api-access-htl8f\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.278502 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.278324 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c0038da-6753-430f-9467-084fa830c07d-crio-socket\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.278502 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.278360 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c0038da-6753-430f-9467-084fa830c07d-data-volume\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.278502 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.278379 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0038da-6753-430f-9467-084fa830c07d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.278502 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.278482 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c0038da-6753-430f-9467-084fa830c07d-crio-socket\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.278794 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.278774 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c0038da-6753-430f-9467-084fa830c07d-data-volume\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.278975 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.278960 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c0038da-6753-430f-9467-084fa830c07d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.280506 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.280485 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c0038da-6753-430f-9467-084fa830c07d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.287123 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.287103 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htl8f\" (UniqueName: \"kubernetes.io/projected/0c0038da-6753-430f-9467-084fa830c07d-kube-api-access-htl8f\") pod \"insights-runtime-extractor-zpqlv\" (UID: \"0c0038da-6753-430f-9467-084fa830c07d\") " pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.368637 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.368553 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zpqlv" May 26 10:11:24.508152 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:24.508122 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zpqlv"] May 26 10:11:24.510724 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:24.510698 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0038da_6753_430f_9467_084fa830c07d.slice/crio-a283cac37209e242cd0dd19e871e5368d4fcc28e737b650060ad6f849a2d3e56 WatchSource:0}: Error finding container a283cac37209e242cd0dd19e871e5368d4fcc28e737b650060ad6f849a2d3e56: Status 404 returned error can't find the container with id a283cac37209e242cd0dd19e871e5368d4fcc28e737b650060ad6f849a2d3e56 May 26 10:11:25.147844 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:25.147806 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpqlv" event={"ID":"0c0038da-6753-430f-9467-084fa830c07d","Type":"ContainerStarted","Data":"c005661f1f1352eb9d261033ddb9e01e76d0a2923d5ebc316721391857b0249c"} May 26 10:11:25.147844 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:25.147845 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpqlv" event={"ID":"0c0038da-6753-430f-9467-084fa830c07d","Type":"ContainerStarted","Data":"a283cac37209e242cd0dd19e871e5368d4fcc28e737b650060ad6f849a2d3e56"} May 26 10:11:26.152920 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:26.152884 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpqlv" event={"ID":"0c0038da-6753-430f-9467-084fa830c07d","Type":"ContainerStarted","Data":"9d4ee431203fb6516d5f5f956ef6d35394990dd7e3bd95c1ea87f0bac454da55"} May 26 10:11:27.157298 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.157265 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpqlv" event={"ID":"0c0038da-6753-430f-9467-084fa830c07d","Type":"ContainerStarted","Data":"de2423bf2c25f731cef2ba10741a7c3214a602385944d23805ed730208a768d5"} May 26 10:11:27.177604 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.177559 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zpqlv" podStartSLOduration=1.001843768 podStartE2EDuration="3.177546211s" podCreationTimestamp="2026-05-26 10:11:24 +0000 UTC" firstStartedPulling="2026-05-26 10:11:24.55410477 +0000 UTC m=+74.346532763" lastFinishedPulling="2026-05-26 10:11:26.7298072 +0000 UTC m=+76.522235206" observedRunningTime="2026-05-26 10:11:27.176209996 +0000 UTC m=+76.968638006" watchObservedRunningTime="2026-05-26 10:11:27.177546211 +0000 UTC m=+76.969974238" May 26 10:11:27.779949 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.779922 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-668cc9657-sg8ks"] May 26 10:11:27.782735 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.782720 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:27.785274 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.785252 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 26 10:11:27.785274 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.785264 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 26 10:11:27.786388 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.786367 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 26 10:11:27.786388 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.786367 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 26 10:11:27.786583 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.786375 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 26 10:11:27.786583 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.786435 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 26 10:11:27.786583 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.786576 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5qmkg\"" May 26 10:11:27.786727 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.786609 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 26 10:11:27.793745 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.793725 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668cc9657-sg8ks"] May 26 10:11:27.904389 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.904351 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mrx\" (UniqueName: \"kubernetes.io/projected/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-kube-api-access-w6mrx\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:27.904389 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.904394 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-service-ca\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:27.904643 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.904418 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-serving-cert\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:27.904643 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.904469 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-oauth-config\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:27.904643 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.904493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-config\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:27.904643 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:27.904583 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-oauth-serving-cert\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.005125 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.005093 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-service-ca\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.005125 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.005127 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-serving-cert\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.005306 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.005162 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-oauth-config\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.005306 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.005188 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-config\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.005306 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.005215 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-oauth-serving-cert\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.005306 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.005260 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mrx\" (UniqueName: \"kubernetes.io/projected/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-kube-api-access-w6mrx\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.005927 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.005904 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-service-ca\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.006053 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.005998 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-oauth-serving-cert\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.006053 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.006015 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-config\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.007611 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.007592 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-serving-cert\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.007714 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.007680 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-oauth-config\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.014357 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.014333 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mrx\" (UniqueName: \"kubernetes.io/projected/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-kube-api-access-w6mrx\") pod \"console-668cc9657-sg8ks\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.091437 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.091365 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:28.216200 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:28.216174 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668cc9657-sg8ks"] May 26 10:11:28.218316 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:28.218291 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3f2844_92c5_45b6_a2cc_dd85e53b482d.slice/crio-79ca5e1a530d706eeb360579779cebd070f61f42f96f56b52e1c8a34de19c4ed WatchSource:0}: Error finding container 79ca5e1a530d706eeb360579779cebd070f61f42f96f56b52e1c8a34de19c4ed: Status 404 returned error can't find the container with id 79ca5e1a530d706eeb360579779cebd070f61f42f96f56b52e1c8a34de19c4ed May 26 10:11:29.131600 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:29.131572 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mp8fz" May 26 10:11:29.164427 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:29.164394 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cc9657-sg8ks" event={"ID":"8e3f2844-92c5-45b6-a2cc-dd85e53b482d","Type":"ContainerStarted","Data":"79ca5e1a530d706eeb360579779cebd070f61f42f96f56b52e1c8a34de19c4ed"} May 26 10:11:29.995748 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:29.995708 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q"] May 26 10:11:29.999094 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:29.999072 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.001571 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.001545 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 26 10:11:30.001940 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.001921 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 26 10:11:30.002828 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.002809 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 10:11:30.002950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.002898 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 10:11:30.002950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.002930 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 10:11:30.003073 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.002971 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5xphd\"" May 26 10:11:30.008009 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.007987 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q"] May 26 10:11:30.121684 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.121654 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcxtm\" (UniqueName: \"kubernetes.io/projected/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-kube-api-access-fcxtm\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.121684 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.121695 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.121915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.121834 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.121915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.121873 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.222248 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.222203 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxtm\" (UniqueName: \"kubernetes.io/projected/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-kube-api-access-fcxtm\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.222248 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.222253 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.222448 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.222321 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.222448 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.222351 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.222448 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:11:30.222384 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 26 10:11:30.222577 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:11:30.222450 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-tls podName:774adb71-53fd-4f5f-8279-c1c4d0ee8cd5 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:30.722429073 +0000 UTC m=+80.514857078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-xmf4q" (UID: "774adb71-53fd-4f5f-8279-c1c4d0ee8cd5") : secret "prometheus-operator-tls" not found May 26 10:11:30.223353 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.223325 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.225142 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.225106 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.235502 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.235483 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcxtm\" (UniqueName: \"kubernetes.io/projected/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-kube-api-access-fcxtm\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.726782 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.726741 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.729494 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.729459 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/774adb71-53fd-4f5f-8279-c1c4d0ee8cd5-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-xmf4q\" (UID: \"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:30.910318 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:30.910286 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" May 26 10:11:31.050720 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:31.050693 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q"] May 26 10:11:31.054453 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:31.054431 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774adb71_53fd_4f5f_8279_c1c4d0ee8cd5.slice/crio-054612777b39d0ff98c14d52de2cffbb1f0fd3ee3fa6a18b4063c9fb1ba1fc3c WatchSource:0}: Error finding container 054612777b39d0ff98c14d52de2cffbb1f0fd3ee3fa6a18b4063c9fb1ba1fc3c: Status 404 returned error can't find the container with id 054612777b39d0ff98c14d52de2cffbb1f0fd3ee3fa6a18b4063c9fb1ba1fc3c May 26 10:11:31.171744 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:31.171704 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cc9657-sg8ks" event={"ID":"8e3f2844-92c5-45b6-a2cc-dd85e53b482d","Type":"ContainerStarted","Data":"f30228d0d27375f9d9714541caf6f0b0a98bc960631b317015dad446a6ac26aa"} May 26 10:11:31.172815 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:31.172789 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" event={"ID":"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5","Type":"ContainerStarted","Data":"054612777b39d0ff98c14d52de2cffbb1f0fd3ee3fa6a18b4063c9fb1ba1fc3c"} May 26 10:11:31.190475 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:31.190435 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-668cc9657-sg8ks" podStartSLOduration=1.4307590000000001 podStartE2EDuration="4.190420631s" podCreationTimestamp="2026-05-26 10:11:27 +0000 UTC" firstStartedPulling="2026-05-26 10:11:28.220227647 +0000 UTC m=+78.012655636" lastFinishedPulling="2026-05-26 10:11:30.979889278 +0000 UTC m=+80.772317267" observedRunningTime="2026-05-26 10:11:31.189681938 +0000 UTC m=+80.982109951" watchObservedRunningTime="2026-05-26 10:11:31.190420631 +0000 UTC m=+80.982848642" May 26 10:11:33.182189 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:33.182146 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" event={"ID":"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5","Type":"ContainerStarted","Data":"df2ccc830a848c1c8ac55326ef83ca07e312ed8e4019b802bef4655bfe22b636"} May 26 10:11:33.182582 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:33.182194 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" event={"ID":"774adb71-53fd-4f5f-8279-c1c4d0ee8cd5","Type":"ContainerStarted","Data":"6658244f820b38641736dc072d6eb81c6616693512bc5c0ca8c0b36485672d92"} May 26 10:11:33.200900 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:33.200856 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-xmf4q" podStartSLOduration=2.785728182 podStartE2EDuration="4.200843558s" podCreationTimestamp="2026-05-26 10:11:29 +0000 UTC" firstStartedPulling="2026-05-26 10:11:31.056199592 +0000 UTC m=+80.848627580" lastFinishedPulling="2026-05-26 10:11:32.471314966 +0000 UTC m=+82.263742956" observedRunningTime="2026-05-26 10:11:33.199029543 +0000 UTC m=+82.991457537" watchObservedRunningTime="2026-05-26 10:11:33.200843558 +0000 UTC m=+82.993271570" May 26 10:11:34.134239 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:34.134215 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:11:35.423278 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.423246 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w"] May 26 10:11:35.425347 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.425330 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.429574 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.429550 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 26 10:11:35.433197 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.433180 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 26 10:11:35.434528 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.433182 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 26 10:11:35.434832 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.433703 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-q85mw\"" May 26 10:11:35.446950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.446928 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w"] May 26 10:11:35.451459 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.451434 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hx5jn"] May 26 10:11:35.454240 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.454221 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.456617 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.456598 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 10:11:35.456700 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.456600 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 10:11:35.456978 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.456962 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 10:11:35.457194 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.457066 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p5hdm\"" May 26 10:11:35.561708 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.561677 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.561878 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.561725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-wtmp\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.561878 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.561756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.561878 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.561800 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn67t\" (UniqueName: \"kubernetes.io/projected/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-api-access-xn67t\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.561878 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.561865 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-sys\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.562097 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.561913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.562097 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.561949 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-accelerators-collector-config\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.562097 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.561983 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.562097 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.562010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-root\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.562097 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.562045 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.562097 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.562079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-textfile\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.562355 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.562151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg299\" (UniqueName: \"kubernetes.io/projected/8c12b49b-b0ac-4bcf-9fea-cd284a484830-kube-api-access-lg299\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.562355 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.562179 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.562355 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.562212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-tls\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.562355 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.562243 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c12b49b-b0ac-4bcf-9fea-cd284a484830-metrics-client-ca\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663092 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663051 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-textfile\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663092 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663089 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lg299\" (UniqueName: \"kubernetes.io/projected/8c12b49b-b0ac-4bcf-9fea-cd284a484830-kube-api-access-lg299\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663112 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.663334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663159 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-tls\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663177 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c12b49b-b0ac-4bcf-9fea-cd284a484830-metrics-client-ca\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663204 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663237 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-wtmp\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663263 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.663334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663294 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn67t\" (UniqueName: \"kubernetes.io/projected/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-api-access-xn67t\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.663334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663320 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-sys\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663384 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.663738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663415 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-accelerators-collector-config\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663451 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.663738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663492 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-root\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663496 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-textfile\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.663738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663544 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.663738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663714 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.664062 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663862 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-wtmp\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.664062 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.663996 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.664950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.664296 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-root\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.664950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.664319 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.664950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.664353 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c12b49b-b0ac-4bcf-9fea-cd284a484830-sys\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.664950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.664853 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c12b49b-b0ac-4bcf-9fea-cd284a484830-metrics-client-ca\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.664950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.664907 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-accelerators-collector-config\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.666117 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.666092 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.666381 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.666359 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.666451 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.666394 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c12b49b-b0ac-4bcf-9fea-cd284a484830-node-exporter-tls\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.666797 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.666777 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.673039 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.672985 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg299\" (UniqueName: \"kubernetes.io/projected/8c12b49b-b0ac-4bcf-9fea-cd284a484830-kube-api-access-lg299\") pod \"node-exporter-hx5jn\" (UID: \"8c12b49b-b0ac-4bcf-9fea-cd284a484830\") " pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.673675 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.673620 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn67t\" (UniqueName: \"kubernetes.io/projected/7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1-kube-api-access-xn67t\") pod \"kube-state-metrics-54fd6bc5c4-nwc4w\" (UID: \"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.737593 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.737568 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" May 26 10:11:35.764656 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.764626 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hx5jn" May 26 10:11:35.774709 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:35.774682 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c12b49b_b0ac_4bcf_9fea_cd284a484830.slice/crio-fb19cbe2fee48be7533d43b52aa6f942c08b050df9c8bd539a0a5fdf4969d25a WatchSource:0}: Error finding container fb19cbe2fee48be7533d43b52aa6f942c08b050df9c8bd539a0a5fdf4969d25a: Status 404 returned error can't find the container with id fb19cbe2fee48be7533d43b52aa6f942c08b050df9c8bd539a0a5fdf4969d25a May 26 10:11:35.875056 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:35.875037 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w"] May 26 10:11:35.877528 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:35.877492 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcb9bf8_2b07_4ade_ab8a_5ab89b68eab1.slice/crio-c95ef33cbb0167df5d2bd1769865cfd91b309fa82e886539d00516e9ae007d51 WatchSource:0}: Error finding container c95ef33cbb0167df5d2bd1769865cfd91b309fa82e886539d00516e9ae007d51: Status 404 returned error can't find the container with id c95ef33cbb0167df5d2bd1769865cfd91b309fa82e886539d00516e9ae007d51 May 26 10:11:36.195767 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:36.195725 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hx5jn" event={"ID":"8c12b49b-b0ac-4bcf-9fea-cd284a484830","Type":"ContainerStarted","Data":"fb19cbe2fee48be7533d43b52aa6f942c08b050df9c8bd539a0a5fdf4969d25a"} May 26 10:11:36.198783 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:36.198757 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" event={"ID":"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1","Type":"ContainerStarted","Data":"c95ef33cbb0167df5d2bd1769865cfd91b309fa82e886539d00516e9ae007d51"} May 26 10:11:37.203269 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:37.203238 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hx5jn" event={"ID":"8c12b49b-b0ac-4bcf-9fea-cd284a484830","Type":"ContainerStarted","Data":"c1f335a7eec65b25e50b3da9b61881f871d6e7fa6bcfd43713c9911e14c14571"} May 26 10:11:38.091913 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.091877 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:38.091913 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.091917 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:38.096716 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.096694 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:38.207571 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.207535 2557 generic.go:358] "Generic (PLEG): container finished" podID="8c12b49b-b0ac-4bcf-9fea-cd284a484830" containerID="c1f335a7eec65b25e50b3da9b61881f871d6e7fa6bcfd43713c9911e14c14571" exitCode=0 May 26 10:11:38.207938 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.207583 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hx5jn" event={"ID":"8c12b49b-b0ac-4bcf-9fea-cd284a484830","Type":"ContainerDied","Data":"c1f335a7eec65b25e50b3da9b61881f871d6e7fa6bcfd43713c9911e14c14571"} May 26 10:11:38.209571 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.209544 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" event={"ID":"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1","Type":"ContainerStarted","Data":"cc84977f6e5b5e75a9b5c4c2b5f141186b9e9ef1d930dbd0cddf44d4131787fe"} May 26 10:11:38.209662 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.209577 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" event={"ID":"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1","Type":"ContainerStarted","Data":"3f565d03eb9576ee495bc5427fc755b429f008522f28e12ef2b0285258c3d0c8"} May 26 10:11:38.209662 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.209593 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" event={"ID":"7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1","Type":"ContainerStarted","Data":"a2a7c305381e5c7aaf9fbfb2bc2ae0e06b7e36a31ac9bb154c54ff7256032a0e"} May 26 10:11:38.213871 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.213853 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668cc9657-sg8ks" May 26 10:11:38.244695 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:38.244650 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-nwc4w" podStartSLOduration=1.894904664 podStartE2EDuration="3.244634526s" podCreationTimestamp="2026-05-26 10:11:35 +0000 UTC" firstStartedPulling="2026-05-26 10:11:35.879456952 +0000 UTC m=+85.671884942" lastFinishedPulling="2026-05-26 10:11:37.229186816 +0000 UTC m=+87.021614804" observedRunningTime="2026-05-26 10:11:38.243504292 +0000 UTC m=+88.035932304" watchObservedRunningTime="2026-05-26 10:11:38.244634526 +0000 UTC m=+88.037062536" May 26 10:11:39.217237 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.217198 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hx5jn" event={"ID":"8c12b49b-b0ac-4bcf-9fea-cd284a484830","Type":"ContainerStarted","Data":"7ebf732007c376e7c998bfc314fe711d53d7eb9e356c096c568e99c6d069604e"} May 26 10:11:39.217616 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.217242 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hx5jn" event={"ID":"8c12b49b-b0ac-4bcf-9fea-cd284a484830","Type":"ContainerStarted","Data":"b3d0cb19ff7a064e710d64d17227232a29058c23b32b5f42f33f139eb14de525"} May 26 10:11:39.238298 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.238224 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hx5jn" podStartSLOduration=3.230272869 podStartE2EDuration="4.238211422s" podCreationTimestamp="2026-05-26 10:11:35 +0000 UTC" firstStartedPulling="2026-05-26 10:11:35.776708801 +0000 UTC m=+85.569136793" lastFinishedPulling="2026-05-26 10:11:36.784647341 +0000 UTC m=+86.577075346" observedRunningTime="2026-05-26 10:11:39.23662155 +0000 UTC m=+89.029049587" watchObservedRunningTime="2026-05-26 10:11:39.238211422 +0000 UTC m=+89.030639432" May 26 10:11:39.652023 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.651987 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b6cbcc989-9zmz7"] May 26 10:11:39.655713 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.655695 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.659536 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.659433 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rx9dq\"" May 26 10:11:39.659536 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.659488 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 26 10:11:39.659536 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.659503 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 10:11:39.659536 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.659491 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ftjs858vsbc6f\"" May 26 10:11:39.659820 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.659542 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 26 10:11:39.659820 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.659493 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 26 10:11:39.664788 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.664764 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b6cbcc989-9zmz7"] May 26 10:11:39.797262 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.797231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-client-ca-bundle\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.797388 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.797280 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-secret-metrics-server-client-certs\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.797388 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.797310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f408e994-de5c-4d74-a12d-e73ce413f95f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.797388 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.797330 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f408e994-de5c-4d74-a12d-e73ce413f95f-metrics-server-audit-profiles\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.797494 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.797407 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-secret-metrics-server-tls\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.797494 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.797434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f408e994-de5c-4d74-a12d-e73ce413f95f-audit-log\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.797494 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.797451 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngd6\" (UniqueName: \"kubernetes.io/projected/f408e994-de5c-4d74-a12d-e73ce413f95f-kube-api-access-tngd6\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.898485 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.898451 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-secret-metrics-server-client-certs\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.898651 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.898495 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f408e994-de5c-4d74-a12d-e73ce413f95f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.898651 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.898533 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f408e994-de5c-4d74-a12d-e73ce413f95f-metrics-server-audit-profiles\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.898780 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.898657 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-secret-metrics-server-tls\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.898780 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.898690 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f408e994-de5c-4d74-a12d-e73ce413f95f-audit-log\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.898780 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.898711 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tngd6\" (UniqueName: \"kubernetes.io/projected/f408e994-de5c-4d74-a12d-e73ce413f95f-kube-api-access-tngd6\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.898780 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.898759 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-client-ca-bundle\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.899123 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.899093 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f408e994-de5c-4d74-a12d-e73ce413f95f-audit-log\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.899302 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.899281 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f408e994-de5c-4d74-a12d-e73ce413f95f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.899483 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.899465 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f408e994-de5c-4d74-a12d-e73ce413f95f-metrics-server-audit-profiles\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.901090 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.901061 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-secret-metrics-server-tls\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.901196 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.901124 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-client-ca-bundle\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.901196 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.901167 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f408e994-de5c-4d74-a12d-e73ce413f95f-secret-metrics-server-client-certs\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.906418 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.906365 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngd6\" (UniqueName: \"kubernetes.io/projected/f408e994-de5c-4d74-a12d-e73ce413f95f-kube-api-access-tngd6\") pod \"metrics-server-7b6cbcc989-9zmz7\" (UID: \"f408e994-de5c-4d74-a12d-e73ce413f95f\") " pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:39.965993 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:39.965961 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:40.089731 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.089698 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b6cbcc989-9zmz7"] May 26 10:11:40.092810 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:40.092777 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf408e994_de5c_4d74_a12d_e73ce413f95f.slice/crio-7f9e955dbaa55de2436797725cccd275cd06768a4699071e452e1032dcfe4b30 WatchSource:0}: Error finding container 7f9e955dbaa55de2436797725cccd275cd06768a4699071e452e1032dcfe4b30: Status 404 returned error can't find the container with id 7f9e955dbaa55de2436797725cccd275cd06768a4699071e452e1032dcfe4b30 May 26 10:11:40.129279 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.129252 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl"] May 26 10:11:40.134279 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.134260 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" May 26 10:11:40.136832 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.136813 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 26 10:11:40.136939 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.136833 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-vpwk6\"" May 26 10:11:40.139963 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.139938 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl"] May 26 10:11:40.201244 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.201165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa4f6692-d0c8-4b78-ac99-9f2c1e69702a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4m9cl\" (UID: \"fa4f6692-d0c8-4b78-ac99-9f2c1e69702a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" May 26 10:11:40.221196 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.221168 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" event={"ID":"f408e994-de5c-4d74-a12d-e73ce413f95f","Type":"ContainerStarted","Data":"7f9e955dbaa55de2436797725cccd275cd06768a4699071e452e1032dcfe4b30"} May 26 10:11:40.302576 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.302547 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa4f6692-d0c8-4b78-ac99-9f2c1e69702a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4m9cl\" (UID: \"fa4f6692-d0c8-4b78-ac99-9f2c1e69702a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" May 26 10:11:40.302743 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:11:40.302690 2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 26 10:11:40.302795 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:11:40.302769 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4f6692-d0c8-4b78-ac99-9f2c1e69702a-monitoring-plugin-cert podName:fa4f6692-d0c8-4b78-ac99-9f2c1e69702a nodeName:}" failed. No retries permitted until 2026-05-26 10:11:40.802747853 +0000 UTC m=+90.595175843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fa4f6692-d0c8-4b78-ac99-9f2c1e69702a-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-4m9cl" (UID: "fa4f6692-d0c8-4b78-ac99-9f2c1e69702a") : secret "monitoring-plugin-cert" not found May 26 10:11:40.804978 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.804948 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa4f6692-d0c8-4b78-ac99-9f2c1e69702a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4m9cl\" (UID: \"fa4f6692-d0c8-4b78-ac99-9f2c1e69702a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" May 26 10:11:40.807282 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:40.807264 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fa4f6692-d0c8-4b78-ac99-9f2c1e69702a-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-4m9cl\" (UID: \"fa4f6692-d0c8-4b78-ac99-9f2c1e69702a\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" May 26 10:11:41.044616 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.044576 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" May 26 10:11:41.187395 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.187366 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl"] May 26 10:11:41.569600 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:41.569561 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4f6692_d0c8_4b78_ac99_9f2c1e69702a.slice/crio-c53b9bc6349c68a84b69fdcb1490fff6901cf15be887328e23aab4489b444270 WatchSource:0}: Error finding container c53b9bc6349c68a84b69fdcb1490fff6901cf15be887328e23aab4489b444270: Status 404 returned error can't find the container with id c53b9bc6349c68a84b69fdcb1490fff6901cf15be887328e23aab4489b444270 May 26 10:11:41.663834 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.663806 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:11:41.669118 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.669093 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.671861 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.671842 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 10:11:41.672002 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.671982 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 10:11:41.672219 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.672186 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 10:11:41.672314 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.672250 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 10:11:41.672314 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.672259 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 10:11:41.672421 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.672265 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 10:11:41.672573 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.672558 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 10:11:41.675612 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.673246 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1idndv03t96ok\"" May 26 10:11:41.675612 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.673459 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 10:11:41.675612 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.673718 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 10:11:41.675612 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.675291 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 10:11:41.675612 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.675442 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 10:11:41.675612 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.675486 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lwngp\"" May 26 10:11:41.676473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.676459 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 10:11:41.682971 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.682843 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:11:41.815479 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.815442 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.815764 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.815744 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.815958 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.815943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816059 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816029 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816183 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816074 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816183 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816100 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816183 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816117 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816183 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816358 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816358 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816294 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqfm5\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-kube-api-access-rqfm5\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816358 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816340 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816467 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816365 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816467 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816384 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816467 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816467 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816424 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816467 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816449 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816696 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.816696 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.816500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.917652 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.917616 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.917652 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.917657 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.917915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.917678 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.917915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.917699 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.917915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.917749 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.917915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.917778 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.917915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.917806 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918149 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918035 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfm5\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-kube-api-access-rqfm5\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918149 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918089 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918149 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918125 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918286 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918156 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918286 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918183 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918286 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918218 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918286 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918249 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918480 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918287 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918480 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918324 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918480 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918360 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918480 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918394 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918699 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918482 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.918762 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.918734 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.919044 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.919013 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.919366 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.919342 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.920005 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.919981 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.921181 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.921086 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.921292 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.921265 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.922248 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.921698 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.922248 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.921948 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.922474 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.922451 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.923388 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.923360 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.924002 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.923857 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.924002 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.923959 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.924701 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.924630 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.925219 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.924902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.925219 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.925130 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.927300 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.927273 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.927470 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.927454 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqfm5\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-kube-api-access-rqfm5\") pod \"prometheus-k8s-0\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:41.982406 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:41.982378 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:42.158442 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:42.158411 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:11:42.160861 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:11:42.160832 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4347f21_82bc_4c46_8c3a_d07c77e50f54.slice/crio-f38db1f2b2633ab731e8ecb4056491487eb9fd94bef6c37975f66498818125c5 WatchSource:0}: Error finding container f38db1f2b2633ab731e8ecb4056491487eb9fd94bef6c37975f66498818125c5: Status 404 returned error can't find the container with id f38db1f2b2633ab731e8ecb4056491487eb9fd94bef6c37975f66498818125c5 May 26 10:11:42.227545 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:42.227457 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" event={"ID":"f408e994-de5c-4d74-a12d-e73ce413f95f","Type":"ContainerStarted","Data":"bb2815a63e9ae6e75630acbfade0606cda9c6c87f538cc9ef16f670a0a5c2401"} May 26 10:11:42.228789 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:42.228764 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerStarted","Data":"f38db1f2b2633ab731e8ecb4056491487eb9fd94bef6c37975f66498818125c5"} May 26 10:11:42.230009 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:42.229982 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" event={"ID":"fa4f6692-d0c8-4b78-ac99-9f2c1e69702a","Type":"ContainerStarted","Data":"c53b9bc6349c68a84b69fdcb1490fff6901cf15be887328e23aab4489b444270"} May 26 10:11:42.248745 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:42.248693 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" podStartSLOduration=1.722958231 podStartE2EDuration="3.248679513s" podCreationTimestamp="2026-05-26 10:11:39 +0000 UTC" firstStartedPulling="2026-05-26 10:11:40.095209961 +0000 UTC m=+89.887637951" lastFinishedPulling="2026-05-26 10:11:41.62093123 +0000 UTC m=+91.413359233" observedRunningTime="2026-05-26 10:11:42.247155142 +0000 UTC m=+92.039583154" watchObservedRunningTime="2026-05-26 10:11:42.248679513 +0000 UTC m=+92.041107523" May 26 10:11:44.238103 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:44.238069 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" exitCode=0 May 26 10:11:44.238531 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:44.238148 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerDied","Data":"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96"} May 26 10:11:44.239407 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:44.239382 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" event={"ID":"fa4f6692-d0c8-4b78-ac99-9f2c1e69702a","Type":"ContainerStarted","Data":"a0aa0e85e94418d0cce5574c6524446fedb32b49b1d226a165a9ea229603e145"} May 26 10:11:44.239634 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:44.239615 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" May 26 10:11:44.244664 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:44.244643 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" May 26 10:11:44.279243 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:44.279188 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-4m9cl" podStartSLOduration=2.4516042000000002 podStartE2EDuration="4.279174788s" podCreationTimestamp="2026-05-26 10:11:40 +0000 UTC" firstStartedPulling="2026-05-26 10:11:41.571764556 +0000 UTC m=+91.364192549" lastFinishedPulling="2026-05-26 10:11:43.399335136 +0000 UTC m=+93.191763137" observedRunningTime="2026-05-26 10:11:44.278690869 +0000 UTC m=+94.071118881" watchObservedRunningTime="2026-05-26 10:11:44.279174788 +0000 UTC m=+94.071602801" May 26 10:11:47.251534 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:47.251479 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerStarted","Data":"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01"} May 26 10:11:47.251867 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:47.251539 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerStarted","Data":"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0"} May 26 10:11:49.151252 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.151201 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" podUID="36c19326-213b-40b3-a81a-225a4701233c" containerName="registry" containerID="cri-o://a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2" gracePeriod=30 May 26 10:11:49.261047 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.261015 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerStarted","Data":"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207"} May 26 10:11:49.261047 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.261048 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerStarted","Data":"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04"} May 26 10:11:49.261251 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.261057 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerStarted","Data":"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6"} May 26 10:11:49.261251 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.261065 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerStarted","Data":"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131"} May 26 10:11:49.295132 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.295015 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.63752228 podStartE2EDuration="8.294994666s" podCreationTimestamp="2026-05-26 10:11:41 +0000 UTC" firstStartedPulling="2026-05-26 10:11:42.162952773 +0000 UTC m=+91.955380763" lastFinishedPulling="2026-05-26 10:11:48.820425156 +0000 UTC m=+98.612853149" observedRunningTime="2026-05-26 10:11:49.293375311 +0000 UTC m=+99.085803321" watchObservedRunningTime="2026-05-26 10:11:49.294994666 +0000 UTC m=+99.087422676" May 26 10:11:49.400216 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.400196 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:11:49.492634 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.492600 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") pod \"36c19326-213b-40b3-a81a-225a4701233c\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " May 26 10:11:49.492799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.492650 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36c19326-213b-40b3-a81a-225a4701233c-ca-trust-extracted\") pod \"36c19326-213b-40b3-a81a-225a4701233c\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " May 26 10:11:49.492799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.492676 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-installation-pull-secrets\") pod \"36c19326-213b-40b3-a81a-225a4701233c\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " May 26 10:11:49.492799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.492709 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwp4l\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-kube-api-access-xwp4l\") pod \"36c19326-213b-40b3-a81a-225a4701233c\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " May 26 10:11:49.492799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.492736 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-bound-sa-token\") pod \"36c19326-213b-40b3-a81a-225a4701233c\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " May 26 10:11:49.492799 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.492795 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-trusted-ca\") pod \"36c19326-213b-40b3-a81a-225a4701233c\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " May 26 10:11:49.493060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.492822 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-registry-certificates\") pod \"36c19326-213b-40b3-a81a-225a4701233c\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " May 26 10:11:49.493060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.492848 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-image-registry-private-configuration\") pod \"36c19326-213b-40b3-a81a-225a4701233c\" (UID: \"36c19326-213b-40b3-a81a-225a4701233c\") " May 26 10:11:49.493663 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.493598 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "36c19326-213b-40b3-a81a-225a4701233c" (UID: "36c19326-213b-40b3-a81a-225a4701233c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:11:49.493663 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.493620 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "36c19326-213b-40b3-a81a-225a4701233c" (UID: "36c19326-213b-40b3-a81a-225a4701233c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:11:49.495665 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.495637 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "36c19326-213b-40b3-a81a-225a4701233c" (UID: "36c19326-213b-40b3-a81a-225a4701233c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:11:49.495780 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.495742 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "36c19326-213b-40b3-a81a-225a4701233c" (UID: "36c19326-213b-40b3-a81a-225a4701233c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:11:49.495780 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.495719 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "36c19326-213b-40b3-a81a-225a4701233c" (UID: "36c19326-213b-40b3-a81a-225a4701233c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:11:49.495780 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.495752 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "36c19326-213b-40b3-a81a-225a4701233c" (UID: "36c19326-213b-40b3-a81a-225a4701233c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:11:49.495899 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.495813 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-kube-api-access-xwp4l" (OuterVolumeSpecName: "kube-api-access-xwp4l") pod "36c19326-213b-40b3-a81a-225a4701233c" (UID: "36c19326-213b-40b3-a81a-225a4701233c"). InnerVolumeSpecName "kube-api-access-xwp4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:11:49.501610 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.501582 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c19326-213b-40b3-a81a-225a4701233c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "36c19326-213b-40b3-a81a-225a4701233c" (UID: "36c19326-213b-40b3-a81a-225a4701233c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 10:11:49.594327 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.594301 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36c19326-213b-40b3-a81a-225a4701233c-ca-trust-extracted\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:11:49.594327 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.594323 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-installation-pull-secrets\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:11:49.594327 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.594333 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwp4l\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-kube-api-access-xwp4l\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:11:49.594539 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.594344 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-bound-sa-token\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:11:49.594539 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.594354 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-trusted-ca\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:11:49.594539 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.594362 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36c19326-213b-40b3-a81a-225a4701233c-registry-certificates\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:11:49.594539 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.594371 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36c19326-213b-40b3-a81a-225a4701233c-image-registry-private-configuration\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:11:49.594539 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:49.594381 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36c19326-213b-40b3-a81a-225a4701233c-registry-tls\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:11:50.268966 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.268932 2557 generic.go:358] "Generic (PLEG): container finished" podID="36c19326-213b-40b3-a81a-225a4701233c" containerID="a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2" exitCode=0 May 26 10:11:50.269417 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.269016 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" event={"ID":"36c19326-213b-40b3-a81a-225a4701233c","Type":"ContainerDied","Data":"a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2"} May 26 10:11:50.269417 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.269064 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" event={"ID":"36c19326-213b-40b3-a81a-225a4701233c","Type":"ContainerDied","Data":"9b683fb4e6c0a7d161b3e239e286c17814a36d698a6c63cb8790a5ac90e1f02f"} May 26 10:11:50.269417 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.269030 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f5745d4c6-2hg44" May 26 10:11:50.269417 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.269086 2557 scope.go:117] "RemoveContainer" containerID="a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2" May 26 10:11:50.278379 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.278363 2557 scope.go:117] "RemoveContainer" containerID="a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2" May 26 10:11:50.278649 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:11:50.278630 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2\": container with ID starting with a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2 not found: ID does not exist" containerID="a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2" May 26 10:11:50.278706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.278657 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2"} err="failed to get container status \"a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2\": rpc error: code = NotFound desc = could not find container \"a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2\": container with ID starting with a1a51c51d684c7ef1e2a66b8d43915d1e5078332b48094c2e3067e2b2e7662b2 not found: ID does not exist" May 26 10:11:50.290003 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.289984 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f5745d4c6-2hg44"] May 26 10:11:50.293848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.293830 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f5745d4c6-2hg44"] May 26 10:11:50.829574 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:50.829539 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c19326-213b-40b3-a81a-225a4701233c" path="/var/lib/kubelet/pods/36c19326-213b-40b3-a81a-225a4701233c/volumes" May 26 10:11:51.983010 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:51.982982 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:11:52.138850 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:52.138823 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7hhkd" May 26 10:11:59.966247 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:59.966215 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:11:59.966709 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:11:59.966260 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:12:02.148906 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:02.148873 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668cc9657-sg8ks"] May 26 10:12:19.971456 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:19.971423 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:12:19.975351 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:19.975330 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b6cbcc989-9zmz7" May 26 10:12:27.168240 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.168199 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-668cc9657-sg8ks" podUID="8e3f2844-92c5-45b6-a2cc-dd85e53b482d" containerName="console" containerID="cri-o://f30228d0d27375f9d9714541caf6f0b0a98bc960631b317015dad446a6ac26aa" gracePeriod=15 May 26 10:12:27.376084 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.376057 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-668cc9657-sg8ks_8e3f2844-92c5-45b6-a2cc-dd85e53b482d/console/0.log" May 26 10:12:27.376244 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.376092 2557 generic.go:358] "Generic (PLEG): container finished" podID="8e3f2844-92c5-45b6-a2cc-dd85e53b482d" containerID="f30228d0d27375f9d9714541caf6f0b0a98bc960631b317015dad446a6ac26aa" exitCode=2 May 26 10:12:27.376244 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.376124 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cc9657-sg8ks" event={"ID":"8e3f2844-92c5-45b6-a2cc-dd85e53b482d","Type":"ContainerDied","Data":"f30228d0d27375f9d9714541caf6f0b0a98bc960631b317015dad446a6ac26aa"} May 26 10:12:27.410087 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.410068 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-668cc9657-sg8ks_8e3f2844-92c5-45b6-a2cc-dd85e53b482d/console/0.log" May 26 10:12:27.410187 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.410120 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cc9657-sg8ks" May 26 10:12:27.495621 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.495549 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-oauth-serving-cert\") pod \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " May 26 10:12:27.495621 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.495584 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6mrx\" (UniqueName: \"kubernetes.io/projected/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-kube-api-access-w6mrx\") pod \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " May 26 10:12:27.495621 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.495613 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-oauth-config\") pod \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " May 26 10:12:27.495864 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.495647 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-config\") pod \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " May 26 10:12:27.495864 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.495820 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-serving-cert\") pod \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " May 26 10:12:27.495978 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.495880 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-service-ca\") pod \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\" (UID: \"8e3f2844-92c5-45b6-a2cc-dd85e53b482d\") " May 26 10:12:27.496045 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.496021 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-config" (OuterVolumeSpecName: "console-config") pod "8e3f2844-92c5-45b6-a2cc-dd85e53b482d" (UID: "8e3f2844-92c5-45b6-a2cc-dd85e53b482d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:12:27.496098 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.496031 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e3f2844-92c5-45b6-a2cc-dd85e53b482d" (UID: "8e3f2844-92c5-45b6-a2cc-dd85e53b482d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:12:27.496237 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.496223 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-oauth-serving-cert\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:12:27.496280 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.496240 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-config\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:12:27.496280 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.496247 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e3f2844-92c5-45b6-a2cc-dd85e53b482d" (UID: "8e3f2844-92c5-45b6-a2cc-dd85e53b482d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:12:27.497990 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.497964 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e3f2844-92c5-45b6-a2cc-dd85e53b482d" (UID: "8e3f2844-92c5-45b6-a2cc-dd85e53b482d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:12:27.498192 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.498170 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e3f2844-92c5-45b6-a2cc-dd85e53b482d" (UID: "8e3f2844-92c5-45b6-a2cc-dd85e53b482d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:12:27.498292 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.498196 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-kube-api-access-w6mrx" (OuterVolumeSpecName: "kube-api-access-w6mrx") pod "8e3f2844-92c5-45b6-a2cc-dd85e53b482d" (UID: "8e3f2844-92c5-45b6-a2cc-dd85e53b482d"). InnerVolumeSpecName "kube-api-access-w6mrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:12:27.596744 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.596715 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-service-ca\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:12:27.596744 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.596743 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6mrx\" (UniqueName: \"kubernetes.io/projected/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-kube-api-access-w6mrx\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:12:27.596920 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.596754 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-oauth-config\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:12:27.596920 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:27.596763 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e3f2844-92c5-45b6-a2cc-dd85e53b482d-console-serving-cert\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:12:28.379572 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:28.379547 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-668cc9657-sg8ks_8e3f2844-92c5-45b6-a2cc-dd85e53b482d/console/0.log" May 26 10:12:28.379952 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:28.379663 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cc9657-sg8ks" event={"ID":"8e3f2844-92c5-45b6-a2cc-dd85e53b482d","Type":"ContainerDied","Data":"79ca5e1a530d706eeb360579779cebd070f61f42f96f56b52e1c8a34de19c4ed"} May 26 10:12:28.379952 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:28.379677 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cc9657-sg8ks" May 26 10:12:28.379952 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:28.379706 2557 scope.go:117] "RemoveContainer" containerID="f30228d0d27375f9d9714541caf6f0b0a98bc960631b317015dad446a6ac26aa" May 26 10:12:28.400439 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:28.400398 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668cc9657-sg8ks"] May 26 10:12:28.403712 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:28.403690 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-668cc9657-sg8ks"] May 26 10:12:28.829382 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:28.829307 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e3f2844-92c5-45b6-a2cc-dd85e53b482d" path="/var/lib/kubelet/pods/8e3f2844-92c5-45b6-a2cc-dd85e53b482d/volumes" May 26 10:12:41.983108 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:41.983060 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:12:42.001101 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:42.001079 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:12:42.431658 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:12:42.431630 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.045277 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.045191 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:13:00.045795 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.045720 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="prometheus" containerID="cri-o://d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" gracePeriod=600 May 26 10:13:00.045856 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.045750 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" gracePeriod=600 May 26 10:13:00.045909 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.045851 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="config-reloader" containerID="cri-o://87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" gracePeriod=600 May 26 10:13:00.045960 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.045914 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy-web" containerID="cri-o://ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" gracePeriod=600 May 26 10:13:00.046010 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.045936 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy" containerID="cri-o://80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" gracePeriod=600 May 26 10:13:00.046010 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.045913 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="thanos-sidecar" containerID="cri-o://e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" gracePeriod=600 May 26 10:13:00.287945 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.287923 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.359732 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359643 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-tls\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359732 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359680 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-rulefiles-0\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359732 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359715 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-trusted-ca-bundle\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359741 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-db\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359765 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-grpc-tls\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359782 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-kube-rbac-proxy\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359810 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-serving-certs-ca-bundle\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359838 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-web-config\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359866 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config-out\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359900 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-tls-assets\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359933 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqfm5\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-kube-api-access-rqfm5\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.359988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.359963 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.360433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360000 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.360433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360032 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-thanos-prometheus-http-client-file\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.360433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360059 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-metrics-client-certs\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.360433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360084 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.360433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360105 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:13:00.360433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360128 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-kubelet-serving-ca-bundle\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.360433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360168 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-metrics-client-ca\") pod \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\" (UID: \"d4347f21-82bc-4c46-8c3a-d07c77e50f54\") " May 26 10:13:00.360433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360390 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.360847 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360752 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:13:00.360847 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.360758 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 10:13:00.361771 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.361740 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:13:00.361964 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.361935 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:13:00.362492 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.362463 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:13:00.363133 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.363085 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.364375 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.364329 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config-out" (OuterVolumeSpecName: "config-out") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 10:13:00.364763 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.364708 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config" (OuterVolumeSpecName: "config") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.364763 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.364720 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.365197 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.365168 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-kube-api-access-rqfm5" (OuterVolumeSpecName: "kube-api-access-rqfm5") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "kube-api-access-rqfm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:13:00.365288 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.365202 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.365419 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.365356 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.365494 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.365436 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.365494 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.365467 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:13:00.365971 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.365949 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.366441 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.366413 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.374188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.374167 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-web-config" (OuterVolumeSpecName: "web-config") pod "d4347f21-82bc-4c46-8c3a-d07c77e50f54" (UID: "d4347f21-82bc-4c46-8c3a-d07c77e50f54"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:13:00.461255 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461222 2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461255 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461248 2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-metrics-client-certs\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461255 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461260 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461271 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461280 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-metrics-client-ca\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461289 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461297 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461307 2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-prometheus-k8s-db\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461316 2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-grpc-tls\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461325 2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-kube-rbac-proxy\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461333 2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4347f21-82bc-4c46-8c3a-d07c77e50f54-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461342 2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-web-config\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461350 2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config-out\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461357 2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-tls-assets\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461366 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqfm5\" (UniqueName: \"kubernetes.io/projected/d4347f21-82bc-4c46-8c3a-d07c77e50f54-kube-api-access-rqfm5\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461375 2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-config\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.461473 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.461385 2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4347f21-82bc-4c46-8c3a-d07c77e50f54-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:13:00.467837 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467807 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" exitCode=0 May 26 10:13:00.467837 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467835 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" exitCode=0 May 26 10:13:00.467996 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467846 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" exitCode=0 May 26 10:13:00.467996 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467856 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" exitCode=0 May 26 10:13:00.467996 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467865 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" exitCode=0 May 26 10:13:00.467996 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467873 2557 generic.go:358] "Generic (PLEG): container finished" podID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" exitCode=0 May 26 10:13:00.467996 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467891 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerDied","Data":"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207"} May 26 10:13:00.467996 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467931 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.467996 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467943 2557 scope.go:117] "RemoveContainer" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" May 26 10:13:00.468245 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.467932 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerDied","Data":"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04"} May 26 10:13:00.468245 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.468074 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerDied","Data":"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6"} May 26 10:13:00.468245 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.468091 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerDied","Data":"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131"} May 26 10:13:00.468245 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.468106 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerDied","Data":"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01"} May 26 10:13:00.468245 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.468121 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerDied","Data":"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0"} May 26 10:13:00.468245 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.468136 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4347f21-82bc-4c46-8c3a-d07c77e50f54","Type":"ContainerDied","Data":"f38db1f2b2633ab731e8ecb4056491487eb9fd94bef6c37975f66498818125c5"} May 26 10:13:00.476365 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.476328 2557 scope.go:117] "RemoveContainer" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" May 26 10:13:00.482899 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.482884 2557 scope.go:117] "RemoveContainer" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" May 26 10:13:00.488946 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.488931 2557 scope.go:117] "RemoveContainer" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" May 26 10:13:00.491932 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.491911 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:13:00.495450 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.495427 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:13:00.495992 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.495976 2557 scope.go:117] "RemoveContainer" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" May 26 10:13:00.502014 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.501998 2557 scope.go:117] "RemoveContainer" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" May 26 10:13:00.508172 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.508157 2557 scope.go:117] "RemoveContainer" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" May 26 10:13:00.513882 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.513862 2557 scope.go:117] "RemoveContainer" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" May 26 10:13:00.514136 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:13:00.514108 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": container with ID starting with 3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207 not found: ID does not exist" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" May 26 10:13:00.514227 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.514142 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207"} err="failed to get container status \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": rpc error: code = NotFound desc = could not find container \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": container with ID starting with 3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207 not found: ID does not exist" May 26 10:13:00.514227 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.514161 2557 scope.go:117] "RemoveContainer" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" May 26 10:13:00.514407 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:13:00.514374 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": container with ID starting with 80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04 not found: ID does not exist" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" May 26 10:13:00.514472 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.514403 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04"} err="failed to get container status \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": rpc error: code = NotFound desc = could not find container \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": container with ID starting with 80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04 not found: ID does not exist" May 26 10:13:00.514472 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.514425 2557 scope.go:117] "RemoveContainer" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" May 26 10:13:00.514736 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:13:00.514713 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": container with ID starting with ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6 not found: ID does not exist" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" May 26 10:13:00.514813 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.514743 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6"} err="failed to get container status \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": rpc error: code = NotFound desc = could not find container \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": container with ID starting with ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6 not found: ID does not exist" May 26 10:13:00.514813 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.514765 2557 scope.go:117] "RemoveContainer" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" May 26 10:13:00.515024 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:13:00.515007 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": container with ID starting with e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131 not found: ID does not exist" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" May 26 10:13:00.515073 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.515029 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131"} err="failed to get container status \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": rpc error: code = NotFound desc = could not find container \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": container with ID starting with e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131 not found: ID does not exist" May 26 10:13:00.515073 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.515046 2557 scope.go:117] "RemoveContainer" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" May 26 10:13:00.515243 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:13:00.515227 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": container with ID starting with 87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01 not found: ID does not exist" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" May 26 10:13:00.515287 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.515244 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01"} err="failed to get container status \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": rpc error: code = NotFound desc = could not find container \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": container with ID starting with 87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01 not found: ID does not exist" May 26 10:13:00.515287 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.515257 2557 scope.go:117] "RemoveContainer" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" May 26 10:13:00.515494 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:13:00.515477 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": container with ID starting with d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0 not found: ID does not exist" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" May 26 10:13:00.515599 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.515498 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0"} err="failed to get container status \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": rpc error: code = NotFound desc = could not find container \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": container with ID starting with d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0 not found: ID does not exist" May 26 10:13:00.515653 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.515613 2557 scope.go:117] "RemoveContainer" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" May 26 10:13:00.515858 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:13:00.515841 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": container with ID starting with a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96 not found: ID does not exist" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" May 26 10:13:00.515902 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.515862 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96"} err="failed to get container status \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": rpc error: code = NotFound desc = could not find container \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": container with ID starting with a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96 not found: ID does not exist" May 26 10:13:00.515902 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.515876 2557 scope.go:117] "RemoveContainer" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" May 26 10:13:00.516110 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516093 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207"} err="failed to get container status \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": rpc error: code = NotFound desc = could not find container \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": container with ID starting with 3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207 not found: ID does not exist" May 26 10:13:00.516149 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516112 2557 scope.go:117] "RemoveContainer" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" May 26 10:13:00.516320 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516304 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04"} err="failed to get container status \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": rpc error: code = NotFound desc = could not find container \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": container with ID starting with 80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04 not found: ID does not exist" May 26 10:13:00.516366 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516320 2557 scope.go:117] "RemoveContainer" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" May 26 10:13:00.516543 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516526 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6"} err="failed to get container status \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": rpc error: code = NotFound desc = could not find container \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": container with ID starting with ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6 not found: ID does not exist" May 26 10:13:00.516588 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516544 2557 scope.go:117] "RemoveContainer" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" May 26 10:13:00.516736 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516720 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131"} err="failed to get container status \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": rpc error: code = NotFound desc = could not find container \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": container with ID starting with e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131 not found: ID does not exist" May 26 10:13:00.516776 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516738 2557 scope.go:117] "RemoveContainer" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" May 26 10:13:00.516915 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516896 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01"} err="failed to get container status \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": rpc error: code = NotFound desc = could not find container \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": container with ID starting with 87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01 not found: ID does not exist" May 26 10:13:00.516961 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.516915 2557 scope.go:117] "RemoveContainer" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" May 26 10:13:00.517122 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517103 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0"} err="failed to get container status \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": rpc error: code = NotFound desc = could not find container \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": container with ID starting with d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0 not found: ID does not exist" May 26 10:13:00.517159 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517123 2557 scope.go:117] "RemoveContainer" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" May 26 10:13:00.517300 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517282 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96"} err="failed to get container status \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": rpc error: code = NotFound desc = could not find container \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": container with ID starting with a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96 not found: ID does not exist" May 26 10:13:00.517337 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517300 2557 scope.go:117] "RemoveContainer" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" May 26 10:13:00.517494 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517478 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207"} err="failed to get container status \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": rpc error: code = NotFound desc = could not find container \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": container with ID starting with 3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207 not found: ID does not exist" May 26 10:13:00.517562 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517496 2557 scope.go:117] "RemoveContainer" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" May 26 10:13:00.517690 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517675 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04"} err="failed to get container status \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": rpc error: code = NotFound desc = could not find container \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": container with ID starting with 80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04 not found: ID does not exist" May 26 10:13:00.517730 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517691 2557 scope.go:117] "RemoveContainer" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" May 26 10:13:00.517870 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517854 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6"} err="failed to get container status \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": rpc error: code = NotFound desc = could not find container \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": container with ID starting with ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6 not found: ID does not exist" May 26 10:13:00.517913 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.517871 2557 scope.go:117] "RemoveContainer" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" May 26 10:13:00.518068 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518052 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131"} err="failed to get container status \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": rpc error: code = NotFound desc = could not find container \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": container with ID starting with e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131 not found: ID does not exist" May 26 10:13:00.518068 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518067 2557 scope.go:117] "RemoveContainer" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" May 26 10:13:00.518256 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518237 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01"} err="failed to get container status \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": rpc error: code = NotFound desc = could not find container \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": container with ID starting with 87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01 not found: ID does not exist" May 26 10:13:00.518295 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518256 2557 scope.go:117] "RemoveContainer" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" May 26 10:13:00.518453 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518438 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0"} err="failed to get container status \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": rpc error: code = NotFound desc = could not find container \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": container with ID starting with d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0 not found: ID does not exist" May 26 10:13:00.518453 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518453 2557 scope.go:117] "RemoveContainer" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" May 26 10:13:00.518665 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518650 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96"} err="failed to get container status \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": rpc error: code = NotFound desc = could not find container \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": container with ID starting with a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96 not found: ID does not exist" May 26 10:13:00.518714 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518666 2557 scope.go:117] "RemoveContainer" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" May 26 10:13:00.518874 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518857 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207"} err="failed to get container status \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": rpc error: code = NotFound desc = could not find container \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": container with ID starting with 3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207 not found: ID does not exist" May 26 10:13:00.518874 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.518874 2557 scope.go:117] "RemoveContainer" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" May 26 10:13:00.519060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519044 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04"} err="failed to get container status \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": rpc error: code = NotFound desc = could not find container \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": container with ID starting with 80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04 not found: ID does not exist" May 26 10:13:00.519060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519060 2557 scope.go:117] "RemoveContainer" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" May 26 10:13:00.519249 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519231 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6"} err="failed to get container status \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": rpc error: code = NotFound desc = could not find container \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": container with ID starting with ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6 not found: ID does not exist" May 26 10:13:00.519249 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519249 2557 scope.go:117] "RemoveContainer" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" May 26 10:13:00.519460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519445 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131"} err="failed to get container status \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": rpc error: code = NotFound desc = could not find container \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": container with ID starting with e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131 not found: ID does not exist" May 26 10:13:00.519535 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519460 2557 scope.go:117] "RemoveContainer" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" May 26 10:13:00.519687 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519671 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01"} err="failed to get container status \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": rpc error: code = NotFound desc = could not find container \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": container with ID starting with 87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01 not found: ID does not exist" May 26 10:13:00.519733 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519687 2557 scope.go:117] "RemoveContainer" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" May 26 10:13:00.519880 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519863 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0"} err="failed to get container status \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": rpc error: code = NotFound desc = could not find container \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": container with ID starting with d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0 not found: ID does not exist" May 26 10:13:00.519880 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.519880 2557 scope.go:117] "RemoveContainer" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" May 26 10:13:00.520064 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520048 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96"} err="failed to get container status \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": rpc error: code = NotFound desc = could not find container \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": container with ID starting with a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96 not found: ID does not exist" May 26 10:13:00.520108 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520063 2557 scope.go:117] "RemoveContainer" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" May 26 10:13:00.520231 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520216 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207"} err="failed to get container status \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": rpc error: code = NotFound desc = could not find container \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": container with ID starting with 3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207 not found: ID does not exist" May 26 10:13:00.520274 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520231 2557 scope.go:117] "RemoveContainer" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" May 26 10:13:00.520414 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520394 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04"} err="failed to get container status \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": rpc error: code = NotFound desc = could not find container \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": container with ID starting with 80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04 not found: ID does not exist" May 26 10:13:00.520449 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520416 2557 scope.go:117] "RemoveContainer" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" May 26 10:13:00.520586 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520572 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6"} err="failed to get container status \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": rpc error: code = NotFound desc = could not find container \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": container with ID starting with ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6 not found: ID does not exist" May 26 10:13:00.520623 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520586 2557 scope.go:117] "RemoveContainer" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" May 26 10:13:00.520741 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520727 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131"} err="failed to get container status \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": rpc error: code = NotFound desc = could not find container \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": container with ID starting with e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131 not found: ID does not exist" May 26 10:13:00.520741 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520740 2557 scope.go:117] "RemoveContainer" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" May 26 10:13:00.520918 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520903 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01"} err="failed to get container status \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": rpc error: code = NotFound desc = could not find container \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": container with ID starting with 87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01 not found: ID does not exist" May 26 10:13:00.520964 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.520920 2557 scope.go:117] "RemoveContainer" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" May 26 10:13:00.521104 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521089 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0"} err="failed to get container status \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": rpc error: code = NotFound desc = could not find container \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": container with ID starting with d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0 not found: ID does not exist" May 26 10:13:00.521104 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521102 2557 scope.go:117] "RemoveContainer" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" May 26 10:13:00.521291 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521273 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96"} err="failed to get container status \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": rpc error: code = NotFound desc = could not find container \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": container with ID starting with a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96 not found: ID does not exist" May 26 10:13:00.521333 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521292 2557 scope.go:117] "RemoveContainer" containerID="3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207" May 26 10:13:00.521490 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521469 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207"} err="failed to get container status \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": rpc error: code = NotFound desc = could not find container \"3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207\": container with ID starting with 3120baf29bfc7fee99d8a7124c88c45197b1381b004b397af3c764988cc99207 not found: ID does not exist" May 26 10:13:00.521490 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521490 2557 scope.go:117] "RemoveContainer" containerID="80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04" May 26 10:13:00.521743 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521719 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04"} err="failed to get container status \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": rpc error: code = NotFound desc = could not find container \"80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04\": container with ID starting with 80145f941b77103cb399e808c763ec1463f8cb2ab69cfe4881c75185ab811b04 not found: ID does not exist" May 26 10:13:00.521743 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521737 2557 scope.go:117] "RemoveContainer" containerID="ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6" May 26 10:13:00.521932 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521917 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6"} err="failed to get container status \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": rpc error: code = NotFound desc = could not find container \"ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6\": container with ID starting with ec0346edbe97244595a24c041734eb58090bf4739df76599dac278aa4cac08b6 not found: ID does not exist" May 26 10:13:00.521976 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.521933 2557 scope.go:117] "RemoveContainer" containerID="e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131" May 26 10:13:00.522104 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.522088 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131"} err="failed to get container status \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": rpc error: code = NotFound desc = could not find container \"e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131\": container with ID starting with e8170bb81a10b30ce9cf52e561994d5c85efca3b94676f8fb30a37be72687131 not found: ID does not exist" May 26 10:13:00.522141 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.522104 2557 scope.go:117] "RemoveContainer" containerID="87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01" May 26 10:13:00.522290 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.522272 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01"} err="failed to get container status \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": rpc error: code = NotFound desc = could not find container \"87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01\": container with ID starting with 87cbdde1c612a81190f602b22629ff0bff7946c28c683b95b9ec53312529cc01 not found: ID does not exist" May 26 10:13:00.522361 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.522292 2557 scope.go:117] "RemoveContainer" containerID="d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0" May 26 10:13:00.522470 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.522454 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0"} err="failed to get container status \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": rpc error: code = NotFound desc = could not find container \"d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0\": container with ID starting with d42a522d4d0aef05d7705569c90bbd702426a78f7908b3a8b96eed7dfa06afa0 not found: ID does not exist" May 26 10:13:00.522531 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.522469 2557 scope.go:117] "RemoveContainer" containerID="a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96" May 26 10:13:00.522920 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.522897 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96"} err="failed to get container status \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": rpc error: code = NotFound desc = could not find container \"a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96\": container with ID starting with a48a8cd29231f8b3a67821214b34537356f37ea14f9717b8ac62c1c4b62bea96 not found: ID does not exist" May 26 10:13:00.524553 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524534 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:13:00.524796 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524784 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="config-reloader" May 26 10:13:00.524846 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524800 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="config-reloader" May 26 10:13:00.524846 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524813 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="thanos-sidecar" May 26 10:13:00.524846 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524819 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="thanos-sidecar" May 26 10:13:00.524846 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524826 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy-web" May 26 10:13:00.524846 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524832 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy-web" May 26 10:13:00.524846 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524840 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="init-config-reloader" May 26 10:13:00.524846 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524845 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="init-config-reloader" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524853 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524858 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524867 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e3f2844-92c5-45b6-a2cc-dd85e53b482d" containerName="console" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524875 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e3f2844-92c5-45b6-a2cc-dd85e53b482d" containerName="console" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524885 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="prometheus" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524890 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="prometheus" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524898 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c19326-213b-40b3-a81a-225a4701233c" containerName="registry" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524903 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c19326-213b-40b3-a81a-225a4701233c" containerName="registry" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524909 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy-thanos" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524914 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy-thanos" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524957 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e3f2844-92c5-45b6-a2cc-dd85e53b482d" containerName="console" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524966 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="prometheus" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524977 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="config-reloader" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524985 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy-web" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.524996 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.525004 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="36c19326-213b-40b3-a81a-225a4701233c" containerName="registry" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.525009 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="thanos-sidecar" May 26 10:13:00.525063 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.525015 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" containerName="kube-rbac-proxy-thanos" May 26 10:13:00.528376 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.528359 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.531706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.531090 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 10:13:00.531706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.531375 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 10:13:00.531706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.531496 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 10:13:00.531706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.531657 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 10:13:00.532133 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.531953 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 10:13:00.533825 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.533803 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1idndv03t96ok\"" May 26 10:13:00.533899 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.533855 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 10:13:00.534014 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.533993 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 10:13:00.534081 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.534064 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 10:13:00.534132 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.534066 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 10:13:00.534132 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.534111 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 10:13:00.534250 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.534144 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lwngp\"" May 26 10:13:00.537315 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.537298 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 10:13:00.538621 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.538449 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 10:13:00.541458 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.541436 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:13:00.561950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.561929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99d93955-41c0-487d-ab49-556e77e52f09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562111 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.561963 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562111 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.561991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562111 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562045 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562111 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562087 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562319 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562135 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-config\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562319 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562161 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562319 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562197 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562319 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562223 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-web-config\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562319 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562257 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562319 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562281 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562319 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562314 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562639 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99d93955-41c0-487d-ab49-556e77e52f09-config-out\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562639 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562373 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562639 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562405 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562639 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562431 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562639 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.562639 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.562551 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br6sp\" (UniqueName: \"kubernetes.io/projected/99d93955-41c0-487d-ab49-556e77e52f09-kube-api-access-br6sp\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.663588 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.663543 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.663741 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.663601 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99d93955-41c0-487d-ab49-556e77e52f09-config-out\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.663741 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.663628 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.663741 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.663660 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.663741 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.663687 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.663937 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.663829 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.663937 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.663860 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-br6sp\" (UniqueName: \"kubernetes.io/projected/99d93955-41c0-487d-ab49-556e77e52f09-kube-api-access-br6sp\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664043 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.663979 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99d93955-41c0-487d-ab49-556e77e52f09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664043 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664019 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664147 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664049 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664147 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664080 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664147 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664112 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664148 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664167 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-config\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664206 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664247 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664276 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-web-config\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664551 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664314 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.664551 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664337 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.665077 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.664779 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.665203 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.665091 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.665602 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.665568 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.666105 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.666080 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.666444 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.666389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99d93955-41c0-487d-ab49-556e77e52f09-config-out\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.666900 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.666826 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.667179 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.667158 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99d93955-41c0-487d-ab49-556e77e52f09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.667661 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.667611 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.668028 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.667971 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.668463 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.668437 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.668568 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.668497 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/99d93955-41c0-487d-ab49-556e77e52f09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.668706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.668682 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.668760 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.668690 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-web-config\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.669341 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.669325 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.669377 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.669344 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-config\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.669711 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.669695 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/99d93955-41c0-487d-ab49-556e77e52f09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.671860 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.671844 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br6sp\" (UniqueName: \"kubernetes.io/projected/99d93955-41c0-487d-ab49-556e77e52f09-kube-api-access-br6sp\") pod \"prometheus-k8s-0\" (UID: \"99d93955-41c0-487d-ab49-556e77e52f09\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.828575 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.828543 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4347f21-82bc-4c46-8c3a-d07c77e50f54" path="/var/lib/kubelet/pods/d4347f21-82bc-4c46-8c3a-d07c77e50f54/volumes" May 26 10:13:00.842239 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.842217 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:13:00.967066 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:00.966963 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 10:13:00.969422 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:13:00.969391 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d93955_41c0_487d_ab49_556e77e52f09.slice/crio-9201b23bac948fd19efde81fad89b0c0ae2e6a3900252933211fed8a41828bc2 WatchSource:0}: Error finding container 9201b23bac948fd19efde81fad89b0c0ae2e6a3900252933211fed8a41828bc2: Status 404 returned error can't find the container with id 9201b23bac948fd19efde81fad89b0c0ae2e6a3900252933211fed8a41828bc2 May 26 10:13:01.472254 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:01.472218 2557 generic.go:358] "Generic (PLEG): container finished" podID="99d93955-41c0-487d-ab49-556e77e52f09" containerID="c810b7b002515500b4c1522c01c1df6f22eb573d5c000b560a8a4bb90ec8e048" exitCode=0 May 26 10:13:01.472624 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:01.472293 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99d93955-41c0-487d-ab49-556e77e52f09","Type":"ContainerDied","Data":"c810b7b002515500b4c1522c01c1df6f22eb573d5c000b560a8a4bb90ec8e048"} May 26 10:13:01.472624 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:01.472317 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99d93955-41c0-487d-ab49-556e77e52f09","Type":"ContainerStarted","Data":"9201b23bac948fd19efde81fad89b0c0ae2e6a3900252933211fed8a41828bc2"} May 26 10:13:02.477548 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:02.477482 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99d93955-41c0-487d-ab49-556e77e52f09","Type":"ContainerStarted","Data":"d72c7416a2ac0726268a4cdf993e7924b70e100b51bf71f2ee0e675838b28ac4"} May 26 10:13:02.477548 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:02.477551 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99d93955-41c0-487d-ab49-556e77e52f09","Type":"ContainerStarted","Data":"897870b0774b16ad28cf57554999ca005510edeb641b969254ef9d73d8236de6"} May 26 10:13:02.477955 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:02.477567 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99d93955-41c0-487d-ab49-556e77e52f09","Type":"ContainerStarted","Data":"624ce163c9f2704f3f42878a17008412cebeee889ceab1d889bb464e6fab850e"} May 26 10:13:02.477955 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:02.477579 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99d93955-41c0-487d-ab49-556e77e52f09","Type":"ContainerStarted","Data":"36e3ff1694be91234249b7024954fc6155d98adb14ab02c376dd9d67954bcc39"} May 26 10:13:02.477955 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:02.477590 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99d93955-41c0-487d-ab49-556e77e52f09","Type":"ContainerStarted","Data":"504ee456fcefd38e9c63cf9632c32a5e73ccf5c54f8df798e5e615858e09475e"} May 26 10:13:02.477955 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:02.477603 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"99d93955-41c0-487d-ab49-556e77e52f09","Type":"ContainerStarted","Data":"6e73ccf97dd72a95948ecd32129162ff1fa98ba0f827736c3bfd1ca9dede9b4d"} May 26 10:13:02.508962 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:02.508908 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5088898459999998 podStartE2EDuration="2.508889846s" podCreationTimestamp="2026-05-26 10:13:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:13:02.506434829 +0000 UTC m=+172.298862840" watchObservedRunningTime="2026-05-26 10:13:02.508889846 +0000 UTC m=+172.301317858" May 26 10:13:05.843177 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:13:05.843148 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:14:00.843060 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:14:00.843026 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:14:00.857934 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:14:00.857909 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:14:01.657157 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:14:01.657130 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 10:15:10.743729 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:15:10.743702 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:15:10.744185 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:15:10.743871 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:20:10.760902 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:20:10.760876 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:20:10.762538 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:20:10.762499 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:22:58.300901 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.300868 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-blgfh"] May 26 10:22:58.303910 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.303890 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:22:58.306742 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.306715 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-62vhm\"" May 26 10:22:58.306877 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.306746 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 26 10:22:58.306877 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.306746 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 26 10:22:58.312227 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.312202 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-blgfh"] May 26 10:22:58.366351 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.366325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b58d6470-3f91-47f8-906c-4b2fdf1c9182-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-blgfh\" (UID: \"b58d6470-3f91-47f8-906c-4b2fdf1c9182\") " pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:22:58.366465 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.366368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4zm9\" (UniqueName: \"kubernetes.io/projected/b58d6470-3f91-47f8-906c-4b2fdf1c9182-kube-api-access-q4zm9\") pod \"cert-manager-webhook-587ccfb98-blgfh\" (UID: \"b58d6470-3f91-47f8-906c-4b2fdf1c9182\") " pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:22:58.467647 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.467612 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b58d6470-3f91-47f8-906c-4b2fdf1c9182-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-blgfh\" (UID: \"b58d6470-3f91-47f8-906c-4b2fdf1c9182\") " pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:22:58.467794 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.467664 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4zm9\" (UniqueName: \"kubernetes.io/projected/b58d6470-3f91-47f8-906c-4b2fdf1c9182-kube-api-access-q4zm9\") pod \"cert-manager-webhook-587ccfb98-blgfh\" (UID: \"b58d6470-3f91-47f8-906c-4b2fdf1c9182\") " pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:22:58.476560 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.476532 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b58d6470-3f91-47f8-906c-4b2fdf1c9182-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-blgfh\" (UID: \"b58d6470-3f91-47f8-906c-4b2fdf1c9182\") " pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:22:58.476659 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.476592 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4zm9\" (UniqueName: \"kubernetes.io/projected/b58d6470-3f91-47f8-906c-4b2fdf1c9182-kube-api-access-q4zm9\") pod \"cert-manager-webhook-587ccfb98-blgfh\" (UID: \"b58d6470-3f91-47f8-906c-4b2fdf1c9182\") " pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:22:58.625319 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.625237 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:22:58.751430 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.751347 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-blgfh"] May 26 10:22:58.753569 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:22:58.753538 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb58d6470_3f91_47f8_906c_4b2fdf1c9182.slice/crio-d9aa872fad2b6b26ea6565587805f315d53d9919c3c8375d7181c9858fde385b WatchSource:0}: Error finding container d9aa872fad2b6b26ea6565587805f315d53d9919c3c8375d7181c9858fde385b: Status 404 returned error can't find the container with id d9aa872fad2b6b26ea6565587805f315d53d9919c3c8375d7181c9858fde385b May 26 10:22:58.755385 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:58.755368 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:22:59.021728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:22:59.021697 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" event={"ID":"b58d6470-3f91-47f8-906c-4b2fdf1c9182","Type":"ContainerStarted","Data":"d9aa872fad2b6b26ea6565587805f315d53d9919c3c8375d7181c9858fde385b"} May 26 10:23:02.031980 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:02.031940 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" event={"ID":"b58d6470-3f91-47f8-906c-4b2fdf1c9182","Type":"ContainerStarted","Data":"8d74496a1fd0fd20083edc1310054a7bd719fc5222d5c4c7635b1868f72cbd70"} May 26 10:23:02.032423 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:02.032000 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:23:02.050993 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:02.050942 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" podStartSLOduration=1.195184587 podStartE2EDuration="4.050928209s" podCreationTimestamp="2026-05-26 10:22:58 +0000 UTC" firstStartedPulling="2026-05-26 10:22:58.755498558 +0000 UTC m=+768.547926550" lastFinishedPulling="2026-05-26 10:23:01.611242179 +0000 UTC m=+771.403670172" observedRunningTime="2026-05-26 10:23:02.050502675 +0000 UTC m=+771.842930699" watchObservedRunningTime="2026-05-26 10:23:02.050928209 +0000 UTC m=+771.843356220" May 26 10:23:08.038599 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:08.038569 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-blgfh" May 26 10:23:30.730530 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.730491 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c"] May 26 10:23:30.734192 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.734173 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.737848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.737825 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 26 10:23:30.737848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.737838 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 26 10:23:30.738010 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.737872 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 26 10:23:30.738010 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.737840 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dw9bs\"" May 26 10:23:30.738010 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.737964 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 26 10:23:30.755480 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.755458 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c"] May 26 10:23:30.821069 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.821036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xph7\" (UniqueName: \"kubernetes.io/projected/eaf1f784-0b96-40b1-8ede-a78d3618431b-kube-api-access-2xph7\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.821216 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.821077 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eaf1f784-0b96-40b1-8ede-a78d3618431b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.821216 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.821117 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaf1f784-0b96-40b1-8ede-a78d3618431b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.921487 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.921455 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaf1f784-0b96-40b1-8ede-a78d3618431b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.921672 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.921492 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xph7\" (UniqueName: \"kubernetes.io/projected/eaf1f784-0b96-40b1-8ede-a78d3618431b-kube-api-access-2xph7\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.921672 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.921546 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eaf1f784-0b96-40b1-8ede-a78d3618431b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.924189 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.924166 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaf1f784-0b96-40b1-8ede-a78d3618431b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.924318 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.924209 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eaf1f784-0b96-40b1-8ede-a78d3618431b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:30.931653 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:30.931627 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xph7\" (UniqueName: \"kubernetes.io/projected/eaf1f784-0b96-40b1-8ede-a78d3618431b-kube-api-access-2xph7\") pod \"opendatahub-operator-controller-manager-7c66b4d846-8rr6c\" (UID: \"eaf1f784-0b96-40b1-8ede-a78d3618431b\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:31.044195 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:31.044114 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:31.169280 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:31.169252 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c"] May 26 10:23:31.172126 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:23:31.172097 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf1f784_0b96_40b1_8ede_a78d3618431b.slice/crio-3dd2aba9ac93423b5be8ed27635ef7fd6dd7de1f84eb56125526adaf53abe365 WatchSource:0}: Error finding container 3dd2aba9ac93423b5be8ed27635ef7fd6dd7de1f84eb56125526adaf53abe365: Status 404 returned error can't find the container with id 3dd2aba9ac93423b5be8ed27635ef7fd6dd7de1f84eb56125526adaf53abe365 May 26 10:23:32.120551 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:32.120490 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" event={"ID":"eaf1f784-0b96-40b1-8ede-a78d3618431b","Type":"ContainerStarted","Data":"3dd2aba9ac93423b5be8ed27635ef7fd6dd7de1f84eb56125526adaf53abe365"} May 26 10:23:34.128652 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:34.128622 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" event={"ID":"eaf1f784-0b96-40b1-8ede-a78d3618431b","Type":"ContainerStarted","Data":"8edeb2eca700e57a1a141b7dbbc26b8b9b317bb0a86dbf177afba857b9ca2629"} May 26 10:23:34.129070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:34.128759 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:34.153814 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:34.153773 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" podStartSLOduration=1.6255271690000002 podStartE2EDuration="4.153759845s" podCreationTimestamp="2026-05-26 10:23:30 +0000 UTC" firstStartedPulling="2026-05-26 10:23:31.173816438 +0000 UTC m=+800.966244428" lastFinishedPulling="2026-05-26 10:23:33.702049106 +0000 UTC m=+803.494477104" observedRunningTime="2026-05-26 10:23:34.152112472 +0000 UTC m=+803.944540522" watchObservedRunningTime="2026-05-26 10:23:34.153759845 +0000 UTC m=+803.946187856" May 26 10:23:41.065678 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.065644 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h"] May 26 10:23:41.067759 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.067738 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.070476 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.070441 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 26 10:23:41.070615 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.070491 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 26 10:23:41.071496 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.071469 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 26 10:23:41.071631 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.071503 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 26 10:23:41.071631 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.071588 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r24mm\"" May 26 10:23:41.071719 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.071703 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 26 10:23:41.081311 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.081288 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h"] May 26 10:23:41.094547 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.094505 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk66z\" (UniqueName: \"kubernetes.io/projected/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-kube-api-access-hk66z\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.094676 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.094563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-cert\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.094676 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.094644 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-manager-config\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.094783 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.094686 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-metrics-cert\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.195809 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.195777 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-metrics-cert\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.196070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.195833 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hk66z\" (UniqueName: \"kubernetes.io/projected/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-kube-api-access-hk66z\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.196070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.195872 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-cert\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.196070 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.195937 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-manager-config\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.196609 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.196585 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-manager-config\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.198290 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.198265 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-cert\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.198443 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.198423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-metrics-cert\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.203714 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.203686 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk66z\" (UniqueName: \"kubernetes.io/projected/ad6c66b2-e383-4b7b-ab75-dc8dabe7851f-kube-api-access-hk66z\") pod \"lws-controller-manager-546dd56b4d-m8q5h\" (UID: \"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f\") " pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.377270 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.377238 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:41.501356 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:41.501309 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h"] May 26 10:23:41.503430 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:23:41.503407 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6c66b2_e383_4b7b_ab75_dc8dabe7851f.slice/crio-d0a16171435f3ac3d8afc2a9f8c22f6c5a625381edf2874fcfc59a274b75be04 WatchSource:0}: Error finding container d0a16171435f3ac3d8afc2a9f8c22f6c5a625381edf2874fcfc59a274b75be04: Status 404 returned error can't find the container with id d0a16171435f3ac3d8afc2a9f8c22f6c5a625381edf2874fcfc59a274b75be04 May 26 10:23:42.155567 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:42.155533 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" event={"ID":"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f","Type":"ContainerStarted","Data":"d0a16171435f3ac3d8afc2a9f8c22f6c5a625381edf2874fcfc59a274b75be04"} May 26 10:23:45.135318 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:45.135289 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-8rr6c" May 26 10:23:45.166684 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:45.166654 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" event={"ID":"ad6c66b2-e383-4b7b-ab75-dc8dabe7851f","Type":"ContainerStarted","Data":"78d048e643903f024f02e29e7c0cfb5444a5a1a597ba6d371fd5347f156fb688"} May 26 10:23:45.166856 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:45.166762 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:23:45.188158 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:45.188109 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" podStartSLOduration=1.276359896 podStartE2EDuration="4.188094664s" podCreationTimestamp="2026-05-26 10:23:41 +0000 UTC" firstStartedPulling="2026-05-26 10:23:41.50523401 +0000 UTC m=+811.297662001" lastFinishedPulling="2026-05-26 10:23:44.416968777 +0000 UTC m=+814.209396769" observedRunningTime="2026-05-26 10:23:45.187980413 +0000 UTC m=+814.980408425" watchObservedRunningTime="2026-05-26 10:23:45.188094664 +0000 UTC m=+814.980522676" May 26 10:23:48.426585 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.426546 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-546bd7d749-glwtk"] May 26 10:23:48.429068 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.429045 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.431697 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.431675 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 26 10:23:48.431830 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.431718 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 26 10:23:48.432966 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.432948 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 26 10:23:48.433066 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.433011 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 26 10:23:48.433127 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.433102 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nfh9c\"" May 26 10:23:48.443310 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.443289 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-546bd7d749-glwtk"] May 26 10:23:48.451988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.451968 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c66c751-71d4-4a76-bd1b-3e1684680171-tls-certs\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.452112 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.452004 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9bp\" (UniqueName: \"kubernetes.io/projected/2c66c751-71d4-4a76-bd1b-3e1684680171-kube-api-access-qq9bp\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.452112 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.452024 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c66c751-71d4-4a76-bd1b-3e1684680171-tmp\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.553141 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.553110 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c66c751-71d4-4a76-bd1b-3e1684680171-tls-certs\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.553310 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.553155 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9bp\" (UniqueName: \"kubernetes.io/projected/2c66c751-71d4-4a76-bd1b-3e1684680171-kube-api-access-qq9bp\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.553310 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.553173 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c66c751-71d4-4a76-bd1b-3e1684680171-tmp\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.555384 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.555360 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c66c751-71d4-4a76-bd1b-3e1684680171-tmp\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.555651 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.555634 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c66c751-71d4-4a76-bd1b-3e1684680171-tls-certs\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.562103 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.562078 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9bp\" (UniqueName: \"kubernetes.io/projected/2c66c751-71d4-4a76-bd1b-3e1684680171-kube-api-access-qq9bp\") pod \"kube-auth-proxy-546bd7d749-glwtk\" (UID: \"2c66c751-71d4-4a76-bd1b-3e1684680171\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.738554 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.738466 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" May 26 10:23:48.864728 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:48.864598 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-546bd7d749-glwtk"] May 26 10:23:48.867692 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:23:48.867661 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c66c751_71d4_4a76_bd1b_3e1684680171.slice/crio-e83591bafc0de5129427479dac7e6e347fd13c2a0fb11cd8d6f03de7899cb8ea WatchSource:0}: Error finding container e83591bafc0de5129427479dac7e6e347fd13c2a0fb11cd8d6f03de7899cb8ea: Status 404 returned error can't find the container with id e83591bafc0de5129427479dac7e6e347fd13c2a0fb11cd8d6f03de7899cb8ea May 26 10:23:49.182666 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:49.182629 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" event={"ID":"2c66c751-71d4-4a76-bd1b-3e1684680171","Type":"ContainerStarted","Data":"e83591bafc0de5129427479dac7e6e347fd13c2a0fb11cd8d6f03de7899cb8ea"} May 26 10:23:52.191311 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:52.191274 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" event={"ID":"2c66c751-71d4-4a76-bd1b-3e1684680171","Type":"ContainerStarted","Data":"ee18ffec72c7e59d7bc30a0091e06d57d1729d6d3f81d48dd5781bca29369d38"} May 26 10:23:52.209384 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:52.209330 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-546bd7d749-glwtk" podStartSLOduration=1.043035645 podStartE2EDuration="4.209316038s" podCreationTimestamp="2026-05-26 10:23:48 +0000 UTC" firstStartedPulling="2026-05-26 10:23:48.869629231 +0000 UTC m=+818.662057222" lastFinishedPulling="2026-05-26 10:23:52.035909621 +0000 UTC m=+821.828337615" observedRunningTime="2026-05-26 10:23:52.207439606 +0000 UTC m=+821.999867618" watchObservedRunningTime="2026-05-26 10:23:52.209316038 +0000 UTC m=+822.001744176" May 26 10:23:56.175159 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:23:56.175128 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-546dd56b4d-m8q5h" May 26 10:25:10.779587 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:10.779499 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:25:10.781628 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:10.781606 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:25:25.957659 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:25.957626 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55"] May 26 10:25:25.960831 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:25.960813 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:25.963584 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:25.963500 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 26 10:25:25.964736 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:25.964717 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-86mnb\"" May 26 10:25:25.964838 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:25.964740 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 26 10:25:25.970582 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:25.970562 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55"] May 26 10:25:26.146272 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:26.146238 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhd5s\" (UniqueName: \"kubernetes.io/projected/c84eedca-2aa2-402f-9caa-031c86e8b66c-kube-api-access-dhd5s\") pod \"limitador-operator-controller-manager-85c4996f8c-95j55\" (UID: \"c84eedca-2aa2-402f-9caa-031c86e8b66c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:26.247748 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:26.247670 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhd5s\" (UniqueName: \"kubernetes.io/projected/c84eedca-2aa2-402f-9caa-031c86e8b66c-kube-api-access-dhd5s\") pod \"limitador-operator-controller-manager-85c4996f8c-95j55\" (UID: \"c84eedca-2aa2-402f-9caa-031c86e8b66c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:26.258565 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:26.258540 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhd5s\" (UniqueName: \"kubernetes.io/projected/c84eedca-2aa2-402f-9caa-031c86e8b66c-kube-api-access-dhd5s\") pod \"limitador-operator-controller-manager-85c4996f8c-95j55\" (UID: \"c84eedca-2aa2-402f-9caa-031c86e8b66c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:26.271385 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:26.271331 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:26.398502 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:26.398471 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55"] May 26 10:25:26.401543 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:25:26.401503 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84eedca_2aa2_402f_9caa_031c86e8b66c.slice/crio-fefdc64cb883b42f8a9e1bf8e181622f8edd5975b42c4639cbe3ccfdb6945e36 WatchSource:0}: Error finding container fefdc64cb883b42f8a9e1bf8e181622f8edd5975b42c4639cbe3ccfdb6945e36: Status 404 returned error can't find the container with id fefdc64cb883b42f8a9e1bf8e181622f8edd5975b42c4639cbe3ccfdb6945e36 May 26 10:25:26.464139 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:26.464111 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" event={"ID":"c84eedca-2aa2-402f-9caa-031c86e8b66c","Type":"ContainerStarted","Data":"fefdc64cb883b42f8a9e1bf8e181622f8edd5975b42c4639cbe3ccfdb6945e36"} May 26 10:25:28.478920 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:28.478888 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" event={"ID":"c84eedca-2aa2-402f-9caa-031c86e8b66c","Type":"ContainerStarted","Data":"d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634"} May 26 10:25:28.479299 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:28.478994 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:28.523709 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:28.523637 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" podStartSLOduration=1.563512152 podStartE2EDuration="3.523621695s" podCreationTimestamp="2026-05-26 10:25:25 +0000 UTC" firstStartedPulling="2026-05-26 10:25:26.403363988 +0000 UTC m=+916.195791977" lastFinishedPulling="2026-05-26 10:25:28.363473526 +0000 UTC m=+918.155901520" observedRunningTime="2026-05-26 10:25:28.522165008 +0000 UTC m=+918.314593019" watchObservedRunningTime="2026-05-26 10:25:28.523621695 +0000 UTC m=+918.316049708" May 26 10:25:39.484095 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:39.484063 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:43.506882 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.506851 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55"] May 26 10:25:43.507266 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.507112 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" containerName="manager" containerID="cri-o://d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634" gracePeriod=2 May 26 10:25:43.519601 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.519559 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55"] May 26 10:25:43.532181 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.532156 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj"] May 26 10:25:43.532532 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.532499 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" containerName="manager" May 26 10:25:43.532626 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.532535 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" containerName="manager" May 26 10:25:43.532719 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.532632 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" containerName="manager" May 26 10:25:43.535334 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.535317 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" May 26 10:25:43.545536 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.545494 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj"] May 26 10:25:43.585817 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.585794 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4jxt\" (UniqueName: \"kubernetes.io/projected/f3bda622-f973-48fb-ac76-459bee98a2d2-kube-api-access-j4jxt\") pod \"limitador-operator-controller-manager-85c4996f8c-m2tlj\" (UID: \"f3bda622-f973-48fb-ac76-459bee98a2d2\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" May 26 10:25:43.687118 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.687086 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4jxt\" (UniqueName: \"kubernetes.io/projected/f3bda622-f973-48fb-ac76-459bee98a2d2-kube-api-access-j4jxt\") pod \"limitador-operator-controller-manager-85c4996f8c-m2tlj\" (UID: \"f3bda622-f973-48fb-ac76-459bee98a2d2\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" May 26 10:25:43.700567 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.700542 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4jxt\" (UniqueName: \"kubernetes.io/projected/f3bda622-f973-48fb-ac76-459bee98a2d2-kube-api-access-j4jxt\") pod \"limitador-operator-controller-manager-85c4996f8c-m2tlj\" (UID: \"f3bda622-f973-48fb-ac76-459bee98a2d2\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" May 26 10:25:43.739009 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.738989 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:43.740990 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.740966 2557 status_manager.go:895] "Failed to get status for pod" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" err="pods \"limitador-operator-controller-manager-85c4996f8c-95j55\" is forbidden: User \"system:node:ip-10-0-139-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-163.ec2.internal' and this object" May 26 10:25:43.787835 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.787778 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhd5s\" (UniqueName: \"kubernetes.io/projected/c84eedca-2aa2-402f-9caa-031c86e8b66c-kube-api-access-dhd5s\") pod \"c84eedca-2aa2-402f-9caa-031c86e8b66c\" (UID: \"c84eedca-2aa2-402f-9caa-031c86e8b66c\") " May 26 10:25:43.789761 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.789737 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c84eedca-2aa2-402f-9caa-031c86e8b66c-kube-api-access-dhd5s" (OuterVolumeSpecName: "kube-api-access-dhd5s") pod "c84eedca-2aa2-402f-9caa-031c86e8b66c" (UID: "c84eedca-2aa2-402f-9caa-031c86e8b66c"). InnerVolumeSpecName "kube-api-access-dhd5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:25:43.872195 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.872164 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" May 26 10:25:43.889089 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:43.889065 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhd5s\" (UniqueName: \"kubernetes.io/projected/c84eedca-2aa2-402f-9caa-031c86e8b66c-kube-api-access-dhd5s\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:25:44.014932 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.014903 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj"] May 26 10:25:44.018177 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:25:44.018151 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3bda622_f973_48fb_ac76_459bee98a2d2.slice/crio-81d68c15550ceb2c4a7611287d6a6247e5160b68f174c80f9ecf4f5508164c35 WatchSource:0}: Error finding container 81d68c15550ceb2c4a7611287d6a6247e5160b68f174c80f9ecf4f5508164c35: Status 404 returned error can't find the container with id 81d68c15550ceb2c4a7611287d6a6247e5160b68f174c80f9ecf4f5508164c35 May 26 10:25:44.529068 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.529039 2557 generic.go:358] "Generic (PLEG): container finished" podID="c84eedca-2aa2-402f-9caa-031c86e8b66c" containerID="d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634" exitCode=0 May 26 10:25:44.529484 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.529085 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" May 26 10:25:44.529484 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.529114 2557 scope.go:117] "RemoveContainer" containerID="d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634" May 26 10:25:44.530663 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.530639 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" event={"ID":"f3bda622-f973-48fb-ac76-459bee98a2d2","Type":"ContainerStarted","Data":"3f131b0db9249e93578cb9df11c0e6573faa1f51baef36829c8ab24d0a71926c"} May 26 10:25:44.530771 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.530673 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" event={"ID":"f3bda622-f973-48fb-ac76-459bee98a2d2","Type":"ContainerStarted","Data":"81d68c15550ceb2c4a7611287d6a6247e5160b68f174c80f9ecf4f5508164c35"} May 26 10:25:44.530771 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.530733 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" May 26 10:25:44.531547 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.531505 2557 status_manager.go:895] "Failed to get status for pod" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" err="pods \"limitador-operator-controller-manager-85c4996f8c-95j55\" is forbidden: User \"system:node:ip-10-0-139-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-163.ec2.internal' and this object" May 26 10:25:44.537182 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.537161 2557 scope.go:117] "RemoveContainer" containerID="d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634" May 26 10:25:44.537469 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:25:44.537451 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634\": container with ID starting with d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634 not found: ID does not exist" containerID="d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634" May 26 10:25:44.537554 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.537481 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634"} err="failed to get container status \"d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634\": rpc error: code = NotFound desc = could not find container \"d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634\": container with ID starting with d9d55b1caffdf35c46a0561c31f14feb7566d2b9874866d08c9bde40f0a88634 not found: ID does not exist" May 26 10:25:44.554402 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.554377 2557 status_manager.go:895] "Failed to get status for pod" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" err="pods \"limitador-operator-controller-manager-85c4996f8c-95j55\" is forbidden: User \"system:node:ip-10-0-139-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-163.ec2.internal' and this object" May 26 10:25:44.554615 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.554579 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" podStartSLOduration=1.554567706 podStartE2EDuration="1.554567706s" podCreationTimestamp="2026-05-26 10:25:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:25:44.552182965 +0000 UTC m=+934.344610975" watchObservedRunningTime="2026-05-26 10:25:44.554567706 +0000 UTC m=+934.346995718" May 26 10:25:44.556310 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.556288 2557 status_manager.go:895] "Failed to get status for pod" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-95j55" err="pods \"limitador-operator-controller-manager-85c4996f8c-95j55\" is forbidden: User \"system:node:ip-10-0-139-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-163.ec2.internal' and this object" May 26 10:25:44.829057 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:44.828980 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c84eedca-2aa2-402f-9caa-031c86e8b66c" path="/var/lib/kubelet/pods/c84eedca-2aa2-402f-9caa-031c86e8b66c/volumes" May 26 10:25:55.536798 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:25:55.536764 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-m2tlj" May 26 10:26:31.423576 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.423537 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:26:31.426454 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.426432 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:31.430787 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.430767 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vk6x4\"" May 26 10:26:31.431031 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.431015 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 26 10:26:31.449344 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.449319 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:26:31.469256 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.469223 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8chl\" (UniqueName: \"kubernetes.io/projected/d7f14af8-1c33-4655-9187-af77bdc1df19-kube-api-access-r8chl\") pod \"limitador-limitador-78c99df468-4v28s\" (UID: \"d7f14af8-1c33-4655-9187-af77bdc1df19\") " pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:31.469354 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.469295 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7f14af8-1c33-4655-9187-af77bdc1df19-config-file\") pod \"limitador-limitador-78c99df468-4v28s\" (UID: \"d7f14af8-1c33-4655-9187-af77bdc1df19\") " pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:31.483625 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.483596 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:26:31.569817 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.569787 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8chl\" (UniqueName: \"kubernetes.io/projected/d7f14af8-1c33-4655-9187-af77bdc1df19-kube-api-access-r8chl\") pod \"limitador-limitador-78c99df468-4v28s\" (UID: \"d7f14af8-1c33-4655-9187-af77bdc1df19\") " pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:31.569962 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.569836 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7f14af8-1c33-4655-9187-af77bdc1df19-config-file\") pod \"limitador-limitador-78c99df468-4v28s\" (UID: \"d7f14af8-1c33-4655-9187-af77bdc1df19\") " pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:31.570379 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.570361 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7f14af8-1c33-4655-9187-af77bdc1df19-config-file\") pod \"limitador-limitador-78c99df468-4v28s\" (UID: \"d7f14af8-1c33-4655-9187-af77bdc1df19\") " pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:31.585394 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.585366 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8chl\" (UniqueName: \"kubernetes.io/projected/d7f14af8-1c33-4655-9187-af77bdc1df19-kube-api-access-r8chl\") pod \"limitador-limitador-78c99df468-4v28s\" (UID: \"d7f14af8-1c33-4655-9187-af77bdc1df19\") " pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:31.736741 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.736652 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:31.859025 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.858998 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:26:31.861796 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:26:31.861762 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f14af8_1c33_4655_9187_af77bdc1df19.slice/crio-c0699eb9f93118af9cc4f6c9cccc309e80b15e326d7b4dc6c0698c69ed41d6e2 WatchSource:0}: Error finding container c0699eb9f93118af9cc4f6c9cccc309e80b15e326d7b4dc6c0698c69ed41d6e2: Status 404 returned error can't find the container with id c0699eb9f93118af9cc4f6c9cccc309e80b15e326d7b4dc6c0698c69ed41d6e2 May 26 10:26:31.899801 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.899767 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p7jvf"] May 26 10:26:31.904701 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.904680 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" May 26 10:26:31.907295 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.907267 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kvwfr\"" May 26 10:26:31.912770 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.912743 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p7jvf"] May 26 10:26:31.973143 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:31.973114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-895h6\" (UniqueName: \"kubernetes.io/projected/1772e7c8-d533-4714-837d-bbae4a29a5d7-kube-api-access-895h6\") pod \"authorino-f99f4b5cd-p7jvf\" (UID: \"1772e7c8-d533-4714-837d-bbae4a29a5d7\") " pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" May 26 10:26:32.022408 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.022329 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-v29zq"] May 26 10:26:32.025499 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.025480 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-v29zq" May 26 10:26:32.033694 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.033669 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-v29zq"] May 26 10:26:32.073506 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.073471 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xwkf\" (UniqueName: \"kubernetes.io/projected/11674bcb-ef1a-45c5-9999-14469538a1c9-kube-api-access-7xwkf\") pod \"authorino-7498df8756-v29zq\" (UID: \"11674bcb-ef1a-45c5-9999-14469538a1c9\") " pod="kuadrant-system/authorino-7498df8756-v29zq" May 26 10:26:32.073711 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.073602 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-895h6\" (UniqueName: \"kubernetes.io/projected/1772e7c8-d533-4714-837d-bbae4a29a5d7-kube-api-access-895h6\") pod \"authorino-f99f4b5cd-p7jvf\" (UID: \"1772e7c8-d533-4714-837d-bbae4a29a5d7\") " pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" May 26 10:26:32.082148 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.082119 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-895h6\" (UniqueName: \"kubernetes.io/projected/1772e7c8-d533-4714-837d-bbae4a29a5d7-kube-api-access-895h6\") pod \"authorino-f99f4b5cd-p7jvf\" (UID: \"1772e7c8-d533-4714-837d-bbae4a29a5d7\") " pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" May 26 10:26:32.174487 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.174453 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xwkf\" (UniqueName: \"kubernetes.io/projected/11674bcb-ef1a-45c5-9999-14469538a1c9-kube-api-access-7xwkf\") pod \"authorino-7498df8756-v29zq\" (UID: \"11674bcb-ef1a-45c5-9999-14469538a1c9\") " pod="kuadrant-system/authorino-7498df8756-v29zq" May 26 10:26:32.183483 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.183459 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xwkf\" (UniqueName: \"kubernetes.io/projected/11674bcb-ef1a-45c5-9999-14469538a1c9-kube-api-access-7xwkf\") pod \"authorino-7498df8756-v29zq\" (UID: \"11674bcb-ef1a-45c5-9999-14469538a1c9\") " pod="kuadrant-system/authorino-7498df8756-v29zq" May 26 10:26:32.215388 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.215364 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" May 26 10:26:32.335829 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.335559 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-v29zq" May 26 10:26:32.376849 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.376735 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p7jvf"] May 26 10:26:32.384701 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:26:32.384660 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1772e7c8_d533_4714_837d_bbae4a29a5d7.slice/crio-2f6b3f75bdacb1e15652707b039ea80460e14d2141ab7394920f94406bce2939 WatchSource:0}: Error finding container 2f6b3f75bdacb1e15652707b039ea80460e14d2141ab7394920f94406bce2939: Status 404 returned error can't find the container with id 2f6b3f75bdacb1e15652707b039ea80460e14d2141ab7394920f94406bce2939 May 26 10:26:32.507800 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.507740 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-v29zq"] May 26 10:26:32.512728 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:26:32.512695 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11674bcb_ef1a_45c5_9999_14469538a1c9.slice/crio-7e87bc7b0e69d817fd9c657e00c6a327dcfb4b14f6146e0dfc833554557c380a WatchSource:0}: Error finding container 7e87bc7b0e69d817fd9c657e00c6a327dcfb4b14f6146e0dfc833554557c380a: Status 404 returned error can't find the container with id 7e87bc7b0e69d817fd9c657e00c6a327dcfb4b14f6146e0dfc833554557c380a May 26 10:26:32.687663 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.687622 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" event={"ID":"1772e7c8-d533-4714-837d-bbae4a29a5d7","Type":"ContainerStarted","Data":"2f6b3f75bdacb1e15652707b039ea80460e14d2141ab7394920f94406bce2939"} May 26 10:26:32.688902 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.688867 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-v29zq" event={"ID":"11674bcb-ef1a-45c5-9999-14469538a1c9","Type":"ContainerStarted","Data":"7e87bc7b0e69d817fd9c657e00c6a327dcfb4b14f6146e0dfc833554557c380a"} May 26 10:26:32.689999 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:32.689974 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" event={"ID":"d7f14af8-1c33-4655-9187-af77bdc1df19","Type":"ContainerStarted","Data":"c0699eb9f93118af9cc4f6c9cccc309e80b15e326d7b4dc6c0698c69ed41d6e2"} May 26 10:26:37.713255 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:37.713220 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" event={"ID":"1772e7c8-d533-4714-837d-bbae4a29a5d7","Type":"ContainerStarted","Data":"433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97"} May 26 10:26:37.714460 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:37.714440 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-v29zq" event={"ID":"11674bcb-ef1a-45c5-9999-14469538a1c9","Type":"ContainerStarted","Data":"0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53"} May 26 10:26:37.715767 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:37.715741 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" event={"ID":"d7f14af8-1c33-4655-9187-af77bdc1df19","Type":"ContainerStarted","Data":"7a53ebf0b0dada76172bc1ae00afdb637d1536d4a02259c0cd1c824e9627c1d6"} May 26 10:26:37.715899 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:37.715882 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:26:37.730427 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:37.730377 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" podStartSLOduration=2.361777667 podStartE2EDuration="6.730364637s" podCreationTimestamp="2026-05-26 10:26:31 +0000 UTC" firstStartedPulling="2026-05-26 10:26:32.387823984 +0000 UTC m=+982.180251979" lastFinishedPulling="2026-05-26 10:26:36.756410942 +0000 UTC m=+986.548838949" observedRunningTime="2026-05-26 10:26:37.728764395 +0000 UTC m=+987.521192407" watchObservedRunningTime="2026-05-26 10:26:37.730364637 +0000 UTC m=+987.522792647" May 26 10:26:37.746686 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:37.746637 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-v29zq" podStartSLOduration=1.5045797969999999 podStartE2EDuration="5.746622386s" podCreationTimestamp="2026-05-26 10:26:32 +0000 UTC" firstStartedPulling="2026-05-26 10:26:32.514578935 +0000 UTC m=+982.307006927" lastFinishedPulling="2026-05-26 10:26:36.756621528 +0000 UTC m=+986.549049516" observedRunningTime="2026-05-26 10:26:37.746005996 +0000 UTC m=+987.538434009" watchObservedRunningTime="2026-05-26 10:26:37.746622386 +0000 UTC m=+987.539050401" May 26 10:26:37.763080 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:37.763036 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" podStartSLOduration=1.8579646159999998 podStartE2EDuration="6.763022013s" podCreationTimestamp="2026-05-26 10:26:31 +0000 UTC" firstStartedPulling="2026-05-26 10:26:31.863562455 +0000 UTC m=+981.655990444" lastFinishedPulling="2026-05-26 10:26:36.768619843 +0000 UTC m=+986.561047841" observedRunningTime="2026-05-26 10:26:37.761995549 +0000 UTC m=+987.554423560" watchObservedRunningTime="2026-05-26 10:26:37.763022013 +0000 UTC m=+987.555450024" May 26 10:26:37.770487 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:37.770460 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p7jvf"] May 26 10:26:39.722415 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:39.722377 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" podUID="1772e7c8-d533-4714-837d-bbae4a29a5d7" containerName="authorino" containerID="cri-o://433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97" gracePeriod=30 May 26 10:26:39.961371 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:39.961348 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" May 26 10:26:40.044412 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.044332 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-895h6\" (UniqueName: \"kubernetes.io/projected/1772e7c8-d533-4714-837d-bbae4a29a5d7-kube-api-access-895h6\") pod \"1772e7c8-d533-4714-837d-bbae4a29a5d7\" (UID: \"1772e7c8-d533-4714-837d-bbae4a29a5d7\") " May 26 10:26:40.046115 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.046087 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1772e7c8-d533-4714-837d-bbae4a29a5d7-kube-api-access-895h6" (OuterVolumeSpecName: "kube-api-access-895h6") pod "1772e7c8-d533-4714-837d-bbae4a29a5d7" (UID: "1772e7c8-d533-4714-837d-bbae4a29a5d7"). InnerVolumeSpecName "kube-api-access-895h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:26:40.145372 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.145344 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-895h6\" (UniqueName: \"kubernetes.io/projected/1772e7c8-d533-4714-837d-bbae4a29a5d7-kube-api-access-895h6\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:26:40.726810 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.726771 2557 generic.go:358] "Generic (PLEG): container finished" podID="1772e7c8-d533-4714-837d-bbae4a29a5d7" containerID="433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97" exitCode=0 May 26 10:26:40.727273 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.726821 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" May 26 10:26:40.727273 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.726859 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" event={"ID":"1772e7c8-d533-4714-837d-bbae4a29a5d7","Type":"ContainerDied","Data":"433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97"} May 26 10:26:40.727273 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.726903 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-p7jvf" event={"ID":"1772e7c8-d533-4714-837d-bbae4a29a5d7","Type":"ContainerDied","Data":"2f6b3f75bdacb1e15652707b039ea80460e14d2141ab7394920f94406bce2939"} May 26 10:26:40.727273 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.726925 2557 scope.go:117] "RemoveContainer" containerID="433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97" May 26 10:26:40.736502 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.736282 2557 scope.go:117] "RemoveContainer" containerID="433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97" May 26 10:26:40.736743 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:26:40.736714 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97\": container with ID starting with 433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97 not found: ID does not exist" containerID="433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97" May 26 10:26:40.736828 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.736763 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97"} err="failed to get container status \"433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97\": rpc error: code = NotFound desc = could not find container \"433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97\": container with ID starting with 433295d96aec5962f0599777a6493e8a3ab69b3194c4d259d3c026f3d0facc97 not found: ID does not exist" May 26 10:26:40.749999 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.749969 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p7jvf"] May 26 10:26:40.755772 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.755749 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-p7jvf"] May 26 10:26:40.829387 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:40.829357 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1772e7c8-d533-4714-837d-bbae4a29a5d7" path="/var/lib/kubelet/pods/1772e7c8-d533-4714-837d-bbae4a29a5d7/volumes" May 26 10:26:48.720417 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:26:48.720389 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-4v28s" May 26 10:27:04.980441 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:04.980403 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-hmc76"] May 26 10:27:04.980924 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:04.980897 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1772e7c8-d533-4714-837d-bbae4a29a5d7" containerName="authorino" May 26 10:27:04.980924 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:04.980919 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1772e7c8-d533-4714-837d-bbae4a29a5d7" containerName="authorino" May 26 10:27:04.981121 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:04.981011 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="1772e7c8-d533-4714-837d-bbae4a29a5d7" containerName="authorino" May 26 10:27:04.984007 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:04.983989 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-hmc76" May 26 10:27:04.992858 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:04.992835 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-hmc76"] May 26 10:27:05.050829 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.050800 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqtrk\" (UniqueName: \"kubernetes.io/projected/b93b3da9-e174-40e8-b0fa-89c02fc5a7c3-kube-api-access-kqtrk\") pod \"authorino-8b475cf9f-hmc76\" (UID: \"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3\") " pod="kuadrant-system/authorino-8b475cf9f-hmc76" May 26 10:27:05.151529 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.151486 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqtrk\" (UniqueName: \"kubernetes.io/projected/b93b3da9-e174-40e8-b0fa-89c02fc5a7c3-kube-api-access-kqtrk\") pod \"authorino-8b475cf9f-hmc76\" (UID: \"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3\") " pod="kuadrant-system/authorino-8b475cf9f-hmc76" May 26 10:27:05.160633 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.160611 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqtrk\" (UniqueName: \"kubernetes.io/projected/b93b3da9-e174-40e8-b0fa-89c02fc5a7c3-kube-api-access-kqtrk\") pod \"authorino-8b475cf9f-hmc76\" (UID: \"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3\") " pod="kuadrant-system/authorino-8b475cf9f-hmc76" May 26 10:27:05.203469 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.203444 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-hmc76"] May 26 10:27:05.203668 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.203657 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-hmc76" May 26 10:27:05.233770 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.233706 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77f647c596-j8wpg"] May 26 10:27:05.237949 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.237932 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77f647c596-j8wpg" May 26 10:27:05.252389 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.252360 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77f647c596-j8wpg"] May 26 10:27:05.343738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.343702 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-hmc76"] May 26 10:27:05.345364 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:27:05.345336 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb93b3da9_e174_40e8_b0fa_89c02fc5a7c3.slice/crio-5677e6ddaa6df51718c3893e2fd535e79c0d391fad6732553dbbeeea053b4642 WatchSource:0}: Error finding container 5677e6ddaa6df51718c3893e2fd535e79c0d391fad6732553dbbeeea053b4642: Status 404 returned error can't find the container with id 5677e6ddaa6df51718c3893e2fd535e79c0d391fad6732553dbbeeea053b4642 May 26 10:27:05.360646 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.360620 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvgkg\" (UniqueName: \"kubernetes.io/projected/0ca16c24-5516-44d2-ab69-f11844ff60f4-kube-api-access-wvgkg\") pod \"authorino-77f647c596-j8wpg\" (UID: \"0ca16c24-5516-44d2-ab69-f11844ff60f4\") " pod="kuadrant-system/authorino-77f647c596-j8wpg" May 26 10:27:05.461267 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.461240 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgkg\" (UniqueName: \"kubernetes.io/projected/0ca16c24-5516-44d2-ab69-f11844ff60f4-kube-api-access-wvgkg\") pod \"authorino-77f647c596-j8wpg\" (UID: \"0ca16c24-5516-44d2-ab69-f11844ff60f4\") " pod="kuadrant-system/authorino-77f647c596-j8wpg" May 26 10:27:05.469821 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.469799 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvgkg\" (UniqueName: \"kubernetes.io/projected/0ca16c24-5516-44d2-ab69-f11844ff60f4-kube-api-access-wvgkg\") pod \"authorino-77f647c596-j8wpg\" (UID: \"0ca16c24-5516-44d2-ab69-f11844ff60f4\") " pod="kuadrant-system/authorino-77f647c596-j8wpg" May 26 10:27:05.547507 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.547426 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77f647c596-j8wpg" May 26 10:27:05.665947 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.665926 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77f647c596-j8wpg"] May 26 10:27:05.667890 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:27:05.667865 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ca16c24_5516_44d2_ab69_f11844ff60f4.slice/crio-84d33258e4401e9d580bef95b0cde7e168a2515e0b650fbac07e6d890f14e4a7 WatchSource:0}: Error finding container 84d33258e4401e9d580bef95b0cde7e168a2515e0b650fbac07e6d890f14e4a7: Status 404 returned error can't find the container with id 84d33258e4401e9d580bef95b0cde7e168a2515e0b650fbac07e6d890f14e4a7 May 26 10:27:05.678280 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.678256 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77f647c596-j8wpg"] May 26 10:27:05.707016 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.706988 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77fdbc5d44-l5llj"] May 26 10:27:05.711342 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.711321 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:27:05.718088 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.718067 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 26 10:27:05.720109 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.720087 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77fdbc5d44-l5llj"] May 26 10:27:05.811433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.811373 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77f647c596-j8wpg" event={"ID":"0ca16c24-5516-44d2-ab69-f11844ff60f4","Type":"ContainerStarted","Data":"84d33258e4401e9d580bef95b0cde7e168a2515e0b650fbac07e6d890f14e4a7"} May 26 10:27:05.812717 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.812692 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-hmc76" event={"ID":"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3","Type":"ContainerStarted","Data":"42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1"} May 26 10:27:05.812816 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.812724 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-hmc76" event={"ID":"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3","Type":"ContainerStarted","Data":"5677e6ddaa6df51718c3893e2fd535e79c0d391fad6732553dbbeeea053b4642"} May 26 10:27:05.812816 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.812747 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-hmc76" podUID="b93b3da9-e174-40e8-b0fa-89c02fc5a7c3" containerName="authorino" containerID="cri-o://42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1" gracePeriod=30 May 26 10:27:05.864193 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.864167 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb5v9\" (UniqueName: \"kubernetes.io/projected/0f9e0395-b367-4223-aab8-ad887b3f81dd-kube-api-access-xb5v9\") pod \"authorino-77fdbc5d44-l5llj\" (UID: \"0f9e0395-b367-4223-aab8-ad887b3f81dd\") " pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:27:05.864324 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.864200 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f9e0395-b367-4223-aab8-ad887b3f81dd-tls-cert\") pod \"authorino-77fdbc5d44-l5llj\" (UID: \"0f9e0395-b367-4223-aab8-ad887b3f81dd\") " pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:27:05.965400 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.965373 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xb5v9\" (UniqueName: \"kubernetes.io/projected/0f9e0395-b367-4223-aab8-ad887b3f81dd-kube-api-access-xb5v9\") pod \"authorino-77fdbc5d44-l5llj\" (UID: \"0f9e0395-b367-4223-aab8-ad887b3f81dd\") " pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:27:05.965400 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.965404 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f9e0395-b367-4223-aab8-ad887b3f81dd-tls-cert\") pod \"authorino-77fdbc5d44-l5llj\" (UID: \"0f9e0395-b367-4223-aab8-ad887b3f81dd\") " pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:27:05.967739 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.967715 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f9e0395-b367-4223-aab8-ad887b3f81dd-tls-cert\") pod \"authorino-77fdbc5d44-l5llj\" (UID: \"0f9e0395-b367-4223-aab8-ad887b3f81dd\") " pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:27:05.973358 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:05.973334 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb5v9\" (UniqueName: \"kubernetes.io/projected/0f9e0395-b367-4223-aab8-ad887b3f81dd-kube-api-access-xb5v9\") pod \"authorino-77fdbc5d44-l5llj\" (UID: \"0f9e0395-b367-4223-aab8-ad887b3f81dd\") " pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:27:06.021282 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.021258 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:27:06.045177 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.045150 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-hmc76" May 26 10:27:06.157769 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.157743 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77fdbc5d44-l5llj"] May 26 10:27:06.160240 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:27:06.160209 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f9e0395_b367_4223_aab8_ad887b3f81dd.slice/crio-af9d05c06ea416585e11bfe07b8a7be61312ec91206f4e173a8c851dc588c9c0 WatchSource:0}: Error finding container af9d05c06ea416585e11bfe07b8a7be61312ec91206f4e173a8c851dc588c9c0: Status 404 returned error can't find the container with id af9d05c06ea416585e11bfe07b8a7be61312ec91206f4e173a8c851dc588c9c0 May 26 10:27:06.167099 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.167077 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqtrk\" (UniqueName: \"kubernetes.io/projected/b93b3da9-e174-40e8-b0fa-89c02fc5a7c3-kube-api-access-kqtrk\") pod \"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3\" (UID: \"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3\") " May 26 10:27:06.168972 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.168943 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b93b3da9-e174-40e8-b0fa-89c02fc5a7c3-kube-api-access-kqtrk" (OuterVolumeSpecName: "kube-api-access-kqtrk") pod "b93b3da9-e174-40e8-b0fa-89c02fc5a7c3" (UID: "b93b3da9-e174-40e8-b0fa-89c02fc5a7c3"). InnerVolumeSpecName "kube-api-access-kqtrk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:27:06.268343 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.268307 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqtrk\" (UniqueName: \"kubernetes.io/projected/b93b3da9-e174-40e8-b0fa-89c02fc5a7c3-kube-api-access-kqtrk\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:27:06.817166 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.817086 2557 generic.go:358] "Generic (PLEG): container finished" podID="b93b3da9-e174-40e8-b0fa-89c02fc5a7c3" containerID="42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1" exitCode=2 May 26 10:27:06.817166 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.817137 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-hmc76" May 26 10:27:06.817394 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.817175 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-hmc76" event={"ID":"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3","Type":"ContainerDied","Data":"42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1"} May 26 10:27:06.817394 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.817212 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-hmc76" event={"ID":"b93b3da9-e174-40e8-b0fa-89c02fc5a7c3","Type":"ContainerDied","Data":"5677e6ddaa6df51718c3893e2fd535e79c0d391fad6732553dbbeeea053b4642"} May 26 10:27:06.817394 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.817230 2557 scope.go:117] "RemoveContainer" containerID="42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1" May 26 10:27:06.818704 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.818679 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" event={"ID":"0f9e0395-b367-4223-aab8-ad887b3f81dd","Type":"ContainerStarted","Data":"59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96"} May 26 10:27:06.818812 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.818708 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" event={"ID":"0f9e0395-b367-4223-aab8-ad887b3f81dd","Type":"ContainerStarted","Data":"af9d05c06ea416585e11bfe07b8a7be61312ec91206f4e173a8c851dc588c9c0"} May 26 10:27:06.820053 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.820029 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77f647c596-j8wpg" event={"ID":"0ca16c24-5516-44d2-ab69-f11844ff60f4","Type":"ContainerStarted","Data":"9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e"} May 26 10:27:06.820154 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.820114 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-77f647c596-j8wpg" podUID="0ca16c24-5516-44d2-ab69-f11844ff60f4" containerName="authorino" containerID="cri-o://9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e" gracePeriod=30 May 26 10:27:06.825608 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.825458 2557 scope.go:117] "RemoveContainer" containerID="42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1" May 26 10:27:06.825848 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:27:06.825826 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1\": container with ID starting with 42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1 not found: ID does not exist" containerID="42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1" May 26 10:27:06.825927 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.825859 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1"} err="failed to get container status \"42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1\": rpc error: code = NotFound desc = could not find container \"42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1\": container with ID starting with 42a24b0d1b99b301ce5ada8e893f1aacc107b0a13608e3d0fe27448e0da1f1c1 not found: ID does not exist" May 26 10:27:06.835848 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.835800 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-77f647c596-j8wpg" podStartSLOduration=1.525289877 podStartE2EDuration="1.835784776s" podCreationTimestamp="2026-05-26 10:27:05 +0000 UTC" firstStartedPulling="2026-05-26 10:27:05.669231711 +0000 UTC m=+1015.461659701" lastFinishedPulling="2026-05-26 10:27:05.979726596 +0000 UTC m=+1015.772154600" observedRunningTime="2026-05-26 10:27:06.834966461 +0000 UTC m=+1016.627394486" watchObservedRunningTime="2026-05-26 10:27:06.835784776 +0000 UTC m=+1016.628212788" May 26 10:27:06.850768 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.850733 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" podStartSLOduration=1.5269977959999999 podStartE2EDuration="1.850721914s" podCreationTimestamp="2026-05-26 10:27:05 +0000 UTC" firstStartedPulling="2026-05-26 10:27:06.161621725 +0000 UTC m=+1015.954049714" lastFinishedPulling="2026-05-26 10:27:06.485345841 +0000 UTC m=+1016.277773832" observedRunningTime="2026-05-26 10:27:06.849901214 +0000 UTC m=+1016.642329226" watchObservedRunningTime="2026-05-26 10:27:06.850721914 +0000 UTC m=+1016.643149924" May 26 10:27:06.866403 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.866377 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-hmc76"] May 26 10:27:06.871064 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.871042 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-hmc76"] May 26 10:27:06.875766 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.875744 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-v29zq"] May 26 10:27:06.875940 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:06.875920 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-v29zq" podUID="11674bcb-ef1a-45c5-9999-14469538a1c9" containerName="authorino" containerID="cri-o://0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53" gracePeriod=30 May 26 10:27:07.114241 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.114219 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77f647c596-j8wpg" May 26 10:27:07.122065 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.122049 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-v29zq" May 26 10:27:07.174946 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.174926 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvgkg\" (UniqueName: \"kubernetes.io/projected/0ca16c24-5516-44d2-ab69-f11844ff60f4-kube-api-access-wvgkg\") pod \"0ca16c24-5516-44d2-ab69-f11844ff60f4\" (UID: \"0ca16c24-5516-44d2-ab69-f11844ff60f4\") " May 26 10:27:07.176873 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.176846 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca16c24-5516-44d2-ab69-f11844ff60f4-kube-api-access-wvgkg" (OuterVolumeSpecName: "kube-api-access-wvgkg") pod "0ca16c24-5516-44d2-ab69-f11844ff60f4" (UID: "0ca16c24-5516-44d2-ab69-f11844ff60f4"). InnerVolumeSpecName "kube-api-access-wvgkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:27:07.276128 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.276096 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xwkf\" (UniqueName: \"kubernetes.io/projected/11674bcb-ef1a-45c5-9999-14469538a1c9-kube-api-access-7xwkf\") pod \"11674bcb-ef1a-45c5-9999-14469538a1c9\" (UID: \"11674bcb-ef1a-45c5-9999-14469538a1c9\") " May 26 10:27:07.276267 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.276233 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvgkg\" (UniqueName: \"kubernetes.io/projected/0ca16c24-5516-44d2-ab69-f11844ff60f4-kube-api-access-wvgkg\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:27:07.277953 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.277924 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11674bcb-ef1a-45c5-9999-14469538a1c9-kube-api-access-7xwkf" (OuterVolumeSpecName: "kube-api-access-7xwkf") pod "11674bcb-ef1a-45c5-9999-14469538a1c9" (UID: "11674bcb-ef1a-45c5-9999-14469538a1c9"). InnerVolumeSpecName "kube-api-access-7xwkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:27:07.376965 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.376947 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xwkf\" (UniqueName: \"kubernetes.io/projected/11674bcb-ef1a-45c5-9999-14469538a1c9-kube-api-access-7xwkf\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:27:07.824833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.824748 2557 generic.go:358] "Generic (PLEG): container finished" podID="11674bcb-ef1a-45c5-9999-14469538a1c9" containerID="0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53" exitCode=0 May 26 10:27:07.824833 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.824804 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-v29zq" May 26 10:27:07.825052 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.824830 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-v29zq" event={"ID":"11674bcb-ef1a-45c5-9999-14469538a1c9","Type":"ContainerDied","Data":"0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53"} May 26 10:27:07.825052 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.824860 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-v29zq" event={"ID":"11674bcb-ef1a-45c5-9999-14469538a1c9","Type":"ContainerDied","Data":"7e87bc7b0e69d817fd9c657e00c6a327dcfb4b14f6146e0dfc833554557c380a"} May 26 10:27:07.825052 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.824882 2557 scope.go:117] "RemoveContainer" containerID="0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53" May 26 10:27:07.826133 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.826089 2557 generic.go:358] "Generic (PLEG): container finished" podID="0ca16c24-5516-44d2-ab69-f11844ff60f4" containerID="9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e" exitCode=0 May 26 10:27:07.826200 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.826169 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77f647c596-j8wpg" event={"ID":"0ca16c24-5516-44d2-ab69-f11844ff60f4","Type":"ContainerDied","Data":"9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e"} May 26 10:27:07.826249 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.826194 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77f647c596-j8wpg" May 26 10:27:07.826296 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.826192 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77f647c596-j8wpg" event={"ID":"0ca16c24-5516-44d2-ab69-f11844ff60f4","Type":"ContainerDied","Data":"84d33258e4401e9d580bef95b0cde7e168a2515e0b650fbac07e6d890f14e4a7"} May 26 10:27:07.835003 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.834988 2557 scope.go:117] "RemoveContainer" containerID="0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53" May 26 10:27:07.835246 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:27:07.835225 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53\": container with ID starting with 0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53 not found: ID does not exist" containerID="0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53" May 26 10:27:07.835345 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.835250 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53"} err="failed to get container status \"0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53\": rpc error: code = NotFound desc = could not find container \"0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53\": container with ID starting with 0101e188ff0e87c4ca7d14b9c42a98d8439d674fe423ca7b6a4686a1c256ba53 not found: ID does not exist" May 26 10:27:07.835345 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.835268 2557 scope.go:117] "RemoveContainer" containerID="9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e" May 26 10:27:07.844298 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.844260 2557 scope.go:117] "RemoveContainer" containerID="9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e" May 26 10:27:07.844575 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:27:07.844553 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e\": container with ID starting with 9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e not found: ID does not exist" containerID="9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e" May 26 10:27:07.844690 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.844581 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e"} err="failed to get container status \"9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e\": rpc error: code = NotFound desc = could not find container \"9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e\": container with ID starting with 9a5c6e1c9dc66ab95c18778949f8932521917955981e6084198b804f41e74b5e not found: ID does not exist" May 26 10:27:07.850471 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.850449 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-v29zq"] May 26 10:27:07.859368 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.859341 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-v29zq"] May 26 10:27:07.869773 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.869747 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77f647c596-j8wpg"] May 26 10:27:07.872213 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:07.872191 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77f647c596-j8wpg"] May 26 10:27:08.830200 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:08.830158 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ca16c24-5516-44d2-ab69-f11844ff60f4" path="/var/lib/kubelet/pods/0ca16c24-5516-44d2-ab69-f11844ff60f4/volumes" May 26 10:27:08.830655 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:08.830637 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11674bcb-ef1a-45c5-9999-14469538a1c9" path="/var/lib/kubelet/pods/11674bcb-ef1a-45c5-9999-14469538a1c9/volumes" May 26 10:27:08.830997 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:08.830981 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b93b3da9-e174-40e8-b0fa-89c02fc5a7c3" path="/var/lib/kubelet/pods/b93b3da9-e174-40e8-b0fa-89c02fc5a7c3/volumes" May 26 10:27:42.873762 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:42.873726 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:27:59.725258 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:27:59.725178 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:28:10.922409 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:28:10.922373 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:28:22.930472 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:28:22.930437 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:28:25.629135 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:28:25.629098 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:28:50.129615 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:28:50.129583 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:29:07.631931 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:07.631898 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:29:28.459122 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459041 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57b6d85ff7-dxg8f"] May 26 10:29:28.459533 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459431 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11674bcb-ef1a-45c5-9999-14469538a1c9" containerName="authorino" May 26 10:29:28.459533 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459446 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="11674bcb-ef1a-45c5-9999-14469538a1c9" containerName="authorino" May 26 10:29:28.459533 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459463 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b93b3da9-e174-40e8-b0fa-89c02fc5a7c3" containerName="authorino" May 26 10:29:28.459533 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459468 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b93b3da9-e174-40e8-b0fa-89c02fc5a7c3" containerName="authorino" May 26 10:29:28.459533 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459475 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca16c24-5516-44d2-ab69-f11844ff60f4" containerName="authorino" May 26 10:29:28.459533 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459481 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca16c24-5516-44d2-ab69-f11844ff60f4" containerName="authorino" May 26 10:29:28.459757 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459554 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="b93b3da9-e174-40e8-b0fa-89c02fc5a7c3" containerName="authorino" May 26 10:29:28.459757 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459565 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="11674bcb-ef1a-45c5-9999-14469538a1c9" containerName="authorino" May 26 10:29:28.459757 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.459572 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ca16c24-5516-44d2-ab69-f11844ff60f4" containerName="authorino" May 26 10:29:28.461226 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.461212 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" May 26 10:29:28.470523 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.470483 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b6d85ff7-dxg8f"] May 26 10:29:28.536649 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.536620 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-648g9\" (UniqueName: \"kubernetes.io/projected/2999dd93-c85b-419c-8d20-27d0d602ec8d-kube-api-access-648g9\") pod \"authorino-57b6d85ff7-dxg8f\" (UID: \"2999dd93-c85b-419c-8d20-27d0d602ec8d\") " pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" May 26 10:29:28.536798 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.536655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2999dd93-c85b-419c-8d20-27d0d602ec8d-tls-cert\") pod \"authorino-57b6d85ff7-dxg8f\" (UID: \"2999dd93-c85b-419c-8d20-27d0d602ec8d\") " pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" May 26 10:29:28.637188 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.637158 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-648g9\" (UniqueName: \"kubernetes.io/projected/2999dd93-c85b-419c-8d20-27d0d602ec8d-kube-api-access-648g9\") pod \"authorino-57b6d85ff7-dxg8f\" (UID: \"2999dd93-c85b-419c-8d20-27d0d602ec8d\") " pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" May 26 10:29:28.637330 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.637194 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2999dd93-c85b-419c-8d20-27d0d602ec8d-tls-cert\") pod \"authorino-57b6d85ff7-dxg8f\" (UID: \"2999dd93-c85b-419c-8d20-27d0d602ec8d\") " pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" May 26 10:29:28.639592 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.639567 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2999dd93-c85b-419c-8d20-27d0d602ec8d-tls-cert\") pod \"authorino-57b6d85ff7-dxg8f\" (UID: \"2999dd93-c85b-419c-8d20-27d0d602ec8d\") " pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" May 26 10:29:28.645337 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.645317 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-648g9\" (UniqueName: \"kubernetes.io/projected/2999dd93-c85b-419c-8d20-27d0d602ec8d-kube-api-access-648g9\") pod \"authorino-57b6d85ff7-dxg8f\" (UID: \"2999dd93-c85b-419c-8d20-27d0d602ec8d\") " pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" May 26 10:29:28.770745 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.770673 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" May 26 10:29:28.891699 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.891652 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b6d85ff7-dxg8f"] May 26 10:29:28.894491 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:29:28.894464 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2999dd93_c85b_419c_8d20_27d0d602ec8d.slice/crio-3523c6fcd6c1fdfa6f74a04a29a8a8a035f1d5eb150aad8f8c6ee89a6db6b04f WatchSource:0}: Error finding container 3523c6fcd6c1fdfa6f74a04a29a8a8a035f1d5eb150aad8f8c6ee89a6db6b04f: Status 404 returned error can't find the container with id 3523c6fcd6c1fdfa6f74a04a29a8a8a035f1d5eb150aad8f8c6ee89a6db6b04f May 26 10:29:28.896039 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:28.896024 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:29:29.275005 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:29.274967 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" event={"ID":"2999dd93-c85b-419c-8d20-27d0d602ec8d","Type":"ContainerStarted","Data":"3523c6fcd6c1fdfa6f74a04a29a8a8a035f1d5eb150aad8f8c6ee89a6db6b04f"} May 26 10:29:30.279911 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.279876 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" event={"ID":"2999dd93-c85b-419c-8d20-27d0d602ec8d","Type":"ContainerStarted","Data":"4cc16b33a1580864fd8811bbdc2824a8a2f9660cba64b466363fd951608a61d2"} May 26 10:29:30.297129 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.297086 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-57b6d85ff7-dxg8f" podStartSLOduration=1.857121757 podStartE2EDuration="2.297073781s" podCreationTimestamp="2026-05-26 10:29:28 +0000 UTC" firstStartedPulling="2026-05-26 10:29:28.896142565 +0000 UTC m=+1158.688570554" lastFinishedPulling="2026-05-26 10:29:29.336094586 +0000 UTC m=+1159.128522578" observedRunningTime="2026-05-26 10:29:30.295737911 +0000 UTC m=+1160.088165994" watchObservedRunningTime="2026-05-26 10:29:30.297073781 +0000 UTC m=+1160.089501793" May 26 10:29:30.323665 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.323639 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77fdbc5d44-l5llj"] May 26 10:29:30.323885 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.323864 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" podUID="0f9e0395-b367-4223-aab8-ad887b3f81dd" containerName="authorino" containerID="cri-o://59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96" gracePeriod=30 May 26 10:29:30.578749 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.578728 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:29:30.652292 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.652260 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f9e0395-b367-4223-aab8-ad887b3f81dd-tls-cert\") pod \"0f9e0395-b367-4223-aab8-ad887b3f81dd\" (UID: \"0f9e0395-b367-4223-aab8-ad887b3f81dd\") " May 26 10:29:30.652468 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.652309 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb5v9\" (UniqueName: \"kubernetes.io/projected/0f9e0395-b367-4223-aab8-ad887b3f81dd-kube-api-access-xb5v9\") pod \"0f9e0395-b367-4223-aab8-ad887b3f81dd\" (UID: \"0f9e0395-b367-4223-aab8-ad887b3f81dd\") " May 26 10:29:30.654418 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.654389 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9e0395-b367-4223-aab8-ad887b3f81dd-kube-api-access-xb5v9" (OuterVolumeSpecName: "kube-api-access-xb5v9") pod "0f9e0395-b367-4223-aab8-ad887b3f81dd" (UID: "0f9e0395-b367-4223-aab8-ad887b3f81dd"). InnerVolumeSpecName "kube-api-access-xb5v9". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:29:30.661452 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.661427 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f9e0395-b367-4223-aab8-ad887b3f81dd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0f9e0395-b367-4223-aab8-ad887b3f81dd" (UID: "0f9e0395-b367-4223-aab8-ad887b3f81dd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:29:30.753033 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.753003 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f9e0395-b367-4223-aab8-ad887b3f81dd-tls-cert\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:29:30.753033 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:30.753027 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb5v9\" (UniqueName: \"kubernetes.io/projected/0f9e0395-b367-4223-aab8-ad887b3f81dd-kube-api-access-xb5v9\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:29:31.284126 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.284091 2557 generic.go:358] "Generic (PLEG): container finished" podID="0f9e0395-b367-4223-aab8-ad887b3f81dd" containerID="59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96" exitCode=0 May 26 10:29:31.284613 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.284143 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" May 26 10:29:31.284613 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.284181 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" event={"ID":"0f9e0395-b367-4223-aab8-ad887b3f81dd","Type":"ContainerDied","Data":"59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96"} May 26 10:29:31.284613 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.284216 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77fdbc5d44-l5llj" event={"ID":"0f9e0395-b367-4223-aab8-ad887b3f81dd","Type":"ContainerDied","Data":"af9d05c06ea416585e11bfe07b8a7be61312ec91206f4e173a8c851dc588c9c0"} May 26 10:29:31.284613 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.284237 2557 scope.go:117] "RemoveContainer" containerID="59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96" May 26 10:29:31.291948 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.291930 2557 scope.go:117] "RemoveContainer" containerID="59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96" May 26 10:29:31.292174 ip-10-0-139-163 kubenswrapper[2557]: E0526 10:29:31.292155 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96\": container with ID starting with 59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96 not found: ID does not exist" containerID="59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96" May 26 10:29:31.292223 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.292181 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96"} err="failed to get container status \"59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96\": rpc error: code = NotFound desc = could not find container \"59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96\": container with ID starting with 59ef59f89eda07680e5fd2ebd9b8e4340bcebb3fa339c7182c47deb2efe8de96 not found: ID does not exist" May 26 10:29:31.299695 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.299669 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77fdbc5d44-l5llj"] May 26 10:29:31.303202 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:31.303183 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77fdbc5d44-l5llj"] May 26 10:29:32.829089 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:32.829054 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f9e0395-b367-4223-aab8-ad887b3f81dd" path="/var/lib/kubelet/pods/0f9e0395-b367-4223-aab8-ad887b3f81dd/volumes" May 26 10:29:59.234094 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:29:59.234052 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:30:00.168012 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.167981 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663190-n445r"] May 26 10:30:00.168280 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.168270 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9e0395-b367-4223-aab8-ad887b3f81dd" containerName="authorino" May 26 10:30:00.168324 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.168282 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9e0395-b367-4223-aab8-ad887b3f81dd" containerName="authorino" May 26 10:30:00.168358 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.168342 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f9e0395-b367-4223-aab8-ad887b3f81dd" containerName="authorino" May 26 10:30:00.170198 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.170183 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663190-n445r" May 26 10:30:00.172911 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.172883 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-twhh9\"" May 26 10:30:00.181282 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.181259 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663190-n445r"] May 26 10:30:00.290364 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.290327 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5pz5\" (UniqueName: \"kubernetes.io/projected/315b08cb-2a73-4d0a-a87c-75aec483564c-kube-api-access-l5pz5\") pod \"maas-api-key-cleanup-29663190-n445r\" (UID: \"315b08cb-2a73-4d0a-a87c-75aec483564c\") " pod="opendatahub/maas-api-key-cleanup-29663190-n445r" May 26 10:30:00.390724 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.390696 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5pz5\" (UniqueName: \"kubernetes.io/projected/315b08cb-2a73-4d0a-a87c-75aec483564c-kube-api-access-l5pz5\") pod \"maas-api-key-cleanup-29663190-n445r\" (UID: \"315b08cb-2a73-4d0a-a87c-75aec483564c\") " pod="opendatahub/maas-api-key-cleanup-29663190-n445r" May 26 10:30:00.399571 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.399546 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5pz5\" (UniqueName: \"kubernetes.io/projected/315b08cb-2a73-4d0a-a87c-75aec483564c-kube-api-access-l5pz5\") pod \"maas-api-key-cleanup-29663190-n445r\" (UID: \"315b08cb-2a73-4d0a-a87c-75aec483564c\") " pod="opendatahub/maas-api-key-cleanup-29663190-n445r" May 26 10:30:00.480889 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.480809 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663190-n445r" May 26 10:30:00.621555 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:00.621526 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663190-n445r"] May 26 10:30:00.625183 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:30:00.625139 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315b08cb_2a73_4d0a_a87c_75aec483564c.slice/crio-7043d1ce7590d11369bfd297746b8727195383f51ac622c4f607dda3679bad02 WatchSource:0}: Error finding container 7043d1ce7590d11369bfd297746b8727195383f51ac622c4f607dda3679bad02: Status 404 returned error can't find the container with id 7043d1ce7590d11369bfd297746b8727195383f51ac622c4f607dda3679bad02 May 26 10:30:01.377682 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:01.377634 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663190-n445r" event={"ID":"315b08cb-2a73-4d0a-a87c-75aec483564c","Type":"ContainerStarted","Data":"7043d1ce7590d11369bfd297746b8727195383f51ac622c4f607dda3679bad02"} May 26 10:30:04.389973 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:04.389938 2557 generic.go:358] "Generic (PLEG): container finished" podID="315b08cb-2a73-4d0a-a87c-75aec483564c" containerID="99d930a0e87d6d70e55d9e5876edd0f9710ae131cdede63f7aeeb78edc1b310f" exitCode=0 May 26 10:30:04.390339 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:04.390021 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663190-n445r" event={"ID":"315b08cb-2a73-4d0a-a87c-75aec483564c","Type":"ContainerDied","Data":"99d930a0e87d6d70e55d9e5876edd0f9710ae131cdede63f7aeeb78edc1b310f"} May 26 10:30:05.520838 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:05.520813 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663190-n445r" May 26 10:30:05.636267 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:05.636240 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5pz5\" (UniqueName: \"kubernetes.io/projected/315b08cb-2a73-4d0a-a87c-75aec483564c-kube-api-access-l5pz5\") pod \"315b08cb-2a73-4d0a-a87c-75aec483564c\" (UID: \"315b08cb-2a73-4d0a-a87c-75aec483564c\") " May 26 10:30:05.638333 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:05.638309 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315b08cb-2a73-4d0a-a87c-75aec483564c-kube-api-access-l5pz5" (OuterVolumeSpecName: "kube-api-access-l5pz5") pod "315b08cb-2a73-4d0a-a87c-75aec483564c" (UID: "315b08cb-2a73-4d0a-a87c-75aec483564c"). InnerVolumeSpecName "kube-api-access-l5pz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:30:05.737734 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:05.737639 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5pz5\" (UniqueName: \"kubernetes.io/projected/315b08cb-2a73-4d0a-a87c-75aec483564c-kube-api-access-l5pz5\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:30:06.397615 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:06.397578 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663190-n445r" event={"ID":"315b08cb-2a73-4d0a-a87c-75aec483564c","Type":"ContainerDied","Data":"7043d1ce7590d11369bfd297746b8727195383f51ac622c4f607dda3679bad02"} May 26 10:30:06.397615 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:06.397611 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7043d1ce7590d11369bfd297746b8727195383f51ac622c4f607dda3679bad02" May 26 10:30:06.397615 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:06.397619 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663190-n445r" May 26 10:30:08.521190 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:08.521151 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:30:10.800007 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:10.799976 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:30:10.802389 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:10.802367 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:30:18.032916 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:18.032882 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:30:28.526738 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:28.526702 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:30:37.656262 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:37.656216 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:30:47.422265 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:30:47.422222 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:32:00.237159 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:32:00.237122 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:32:14.930771 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:32:14.930739 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:32:54.133628 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:32:54.133589 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:33:10.830007 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:33:10.829968 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:33:25.364131 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:33:25.364091 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:33:41.783192 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:33:41.783157 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:34:35.332803 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:34:35.332764 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:34:45.139633 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:34:45.139598 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:35:01.129044 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:35:01.129006 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:35:10.424379 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:35:10.424334 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:35:10.821864 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:35:10.821779 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:35:10.826653 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:35:10.826628 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:35:27.233339 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:35:27.233242 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:35:35.732474 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:35:35.732438 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:36:08.421332 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:36:08.421292 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:36:16.425580 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:36:16.425542 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:36:25.324151 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:36:25.324114 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:36:32.823450 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:36:32.823413 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:36:41.124185 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:36:41.124149 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:36:59.033250 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:36:59.033169 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:37:11.664975 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:37:11.664940 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:37:59.224394 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:37:59.224355 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:38:03.526746 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:38:03.526707 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:38:10.131440 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:38:10.131399 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:38:18.430581 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:38:18.430542 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:38:27.642819 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:38:27.642739 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:38:35.928306 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:38:35.928263 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:38:45.137697 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:38:45.137665 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:38:53.246818 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:38:53.246778 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:39:01.931148 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:39:01.931111 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:39:11.132068 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:39:11.132029 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:39:20.428432 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:39:20.428398 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:39:29.133494 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:39:29.133459 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:39:37.744787 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:39:37.744757 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:39:46.084620 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:39:46.084587 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:39:55.322175 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:39:55.322094 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:40:02.941853 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:40:02.941817 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:40:10.842706 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:40:10.842678 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:40:10.848023 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:40:10.848003 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:40:12.037316 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:40:12.037286 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:40:20.328673 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:40:20.328640 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:42:36.927766 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:42:36.927732 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:42:42.522451 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:42:42.522388 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:43:08.627107 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:43:08.627030 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:43:15.733053 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:43:15.733015 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:43:25.022132 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:43:25.022097 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:43:35.925693 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:43:35.925628 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:43:43.632864 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:43:43.632820 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:43:54.432896 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:43:54.432859 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:44:03.027790 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:44:03.027754 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:44:14.722790 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:44:14.722752 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:44:22.524913 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:44:22.524877 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:44:33.421531 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:44:33.421470 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:44:42.434839 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:44:42.434801 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:45:00.132170 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.132133 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663205-fh74p"] May 26 10:45:00.132578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.132443 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b08cb-2a73-4d0a-a87c-75aec483564c" containerName="cleanup" May 26 10:45:00.132578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.132455 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b08cb-2a73-4d0a-a87c-75aec483564c" containerName="cleanup" May 26 10:45:00.132578 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.132528 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="315b08cb-2a73-4d0a-a87c-75aec483564c" containerName="cleanup" May 26 10:45:00.135773 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.135758 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" May 26 10:45:00.138221 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.138196 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-twhh9\"" May 26 10:45:00.150057 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.150034 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663205-fh74p"] May 26 10:45:00.258851 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.258819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxh45\" (UniqueName: \"kubernetes.io/projected/314fc60d-7081-4d43-92fb-c1d9863a3e81-kube-api-access-qxh45\") pod \"maas-api-key-cleanup-29663205-fh74p\" (UID: \"314fc60d-7081-4d43-92fb-c1d9863a3e81\") " pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" May 26 10:45:00.360137 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.360102 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxh45\" (UniqueName: \"kubernetes.io/projected/314fc60d-7081-4d43-92fb-c1d9863a3e81-kube-api-access-qxh45\") pod \"maas-api-key-cleanup-29663205-fh74p\" (UID: \"314fc60d-7081-4d43-92fb-c1d9863a3e81\") " pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" May 26 10:45:00.368877 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.368852 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxh45\" (UniqueName: \"kubernetes.io/projected/314fc60d-7081-4d43-92fb-c1d9863a3e81-kube-api-access-qxh45\") pod \"maas-api-key-cleanup-29663205-fh74p\" (UID: \"314fc60d-7081-4d43-92fb-c1d9863a3e81\") " pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" May 26 10:45:00.446824 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.446748 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" May 26 10:45:00.568206 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.568179 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663205-fh74p"] May 26 10:45:00.569920 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:45:00.569893 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314fc60d_7081_4d43_92fb_c1d9863a3e81.slice/crio-c33696f1ba590c19111017156734b29e2f24c605de1299274c0b6299c21d59a6 WatchSource:0}: Error finding container c33696f1ba590c19111017156734b29e2f24c605de1299274c0b6299c21d59a6: Status 404 returned error can't find the container with id c33696f1ba590c19111017156734b29e2f24c605de1299274c0b6299c21d59a6 May 26 10:45:00.571665 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:00.571644 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:45:01.146442 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:01.146403 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" event={"ID":"314fc60d-7081-4d43-92fb-c1d9863a3e81","Type":"ContainerStarted","Data":"2b84ded2c378a21a7eab5b2e4aec67dcd16672b203b733e1ee608bb9ff6a2509"} May 26 10:45:01.146442 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:01.146444 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" event={"ID":"314fc60d-7081-4d43-92fb-c1d9863a3e81","Type":"ContainerStarted","Data":"c33696f1ba590c19111017156734b29e2f24c605de1299274c0b6299c21d59a6"} May 26 10:45:01.162172 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:01.162130 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" podStartSLOduration=1.162115761 podStartE2EDuration="1.162115761s" podCreationTimestamp="2026-05-26 10:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:45:01.160753523 +0000 UTC m=+2090.953181533" watchObservedRunningTime="2026-05-26 10:45:01.162115761 +0000 UTC m=+2090.954543772" May 26 10:45:02.150504 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:02.150467 2557 generic.go:358] "Generic (PLEG): container finished" podID="314fc60d-7081-4d43-92fb-c1d9863a3e81" containerID="2b84ded2c378a21a7eab5b2e4aec67dcd16672b203b733e1ee608bb9ff6a2509" exitCode=0 May 26 10:45:02.150944 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:02.150552 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" event={"ID":"314fc60d-7081-4d43-92fb-c1d9863a3e81","Type":"ContainerDied","Data":"2b84ded2c378a21a7eab5b2e4aec67dcd16672b203b733e1ee608bb9ff6a2509"} May 26 10:45:03.278950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:03.278930 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" May 26 10:45:03.383286 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:03.383255 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxh45\" (UniqueName: \"kubernetes.io/projected/314fc60d-7081-4d43-92fb-c1d9863a3e81-kube-api-access-qxh45\") pod \"314fc60d-7081-4d43-92fb-c1d9863a3e81\" (UID: \"314fc60d-7081-4d43-92fb-c1d9863a3e81\") " May 26 10:45:03.385347 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:03.385313 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/314fc60d-7081-4d43-92fb-c1d9863a3e81-kube-api-access-qxh45" (OuterVolumeSpecName: "kube-api-access-qxh45") pod "314fc60d-7081-4d43-92fb-c1d9863a3e81" (UID: "314fc60d-7081-4d43-92fb-c1d9863a3e81"). InnerVolumeSpecName "kube-api-access-qxh45". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:45:03.483924 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:03.483841 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxh45\" (UniqueName: \"kubernetes.io/projected/314fc60d-7081-4d43-92fb-c1d9863a3e81-kube-api-access-qxh45\") on node \"ip-10-0-139-163.ec2.internal\" DevicePath \"\"" May 26 10:45:04.157973 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:04.157946 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" May 26 10:45:04.158167 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:04.157943 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663205-fh74p" event={"ID":"314fc60d-7081-4d43-92fb-c1d9863a3e81","Type":"ContainerDied","Data":"c33696f1ba590c19111017156734b29e2f24c605de1299274c0b6299c21d59a6"} May 26 10:45:04.158167 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:04.158054 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c33696f1ba590c19111017156734b29e2f24c605de1299274c0b6299c21d59a6" May 26 10:45:10.864118 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:10.864093 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:45:10.869412 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:10.869391 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:45:14.925720 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:14.925686 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:45:57.326854 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:45:57.326782 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:46:06.624027 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:46:06.623976 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:46:15.921378 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:46:15.921339 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:46:24.236891 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:46:24.236851 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:46:31.624169 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:46:31.624135 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:46:43.328710 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:46:43.328679 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:46:51.325685 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:46:51.325650 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:46:58.426693 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:46:58.426645 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:47:08.726825 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:47:08.726787 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:47:16.228179 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:47:16.228133 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:47:24.735378 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:47:24.735293 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:47:34.724504 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:47:34.724468 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:47:53.316936 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:47:53.316899 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:48:00.738978 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:48:00.738928 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:48:09.925784 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:48:09.925748 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:48:17.825793 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:48:17.825763 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:48:34.829404 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:48:34.829370 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:48:43.737254 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:48:43.737221 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:48:52.828942 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:48:52.828910 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:49:00.523355 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:49:00.523322 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:49:09.635023 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:49:09.634989 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:49:18.319529 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:49:18.319475 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:49:26.527826 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:49:26.527792 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:49:37.933851 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:49:37.933810 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:49:46.934306 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:49:46.934272 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:50:00.230204 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:00.230086 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:50:10.435456 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:10.435416 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:50:10.884698 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:10.884673 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:50:10.890222 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:10.890205 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tdnl7_9ebc88d7-bb80-4c64-b239-c1635d55af86/ovn-acl-logging/0.log" May 26 10:50:16.126170 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:16.126133 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:50:26.833876 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:26.833790 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:50:32.126667 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:32.126627 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:50:37.831431 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:37.831395 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:50:50.127463 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:50.127432 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:50:58.743869 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:50:58.743831 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:51:06.938827 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:51:06.938788 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:51:15.236977 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:51:15.236940 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:51:39.024410 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:51:39.024371 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:51:52.118865 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:51:52.118828 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-4v28s"] May 26 10:51:54.801004 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:51:54.800914 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57b6d85ff7-dxg8f_2999dd93-c85b-419c-8d20-27d0d602ec8d/authorino/0.log" May 26 10:51:59.201404 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:51:59.201372 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663190-n445r_315b08cb-2a73-4d0a-a87c-75aec483564c/cleanup/0.log" May 26 10:51:59.301037 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:51:59.301006 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663205-fh74p_314fc60d-7081-4d43-92fb-c1d9863a3e81/cleanup/0.log" May 26 10:51:59.642109 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:51:59.642077 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c66b4d846-8rr6c_eaf1f784-0b96-40b1-8ede-a78d3618431b/manager/0.log" May 26 10:52:01.159963 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:01.159932 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57b6d85ff7-dxg8f_2999dd93-c85b-419c-8d20-27d0d602ec8d/authorino/0.log" May 26 10:52:01.788450 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:01.788420 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-4v28s_d7f14af8-1c33-4655-9187-af77bdc1df19/limitador/0.log" May 26 10:52:01.921625 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:01.921593 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-m2tlj_f3bda622-f973-48fb-ac76-459bee98a2d2/manager/0.log" May 26 10:52:02.572280 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:02.572245 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-546bd7d749-glwtk_2c66c751-71d4-4a76-bd1b-3e1684680171/kube-auth-proxy/0.log" May 26 10:52:07.921721 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.921687 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7hzkl/must-gather-856k2"] May 26 10:52:07.922085 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.922010 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="314fc60d-7081-4d43-92fb-c1d9863a3e81" containerName="cleanup" May 26 10:52:07.922085 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.922023 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="314fc60d-7081-4d43-92fb-c1d9863a3e81" containerName="cleanup" May 26 10:52:07.922178 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.922088 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="314fc60d-7081-4d43-92fb-c1d9863a3e81" containerName="cleanup" May 26 10:52:07.925386 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.925366 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hzkl/must-gather-856k2" May 26 10:52:07.928000 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.927979 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hzkl\"/\"openshift-service-ca.crt\"" May 26 10:52:07.929136 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.929085 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hzkl\"/\"kube-root-ca.crt\"" May 26 10:52:07.929136 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.929095 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7hzkl\"/\"default-dockercfg-lch6v\"" May 26 10:52:07.941395 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.941376 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hzkl/must-gather-856k2"] May 26 10:52:07.962564 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.962541 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz66r\" (UniqueName: \"kubernetes.io/projected/df6128e0-c511-4f00-8802-6a2e3797bf3a-kube-api-access-pz66r\") pod \"must-gather-856k2\" (UID: \"df6128e0-c511-4f00-8802-6a2e3797bf3a\") " pod="openshift-must-gather-7hzkl/must-gather-856k2" May 26 10:52:07.962663 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:07.962575 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df6128e0-c511-4f00-8802-6a2e3797bf3a-must-gather-output\") pod \"must-gather-856k2\" (UID: \"df6128e0-c511-4f00-8802-6a2e3797bf3a\") " pod="openshift-must-gather-7hzkl/must-gather-856k2" May 26 10:52:08.063667 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:08.063638 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df6128e0-c511-4f00-8802-6a2e3797bf3a-must-gather-output\") pod \"must-gather-856k2\" (UID: \"df6128e0-c511-4f00-8802-6a2e3797bf3a\") " pod="openshift-must-gather-7hzkl/must-gather-856k2" May 26 10:52:08.063817 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:08.063740 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pz66r\" (UniqueName: \"kubernetes.io/projected/df6128e0-c511-4f00-8802-6a2e3797bf3a-kube-api-access-pz66r\") pod \"must-gather-856k2\" (UID: \"df6128e0-c511-4f00-8802-6a2e3797bf3a\") " pod="openshift-must-gather-7hzkl/must-gather-856k2" May 26 10:52:08.063983 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:08.063955 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df6128e0-c511-4f00-8802-6a2e3797bf3a-must-gather-output\") pod \"must-gather-856k2\" (UID: \"df6128e0-c511-4f00-8802-6a2e3797bf3a\") " pod="openshift-must-gather-7hzkl/must-gather-856k2" May 26 10:52:08.073601 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:08.073581 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz66r\" (UniqueName: \"kubernetes.io/projected/df6128e0-c511-4f00-8802-6a2e3797bf3a-kube-api-access-pz66r\") pod \"must-gather-856k2\" (UID: \"df6128e0-c511-4f00-8802-6a2e3797bf3a\") " pod="openshift-must-gather-7hzkl/must-gather-856k2" May 26 10:52:08.234607 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:08.234500 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hzkl/must-gather-856k2" May 26 10:52:08.359670 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:08.358536 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hzkl/must-gather-856k2"] May 26 10:52:08.362417 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:08.362372 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:52:08.493730 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:08.493648 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hzkl/must-gather-856k2" event={"ID":"df6128e0-c511-4f00-8802-6a2e3797bf3a","Type":"ContainerStarted","Data":"4074831e3321c44fea040022e869dc11e714a9d0560dc1e703ee8903fe3c900c"} May 26 10:52:09.501211 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:09.500270 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hzkl/must-gather-856k2" event={"ID":"df6128e0-c511-4f00-8802-6a2e3797bf3a","Type":"ContainerStarted","Data":"e8b809a51d2906703624f83245de404d4dd7d54f7c2eea3eab7cae36b613efbe"} May 26 10:52:09.501211 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:09.500317 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hzkl/must-gather-856k2" event={"ID":"df6128e0-c511-4f00-8802-6a2e3797bf3a","Type":"ContainerStarted","Data":"b5945543d0d370c4d31039e07021917f7bcb297dcfdd952e3802445c68a5e149"} May 26 10:52:09.517270 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:09.517215 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7hzkl/must-gather-856k2" podStartSLOduration=1.731723299 podStartE2EDuration="2.51719885s" podCreationTimestamp="2026-05-26 10:52:07 +0000 UTC" firstStartedPulling="2026-05-26 10:52:08.362593191 +0000 UTC m=+2518.155021185" lastFinishedPulling="2026-05-26 10:52:09.148068744 +0000 UTC m=+2518.940496736" observedRunningTime="2026-05-26 10:52:09.515886555 +0000 UTC m=+2519.308314567" watchObservedRunningTime="2026-05-26 10:52:09.51719885 +0000 UTC m=+2519.309626845" May 26 10:52:10.726550 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:10.726493 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t6kkd_0a3d5778-8c69-4b79-a97e-eb71b818caf2/global-pull-secret-syncer/0.log" May 26 10:52:10.847215 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:10.847168 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w62wm_971ff43f-544e-45eb-90d6-63bc0d27c329/konnectivity-agent/0.log" May 26 10:52:10.932876 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:10.932840 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-163.ec2.internal_108cb111ebc940df8584a4b6713a6b98/haproxy/0.log" May 26 10:52:15.245362 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:15.244960 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57b6d85ff7-dxg8f_2999dd93-c85b-419c-8d20-27d0d602ec8d/authorino/0.log" May 26 10:52:15.471153 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:15.471124 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-4v28s_d7f14af8-1c33-4655-9187-af77bdc1df19/limitador/0.log" May 26 10:52:15.567395 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:15.567308 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-m2tlj_f3bda622-f973-48fb-ac76-459bee98a2d2/manager/0.log" May 26 10:52:17.270271 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.270220 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-nwc4w_7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1/kube-state-metrics/0.log" May 26 10:52:17.288072 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.288047 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-nwc4w_7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1/kube-rbac-proxy-main/0.log" May 26 10:52:17.312950 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.312374 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-nwc4w_7dcb9bf8-2b07-4ade-ab8a-5ab89b68eab1/kube-rbac-proxy-self/0.log" May 26 10:52:17.345028 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.344979 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b6cbcc989-9zmz7_f408e994-de5c-4d74-a12d-e73ce413f95f/metrics-server/0.log" May 26 10:52:17.372660 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.372630 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-4m9cl_fa4f6692-d0c8-4b78-ac99-9f2c1e69702a/monitoring-plugin/0.log" May 26 10:52:17.404949 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.404920 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hx5jn_8c12b49b-b0ac-4bcf-9fea-cd284a484830/node-exporter/0.log" May 26 10:52:17.430209 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.430180 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hx5jn_8c12b49b-b0ac-4bcf-9fea-cd284a484830/kube-rbac-proxy/0.log" May 26 10:52:17.455050 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.455018 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hx5jn_8c12b49b-b0ac-4bcf-9fea-cd284a484830/init-textfile/0.log" May 26 10:52:17.757867 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.757834 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_99d93955-41c0-487d-ab49-556e77e52f09/prometheus/0.log" May 26 10:52:17.787159 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.787102 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_99d93955-41c0-487d-ab49-556e77e52f09/config-reloader/0.log" May 26 10:52:17.810061 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.810034 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_99d93955-41c0-487d-ab49-556e77e52f09/thanos-sidecar/0.log" May 26 10:52:17.841374 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.841346 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_99d93955-41c0-487d-ab49-556e77e52f09/kube-rbac-proxy-web/0.log" May 26 10:52:17.864433 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.864404 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_99d93955-41c0-487d-ab49-556e77e52f09/kube-rbac-proxy/0.log" May 26 10:52:17.886645 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.886616 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_99d93955-41c0-487d-ab49-556e77e52f09/kube-rbac-proxy-thanos/0.log" May 26 10:52:17.908472 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.908446 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_99d93955-41c0-487d-ab49-556e77e52f09/init-config-reloader/0.log" May 26 10:52:17.937830 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.937804 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-xmf4q_774adb71-53fd-4f5f-8279-c1c4d0ee8cd5/prometheus-operator/0.log" May 26 10:52:17.956715 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:17.956689 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-xmf4q_774adb71-53fd-4f5f-8279-c1c4d0ee8cd5/kube-rbac-proxy/0.log" May 26 10:52:19.527339 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.527296 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c"] May 26 10:52:19.534210 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.534183 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.539642 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.539614 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c"] May 26 10:52:19.564567 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.564539 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-proc\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.564711 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.564597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-podres\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.564711 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.564644 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqh79\" (UniqueName: \"kubernetes.io/projected/15e83424-2698-4f36-93dd-8442826cd04f-kube-api-access-lqh79\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.564795 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.564709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-lib-modules\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.564795 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.564778 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-sys\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.665922 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.665892 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-lib-modules\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.666083 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.665935 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-sys\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.666083 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.665964 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-proc\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.666083 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.665987 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-podres\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.666083 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.666015 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqh79\" (UniqueName: \"kubernetes.io/projected/15e83424-2698-4f36-93dd-8442826cd04f-kube-api-access-lqh79\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.666262 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.666080 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-proc\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.666262 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.666097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-sys\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.666262 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.666080 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-lib-modules\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.666262 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.666147 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15e83424-2698-4f36-93dd-8442826cd04f-podres\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.674918 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.674883 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqh79\" (UniqueName: \"kubernetes.io/projected/15e83424-2698-4f36-93dd-8442826cd04f-kube-api-access-lqh79\") pod \"perf-node-gather-daemonset-6kq6c\" (UID: \"15e83424-2698-4f36-93dd-8442826cd04f\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:19.851720 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:19.851638 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:20.013587 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:20.013558 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c"] May 26 10:52:20.016374 ip-10-0-139-163 kubenswrapper[2557]: W0526 10:52:20.016327 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15e83424_2698_4f36_93dd_8442826cd04f.slice/crio-1d2b18e9509a22032477d7d1891a1d89c256d10caf272c6f8b094959735a18dc WatchSource:0}: Error finding container 1d2b18e9509a22032477d7d1891a1d89c256d10caf272c6f8b094959735a18dc: Status 404 returned error can't find the container with id 1d2b18e9509a22032477d7d1891a1d89c256d10caf272c6f8b094959735a18dc May 26 10:52:20.555246 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:20.555154 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" event={"ID":"15e83424-2698-4f36-93dd-8442826cd04f","Type":"ContainerStarted","Data":"97f7eeb31788b54933d51ef080e63baa9820afc7c71591bff554d604ddbe1504"} May 26 10:52:20.555246 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:20.555199 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" event={"ID":"15e83424-2698-4f36-93dd-8442826cd04f","Type":"ContainerStarted","Data":"1d2b18e9509a22032477d7d1891a1d89c256d10caf272c6f8b094959735a18dc"} May 26 10:52:20.555807 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:20.555284 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:20.571907 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:20.571862 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" podStartSLOduration=1.571845108 podStartE2EDuration="1.571845108s" podCreationTimestamp="2026-05-26 10:52:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:52:20.570233892 +0000 UTC m=+2530.362661927" watchObservedRunningTime="2026-05-26 10:52:20.571845108 +0000 UTC m=+2530.364273122" May 26 10:52:21.674690 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:21.674659 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mp8fz_46451e3e-b7ae-4254-8244-989b34d47910/dns/0.log" May 26 10:52:21.695363 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:21.695334 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mp8fz_46451e3e-b7ae-4254-8244-989b34d47910/kube-rbac-proxy/0.log" May 26 10:52:21.766468 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:21.766436 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x9rzz_94e8656c-2263-4c65-9a3b-bd7bb835aefc/dns-node-resolver/0.log" May 26 10:52:22.259033 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:22.259005 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-786bz_57adbec3-592d-4976-adfb-2fee89eee87f/node-ca/0.log" May 26 10:52:23.350690 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:23.350661 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-546bd7d749-glwtk_2c66c751-71d4-4a76-bd1b-3e1684680171/kube-auth-proxy/0.log" May 26 10:52:24.060586 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:24.060552 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mz82c_d9180998-ae3a-41d2-9c8b-a46fa4de2a3e/serve-healthcheck-canary/0.log" May 26 10:52:24.736794 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:24.736765 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpqlv_0c0038da-6753-430f-9467-084fa830c07d/kube-rbac-proxy/0.log" May 26 10:52:24.758272 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:24.758242 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpqlv_0c0038da-6753-430f-9467-084fa830c07d/exporter/0.log" May 26 10:52:24.780988 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:24.780963 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpqlv_0c0038da-6753-430f-9467-084fa830c07d/extractor/0.log" May 26 10:52:26.568406 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:26.568382 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-6kq6c" May 26 10:52:26.728528 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:26.728482 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663190-n445r_315b08cb-2a73-4d0a-a87c-75aec483564c/cleanup/0.log" May 26 10:52:26.752386 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:26.752361 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663205-fh74p_314fc60d-7081-4d43-92fb-c1d9863a3e81/cleanup/0.log" May 26 10:52:26.924131 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:26.924101 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c66b4d846-8rr6c_eaf1f784-0b96-40b1-8ede-a78d3618431b/manager/0.log" May 26 10:52:28.241536 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:28.241483 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-546dd56b4d-m8q5h_ad6c66b2-e383-4b7b-ab75-dc8dabe7851f/manager/0.log" May 26 10:52:34.213256 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.213219 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-27ld5_a82f439a-58a5-48db-856f-8150133b761c/kube-multus/0.log" May 26 10:52:34.238917 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.238894 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4j8bf_12df8fdf-4e67-454b-9504-8037dd08195c/kube-multus-additional-cni-plugins/0.log" May 26 10:52:34.264191 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.264166 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4j8bf_12df8fdf-4e67-454b-9504-8037dd08195c/egress-router-binary-copy/0.log" May 26 10:52:34.286992 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.286970 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4j8bf_12df8fdf-4e67-454b-9504-8037dd08195c/cni-plugins/0.log" May 26 10:52:34.308674 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.308650 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4j8bf_12df8fdf-4e67-454b-9504-8037dd08195c/bond-cni-plugin/0.log" May 26 10:52:34.331125 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.331103 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4j8bf_12df8fdf-4e67-454b-9504-8037dd08195c/routeoverride-cni/0.log" May 26 10:52:34.352550 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.352529 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4j8bf_12df8fdf-4e67-454b-9504-8037dd08195c/whereabouts-cni-bincopy/0.log" May 26 10:52:34.375996 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.375976 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4j8bf_12df8fdf-4e67-454b-9504-8037dd08195c/whereabouts-cni/0.log" May 26 10:52:34.819492 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.819441 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6dwkx_c7f27adb-4e8c-4841-9ac8-6ece585e515b/network-metrics-daemon/0.log" May 26 10:52:34.840658 ip-10-0-139-163 kubenswrapper[2557]: I0526 10:52:34.840608 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6dwkx_c7f27adb-4e8c-4841-9ac8-6ece585e515b/kube-rbac-proxy/0.log"