Sep 09 23:09:26.560593 ip-10-0-137-106 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:09:26.929550 ip-10-0-137-106 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:09:26.929550 ip-10-0-137-106 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:09:26.929550 ip-10-0-137-106 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:09:26.929550 ip-10-0-137-106 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:09:26.929550 ip-10-0-137-106 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:09:26.931293 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.931216 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:09:26.934888 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934874 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:09:26.934888 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934888 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934891 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934894 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934897 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934901 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934904 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934907 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934910 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934913 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934916 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934919 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934927 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934929 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934932 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934935 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934937 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934940 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934943 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934945 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934948 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:09:26.934953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934950 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934953 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934955 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934959 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934961 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934964 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934967 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934969 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934972 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934974 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934977 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934979 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934984 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934988 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934992 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934995 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.934998 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935001 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935003 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:09:26.935487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935006 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935008 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935011 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935013 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935016 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935018 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935021 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935023 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935027 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935029 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935031 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935034 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935036 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935039 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935041 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935045 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935048 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935051 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935054 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935056 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935059 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:09:26.935959 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935062 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935064 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935068 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935070 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935073 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935075 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935078 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935080 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935084 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935087 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935089 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935092 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935095 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935097 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935099 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935102 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935104 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935107 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935109 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935113 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:09:26.936487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935117 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935120 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935122 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935125 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935128 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935130 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935133 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935136 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935139 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935141 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935144 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935146 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935149 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935151 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935154 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935157 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935159 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935162 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935824 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:09:26.936975 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935830 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935833 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935836 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935839 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935842 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935845 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935847 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935850 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935853 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935855 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935858 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935861 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935864 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935866 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935869 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935871 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935874 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935876 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935880 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935883 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:09:26.937450 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935885 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935888 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935891 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935893 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935896 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935898 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935901 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935903 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935905 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935908 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935910 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935915 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935919 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935922 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935924 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935927 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935930 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935932 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935935 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:09:26.938077 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935937 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935940 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935943 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935945 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935948 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935950 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935953 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935955 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935958 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935961 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935963 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935967 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935970 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935972 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935975 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935977 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935980 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935982 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935985 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935987 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:09:26.938585 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935989 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935992 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935994 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.935997 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936000 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936005 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936008 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936010 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936013 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936015 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936018 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936021 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936023 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936026 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936028 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936032 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936034 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936036 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936039 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:09:26.939094 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936041 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936044 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936046 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936049 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936052 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936054 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936057 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936059 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936064 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936067 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936070 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936073 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936076 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936079 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936082 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936084 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936087 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936090 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936092 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936094 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:09:26.939593 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936484 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936489 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936493 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936496 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936500 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936503 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936506 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936509 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936512 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936515 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936517 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936520 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936523 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936525 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936528 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936530 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936533 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936536 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936538 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936541 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:09:26.940097 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936544 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936547 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936550 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936553 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936556 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936558 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936561 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936563 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936566 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936568 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936571 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936573 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936576 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936578 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936582 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936585 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936588 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936591 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936594 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:09:26.940614 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936596 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936599 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936602 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936604 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936607 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936609 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936612 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936614 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936617 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936619 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936621 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936624 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936626 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936629 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936631 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936634 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936636 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936638 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936641 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936643 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:09:26.941089 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936646 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936648 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936650 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936653 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936655 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936658 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936660 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936662 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936665 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936667 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936670 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936674 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936677 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936680 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936684 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936686 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936689 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936692 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936694 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:09:26.941588 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936697 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936700 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936702 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936705 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936707 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936710 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936713 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936715 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936717 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936720 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936722 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936725 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936727 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936730 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936732 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936735 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936737 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936741 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936744 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:09:26.942053 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936748 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.936751 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936815 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936844 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936850 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936854 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936860 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936863 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936869 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936873 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936876 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936879 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936882 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936886 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936889 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936892 2581 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936895 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936898 2581 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936900 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936903 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936908 2581 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936911 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936914 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936917 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:09:26.942536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936920 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936924 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936927 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936930 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936933 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936936 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936939 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936942 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936945 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936948 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936952 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936957 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936960 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936962 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936965 2581 flags.go:64] FLAG: --enable-server="true" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936969 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936974 2581 flags.go:64] FLAG: --event-burst="100" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936977 2581 flags.go:64] FLAG: --event-qps="50" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936980 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936983 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936986 2581 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936990 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936993 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936996 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.936998 2581 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:09:26.943160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937001 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937004 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937007 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937010 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937013 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937016 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937019 2581 flags.go:64] FLAG: --feature-gates="" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937023 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937026 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937029 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937032 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937035 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937038 2581 flags.go:64] FLAG: --help="false" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937041 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-137-106.ec2.internal" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937044 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937047 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937050 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937053 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937058 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937061 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937064 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937067 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937070 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:09:26.943852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937075 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937078 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937081 2581 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937084 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937087 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937090 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937092 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937095 2581 flags.go:64] FLAG: --lock-file="" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937098 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937101 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937104 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937109 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937112 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937114 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937117 2581 flags.go:64] FLAG: --logging-format="text" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937120 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937123 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937126 2581 flags.go:64] FLAG: --manifest-url="" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937129 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937133 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937136 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937140 2581 flags.go:64] FLAG: --max-pods="110" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937143 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937145 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937148 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:09:26.944452 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937151 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937154 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937159 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937162 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937168 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937171 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937174 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937178 2581 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937182 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937187 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937189 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937193 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937196 2581 flags.go:64] FLAG: --port="10250" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937198 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937201 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01f43dc8c34246636" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937204 2581 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937207 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937210 2581 flags.go:64] FLAG: --register-node="true" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937213 2581 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937216 2581 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937219 2581 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937222 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937225 2581 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937229 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937232 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:09:26.945067 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937235 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937237 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937240 2581 flags.go:64] FLAG: --runonce="false" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937243 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937246 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937249 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937252 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937255 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937257 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937260 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937265 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937268 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937270 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937273 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937277 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937280 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937283 2581 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937286 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937291 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937294 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937297 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937301 2581 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937304 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937318 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937322 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:09:26.945709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937325 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937328 2581 flags.go:64] FLAG: --v="2" Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937331 2581 flags.go:64] FLAG: --version="false" Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937335 2581 flags.go:64] FLAG: --vmodule="" Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937338 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937342 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937461 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937465 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937468 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937471 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937473 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937476 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937479 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937482 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937486 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937489 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937493 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937498 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937501 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937504 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937507 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:09:26.946335 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937510 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937513 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937516 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937519 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937522 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937524 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937527 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937530 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937532 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937535 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937537 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937540 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937542 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937545 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937547 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937550 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937552 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937555 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937557 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937559 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:09:26.946895 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937562 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937565 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937568 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937570 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937573 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937575 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937578 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937580 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937584 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937587 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937590 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937592 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937596 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937599 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937601 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937604 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937608 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937611 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937613 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:09:26.947400 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937616 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937618 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937621 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937624 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937626 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937629 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937631 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937634 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937636 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937639 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937641 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937644 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937646 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937649 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937651 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937654 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937657 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937659 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937662 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937664 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:09:26.947859 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937667 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937670 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937673 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937676 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937678 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937683 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937687 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937689 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937692 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937694 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937697 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937700 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937702 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937705 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937709 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937713 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937716 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937719 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937722 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:09:26.948590 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937725 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937727 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937730 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937733 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937736 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.937738 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.937743 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.944842 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.944856 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.945618 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.945626 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945687 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945693 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945696 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945699 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:09:26.949236 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945702 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945705 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945707 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945710 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945712 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945715 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945718 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945720 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945723 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945726 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945730 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945734 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945737 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945740 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945743 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945746 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945749 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945752 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945754 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:09:26.949712 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945757 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945759 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945762 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945764 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945767 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945770 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945781 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945785 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945788 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945790 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945793 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945797 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945800 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945804 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945806 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945809 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945812 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945814 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945817 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:09:26.950212 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945819 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945822 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945824 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945827 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945830 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945832 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945834 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945837 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945840 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945842 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945845 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945848 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945851 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945853 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945856 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945858 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945861 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945863 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945866 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945869 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:09:26.950740 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945877 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945880 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945882 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945885 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945887 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945890 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945892 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945895 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945897 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945900 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945902 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945905 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945907 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945910 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945912 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945915 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945917 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945920 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945922 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945925 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:09:26.951290 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945927 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945930 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945932 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945935 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945938 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945940 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945943 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945945 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945947 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945950 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945952 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945955 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945958 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945967 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945970 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945972 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:09:26.951814 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.945975 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.945980 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946126 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946131 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946134 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946136 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946139 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946142 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946144 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946147 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946149 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946152 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946154 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946157 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946159 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:09:26.952211 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946162 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946164 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946167 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946169 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946173 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946175 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946177 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946180 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946184 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946188 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946190 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946193 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946196 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946199 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946202 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946210 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946213 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946216 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946218 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:09:26.952596 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946221 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946223 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946226 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946228 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946231 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946233 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946236 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946238 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946241 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946243 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946245 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946248 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946250 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946253 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946255 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946258 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946260 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946263 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946267 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946269 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:09:26.953060 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946272 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946274 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946277 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946279 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946282 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946284 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946286 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946289 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946292 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946300 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946303 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946306 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946320 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946323 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946326 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946328 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946330 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946333 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946337 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:09:26.953652 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946341 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946344 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946347 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946350 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946353 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946356 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946358 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946361 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946363 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946366 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946369 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946371 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946374 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946376 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946379 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946382 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946384 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946387 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946389 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946392 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:09:26.954119 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946395 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946397 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946400 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946408 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946411 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946413 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946416 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:26.946418 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.946423 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.946550 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.950080 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.951021 2581 server.go:1019] "Starting client certificate rotation" Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.951116 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.951145 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:09:26.954626 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.953244 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:09:26.954968 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.954328 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:09:26.965546 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.965528 2581 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:09:26.968145 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.968132 2581 log.go:25] "Validated CRI v1 image API" Sep 09 23:09:26.971858 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.971843 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:09:26.974500 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.974484 2581 fs.go:135] Filesystem UUIDs: map[175c4116-32f1-40a1-b140-55a9aca8a43d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c20ca420-5838-4bb1-a264-63474d72ddcf:/dev/nvme0n1p3] Sep 09 23:09:26.974568 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.974500 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:09:26.980212 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.980108 2581 manager.go:216] Machine: {Timestamp:2026-09-09 23:09:26.979657839 +0000 UTC m=+0.311733141 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097820 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2974e101356a7aca5f122959521e65 SystemUUID:ec2974e1-0135-6a7a-ca5f-122959521e65 BootID:643f15a4-f26c-4111-9331-17bb6b0cc7bb Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:25:f1:9f:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:25:f1:9f:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:c3:45:0b:1a:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:09:26.980212 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.980210 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:09:26.980332 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.980274 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:09:26.982917 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.982888 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:09:26.983035 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.982918 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-106.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:09:26.983655 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.983644 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:09:26.983687 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.983658 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:09:26.983687 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.983666 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:09:26.984317 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.984296 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:09:26.985100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.985091 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:09:26.985201 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.985182 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:09:26.989047 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989036 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:09:26.989147 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989138 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:09:26.989180 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989165 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:09:26.989180 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989174 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:09:26.989234 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989184 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:09:26.989234 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989194 2581 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:09:26.989234 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989202 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:09:26.989533 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989522 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:09:26.989574 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.989541 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:09:26.992351 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.992325 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:09:26.994692 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.994674 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:09:26.994762 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.994706 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:09:26.995868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995857 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:09:26.995923 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995873 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:09:26.995923 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995880 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:09:26.995923 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995886 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:09:26.995923 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995896 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:09:26.995923 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995901 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:09:26.995923 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995915 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:09:26.995923 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995920 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:09:26.995923 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995927 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:09:26.996233 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995932 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:09:26.996233 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995940 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:09:26.996233 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995945 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:09:26.996233 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995967 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:09:26.996233 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.995973 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:09:26.999677 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.999663 2581 server.go:1268] "Started kubelet" Sep 09 23:09:26.999827 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.999733 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:09:26.999928 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.999771 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:09:26.999928 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:26.999915 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:09:27.000409 ip-10-0-137-106 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:09:27.001106 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.001080 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:09:27.004588 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.004563 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:09:27.004715 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.004670 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:09:27.006355 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.006338 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:09:27.007916 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.007900 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:09:27.008050 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.008015 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.008642 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.008627 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:09:27.008642 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.008626 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:09:27.008782 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.008654 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:09:27.008782 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.008740 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:09:27.008782 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.008749 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:09:27.008925 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.008906 2581 factory.go:55] Registering systemd factory Sep 09 23:09:27.008925 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.008919 2581 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:09:27.009124 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.009110 2581 factory.go:153] Registering CRI-O factory Sep 09 23:09:27.009183 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.009127 2581 factory.go:223] Registration of the crio container factory successfully Sep 09 23:09:27.009231 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.009185 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:09:27.009231 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.009204 2581 factory.go:103] Registering Raw factory Sep 09 23:09:27.009231 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.009224 2581 manager.go:1196] Started watching for new ooms in manager Sep 09 23:09:27.009611 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.009597 2581 manager.go:349] Starting recovery of all containers Sep 09 23:09:27.012165 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.012140 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:09:27.012648 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.012625 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 23:09:27.012901 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.012851 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:09:27.012999 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.012851 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:09:27.012999 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.012853 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 23:09:27.015503 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.012942 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-106.ec2.internal.18d3c9cecad5304d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-106.ec2.internal,UID:ip-10-0-137-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-106.ec2.internal,},FirstTimestamp:2026-09-09 23:09:26.999633997 +0000 UTC m=+0.331709279,LastTimestamp:2026-09-09 23:09:26.999633997 +0000 UTC m=+0.331709279,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-106.ec2.internal,}" Sep 09 23:09:27.020343 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.020188 2581 manager.go:354] Recovery completed Sep 09 23:09:27.026622 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.026609 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:09:27.028458 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.028427 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:09:27.028529 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.028470 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:09:27.028529 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.028484 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:09:27.029006 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.028994 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:09:27.029006 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.029004 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:09:27.029113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.029018 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:09:27.029113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.029014 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:09:27.029837 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.029818 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:09:27.029898 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.029853 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:09:27.029898 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.029868 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:09:27.032561 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.032505 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-106.ec2.internal.18d3c9cecc8cfa4a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-106.ec2.internal,UID:ip-10-0-137-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-106.ec2.internal,},FirstTimestamp:2026-09-09 23:09:27.02845601 +0000 UTC m=+0.360531292,LastTimestamp:2026-09-09 23:09:27.02845601 +0000 UTC m=+0.360531292,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-106.ec2.internal,}" Sep 09 23:09:27.039983 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.039965 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zbqrb" Sep 09 23:09:27.043830 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.043761 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-106.ec2.internal.18d3c9cecc8d519b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-106.ec2.internal,UID:ip-10-0-137-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-106.ec2.internal,},FirstTimestamp:2026-09-09 23:09:27.028478363 +0000 UTC m=+0.360553645,LastTimestamp:2026-09-09 23:09:27.028478363 +0000 UTC m=+0.360553645,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-106.ec2.internal,}" Sep 09 23:09:27.057056 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.057039 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zbqrb" Sep 09 23:09:27.058084 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.058026 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-106.ec2.internal.18d3c9cecc8d7cc7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-106.ec2.internal,UID:ip-10-0-137-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-106.ec2.internal,},FirstTimestamp:2026-09-09 23:09:27.028489415 +0000 UTC m=+0.360564697,LastTimestamp:2026-09-09 23:09:27.028489415 +0000 UTC m=+0.360564697,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-106.ec2.internal,}" Sep 09 23:09:27.072396 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.072326 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-106.ec2.internal.18d3c9cecc8cfa4a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-106.ec2.internal.18d3c9cecc8cfa4a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-106.ec2.internal,UID:ip-10-0-137-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-106.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-106.ec2.internal,},FirstTimestamp:2026-09-09 23:09:27.02845601 +0000 UTC m=+0.360531292,LastTimestamp:2026-09-09 23:09:27.029839 +0000 UTC m=+0.361914284,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-106.ec2.internal,}" Sep 09 23:09:27.181726 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.081801 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-106.ec2.internal.18d3c9cecc8d519b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-106.ec2.internal.18d3c9cecc8d519b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-106.ec2.internal,UID:ip-10-0-137-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-106.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-106.ec2.internal,},FirstTimestamp:2026-09-09 23:09:27.028478363 +0000 UTC m=+0.360553645,LastTimestamp:2026-09-09 23:09:27.029860556 +0000 UTC m=+0.361935839,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-106.ec2.internal,}" Sep 09 23:09:27.181726 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.098015 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-106.ec2.internal.18d3c9cecc8d7cc7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-106.ec2.internal.18d3c9cecc8d7cc7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-106.ec2.internal,UID:ip-10-0-137-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-106.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-106.ec2.internal,},FirstTimestamp:2026-09-09 23:09:27.028489415 +0000 UTC m=+0.360564697,LastTimestamp:2026-09-09 23:09:27.029872935 +0000 UTC m=+0.361948218,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-106.ec2.internal,}" Sep 09 23:09:27.181726 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.109135 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.181726 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.181294 2581 policy_none.go:49] "None policy: Start" Sep 09 23:09:27.181726 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.181324 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:09:27.181726 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.181337 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:09:27.183449 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.183434 2581 policy_none.go:47] "Start" Sep 09 23:09:27.183635 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.183617 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:09:27.184894 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.184874 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:09:27.184974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.184927 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:09:27.184974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.184947 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:09:27.185083 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.184991 2581 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 09 23:09:27.195427 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.195406 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:09:27.209940 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.209922 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.210824 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.210808 2581 manager.go:337] "Starting Device Plugin manager" Sep 09 23:09:27.210887 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.210860 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:09:27.210887 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.210873 2581 server.go:87] "Starting device plugin registration server" Sep 09 23:09:27.211082 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.211071 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:09:27.211124 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.211097 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:09:27.211202 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.211188 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:09:27.211276 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.211261 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:09:27.211276 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.211273 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:09:27.211802 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.211784 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:09:27.211872 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.211836 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.219429 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.219408 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-106.ec2.internal\" not found" node="ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.285534 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.285512 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal"] Sep 09 23:09:27.285580 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.285572 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:09:27.286931 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.286917 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:09:27.287005 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.286943 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:09:27.287005 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.286958 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:09:27.289172 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289159 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:09:27.289321 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289298 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.289421 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289344 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:09:27.289886 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289867 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:09:27.289961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289893 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:09:27.289961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289907 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:09:27.289961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289920 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:09:27.289961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289939 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:09:27.289961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.289952 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:09:27.292065 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.292050 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.292135 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.292075 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:09:27.292746 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.292726 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:09:27.292834 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.292754 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:09:27.292834 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.292763 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:09:27.305890 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.305869 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-106.ec2.internal\" not found" node="ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.309649 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.309633 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-106.ec2.internal\" not found" node="ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.310661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.310646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6000383f8fe5b41a9f74a13d8872f717-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal\" (UID: \"6000383f8fe5b41a9f74a13d8872f717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.310729 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.310674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6000383f8fe5b41a9f74a13d8872f717-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal\" (UID: \"6000383f8fe5b41a9f74a13d8872f717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.310729 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.310698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e14240b2136a476f867f93a084571a5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-106.ec2.internal\" (UID: \"9e14240b2136a476f867f93a084571a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.311671 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.311657 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:09:27.312379 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.312365 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:09:27.312443 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.312392 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:09:27.312443 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.312406 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:09:27.312443 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.312435 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.319345 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.319331 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.319418 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.319351 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-106.ec2.internal\": node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.334142 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.334120 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.411514 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.411494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6000383f8fe5b41a9f74a13d8872f717-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal\" (UID: \"6000383f8fe5b41a9f74a13d8872f717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.411572 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.411520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6000383f8fe5b41a9f74a13d8872f717-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal\" (UID: \"6000383f8fe5b41a9f74a13d8872f717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.411572 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.411535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e14240b2136a476f867f93a084571a5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-106.ec2.internal\" (UID: \"9e14240b2136a476f867f93a084571a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.411572 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.411558 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e14240b2136a476f867f93a084571a5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-106.ec2.internal\" (UID: \"9e14240b2136a476f867f93a084571a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.411672 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.411586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6000383f8fe5b41a9f74a13d8872f717-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal\" (UID: \"6000383f8fe5b41a9f74a13d8872f717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.411672 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.411598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6000383f8fe5b41a9f74a13d8872f717-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal\" (UID: \"6000383f8fe5b41a9f74a13d8872f717\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.435226 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.435174 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.536141 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.536117 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.608574 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.608553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.613281 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.613266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" Sep 09 23:09:27.636831 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.636812 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.736952 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.736891 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.837368 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.837337 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.876956 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.876934 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:09:27.938158 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:27.938122 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:27.950526 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.950502 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:09:27.950643 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.950626 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:09:27.950704 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:27.950671 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:09:28.035644 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.035584 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:09:28.036804 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.036785 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:09:28.036907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.036825 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:09:28.036907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.036844 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:09:28.038420 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:28.038402 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:28.138950 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:28.138915 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:28.182937 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.182893 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:04:27 +0000 UTC" deadline="2028-06-22 00:14:39.39935914 +0000 UTC" Sep 09 23:09:28.182937 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.182935 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15625h5m11.216428981s" Sep 09 23:09:28.199355 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:28.199298 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6000383f8fe5b41a9f74a13d8872f717.slice/crio-b728dc552343f40c0995a772f225bc539e49b90e2db0e7d1caa753ca7d9ac4b4 WatchSource:0}: Error finding container b728dc552343f40c0995a772f225bc539e49b90e2db0e7d1caa753ca7d9ac4b4: Status 404 returned error can't find the container with id b728dc552343f40c0995a772f225bc539e49b90e2db0e7d1caa753ca7d9ac4b4 Sep 09 23:09:28.199659 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:28.199634 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e14240b2136a476f867f93a084571a5.slice/crio-a7c1f04b79aa3dd1289bb0cee64db63616ab8bd2bcd778e08bb1203b0feb4bfd WatchSource:0}: Error finding container a7c1f04b79aa3dd1289bb0cee64db63616ab8bd2bcd778e08bb1203b0feb4bfd: Status 404 returned error can't find the container with id a7c1f04b79aa3dd1289bb0cee64db63616ab8bd2bcd778e08bb1203b0feb4bfd Sep 09 23:09:28.205997 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.205980 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:09:28.239650 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:28.239613 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:28.264937 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.264923 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:09:28.340434 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:28.340383 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:28.441475 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:28.441451 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-106.ec2.internal\" not found" Sep 09 23:09:28.505116 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.505096 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:09:28.508801 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.508785 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" Sep 09 23:09:28.527029 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.527012 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:09:28.528187 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.528174 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" Sep 09 23:09:28.548448 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.548424 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:09:28.992271 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.992243 2581 apiserver.go:52] "Watching apiserver" Sep 09 23:09:28.999462 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.999435 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:09:28.999915 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:28.999885 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-tbnwj","openshift-image-registry/node-ca-5sztf","openshift-ovn-kubernetes/ovnkube-node-k9lpg","kube-system/global-pull-secret-syncer-72rtw","kube-system/konnectivity-agent-vfzlw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal","openshift-multus/multus-additional-cni-plugins-bhzpt","openshift-multus/multus-bg4h8","openshift-multus/network-metrics-daemon-nb2kz","openshift-network-diagnostics/network-check-target-j6wvw","openshift-network-operator/iptables-alerter-btdqf","kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j","openshift-cluster-node-tuning-operator/tuned-6kttg"] Sep 09 23:09:29.002724 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.002697 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.005143 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.005119 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.005708 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.005680 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:09:29.007612 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.007593 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:09:29.008029 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.008007 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.008587 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.008562 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:09:29.008674 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.008570 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:09:29.009518 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.009497 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:09:29.009673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.009654 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:09:29.009854 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.009836 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2x7h\"" Sep 09 23:09:29.009922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.009885 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q26wd\"" Sep 09 23:09:29.010052 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.010034 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:09:29.010141 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.010125 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:09:29.010421 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.010406 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:09:29.010663 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.010645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:09:29.010875 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.010859 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:09:29.010940 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.010921 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:09:29.011243 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.011224 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.011314 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.011273 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:09:29.011502 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.011307 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:29.011502 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.011479 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dm66b\"" Sep 09 23:09:29.011590 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.011234 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:09:29.011666 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.011651 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:09:29.013718 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.012938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:29.016227 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.015090 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:09:29.016227 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.015199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xt8dw\"" Sep 09 23:09:29.016227 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.015482 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.016227 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.016011 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:09:29.017946 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.017825 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:09:29.018468 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.018152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:29.018468 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.018211 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:09:29.018468 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.018222 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:29.018468 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.018416 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j4smk\"" Sep 09 23:09:29.019972 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.019600 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:09:29.021524 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.021503 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.022862 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.022839 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.022961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.022909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-kubelet\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.022961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.022936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-systemd\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023071 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.022963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-842pj\" (UniqueName: \"kubernetes.io/projected/dea9777e-85c2-45d5-a758-8fe5e5b69901-kube-api-access-842pj\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.023071 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.022992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.023071 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-device-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.023071 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.023071 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-cni-bin\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-cni-netd\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-registration-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-systemd-units\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-slash\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-dbus\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.023362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-node-log\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-cnibin\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kxmv\" (UniqueName: \"kubernetes.io/projected/3ac59238-8719-48c3-b361-c29e700955f6-kube-api-access-2kxmv\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-etc-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-ovn\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-run-netns\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-var-lib-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-log-socket\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-ovnkube-config\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.023868 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-env-overrides\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.024426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.023709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/561207ac-633f-450e-8947-c300a6dc4233-ovn-node-metrics-cert\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.024426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-ovnkube-script-lib\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.024426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrf4t\" (UniqueName: \"kubernetes.io/projected/561207ac-633f-450e-8947-c300a6dc4233-kube-api-access-rrf4t\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.024426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024152 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-system-cni-dir\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.024426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-socket-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.024426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.024426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-kubelet-config\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.024658 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.024658 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-sys-fs\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.024987 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.024962 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gw6zs\"" Sep 09 23:09:29.026559 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.026537 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:09:29.027042 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.027023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.028725 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.028702 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:29.028873 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.028846 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:29.029485 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.029462 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5bjvq\"" Sep 09 23:09:29.029773 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.029755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:09:29.030109 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.030089 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:09:29.030809 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.030792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.032311 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.031900 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:09:29.032311 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.031951 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:09:29.032819 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.032800 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:09:29.033500 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.033447 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-56sjq\"" Sep 09 23:09:29.033703 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.033685 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:09:29.036196 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.035571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.036196 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.035755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:09:29.038399 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.037945 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:09:29.038399 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.038233 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-662pn\"" Sep 09 23:09:29.046771 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.046752 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pn7hp" Sep 09 23:09:29.055873 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.055854 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pn7hp" Sep 09 23:09:29.110702 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.110669 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:09:29.125371 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/887791de-ee8b-4a35-9682-2a2c112b28cd-host\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.125536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysctl-d\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.125536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71da0503-79c6-4565-a0ff-6c72c37611d3-tmp\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.125536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-node-log\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.125536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:29.125536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-netns\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.125536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-run-netns\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-var-lib-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c5c89a8-c85f-40ba-8165-b9b7e9cfea46-konnectivity-ca\") pod \"konnectivity-agent-vfzlw\" (UID: \"1c5c89a8-c85f-40ba-8165-b9b7e9cfea46\") " pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnsdh\" (UniqueName: \"kubernetes.io/projected/887791de-ee8b-4a35-9682-2a2c112b28cd-kube-api-access-cnsdh\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-ovnkube-script-lib\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrf4t\" (UniqueName: \"kubernetes.io/projected/561207ac-633f-450e-8947-c300a6dc4233-kube-api-access-rrf4t\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysctl-conf\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-conf-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-node-log\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-var-lib-kubelet\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.125849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-kubelet\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-hostroot\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-run\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.125974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-kubelet\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-systemd\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-tuned\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9sxr\" (UniqueName: \"kubernetes.io/projected/71da0503-79c6-4565-a0ff-6c72c37611d3-kube-api-access-g9sxr\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/887791de-ee8b-4a35-9682-2a2c112b28cd-serviceca\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-k8s-cni-cncf-io\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-842pj\" (UniqueName: \"kubernetes.io/projected/dea9777e-85c2-45d5-a758-8fe5e5b69901-kube-api-access-842pj\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.126250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-cni-bin\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-system-cni-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126349 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-var-lib-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-cnibin\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126367 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-ovnkube-script-lib\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-run-netns\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-etc-kubernetes\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126368 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-cni-bin\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-systemd-units\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126443 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-kubelet\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-slash\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126540 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-systemd-units\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126554 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126572 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-slash\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-kubernetes\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.126663 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-cnibin\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.126880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kxmv\" (UniqueName: \"kubernetes.io/projected/3ac59238-8719-48c3-b361-c29e700955f6-kube-api-access-2kxmv\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-etc-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.126851 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret podName:d4d06d57-79a6-4bb2-8d2f-250f618ebb80 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:29.626825348 +0000 UTC m=+2.958900632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret") pod "global-pull-secret-syncer-72rtw" (UID: "d4d06d57-79a6-4bb2-8d2f-250f618ebb80") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-etc-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-ovn\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126902 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126916 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-cnibin\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-ovn\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.126991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c819edf-3815-4d46-9355-84b4b578df22-host-slash\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6gwp\" (UniqueName: \"kubernetes.io/projected/3c819edf-3815-4d46-9355-84b4b578df22-kube-api-access-w6gwp\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysconfig\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-sys\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f20db8a4-fabf-4205-bdef-8436a727be22-hosts-file\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127192 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dea9777e-85c2-45d5-a758-8fe5e5b69901-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-cni-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.127791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-cni-multus\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-log-socket\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-ovnkube-config\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-log-socket\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-env-overrides\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/561207ac-633f-450e-8947-c300a6dc4233-ovn-node-metrics-cert\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-daemon-config\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-multus-certs\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-system-cni-dir\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-socket-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-kubelet-config\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfr74\" (UniqueName: \"kubernetes.io/projected/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-kube-api-access-tfr74\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4bb6\" (UniqueName: \"kubernetes.io/projected/f20db8a4-fabf-4205-bdef-8436a727be22-kube-api-access-h4bb6\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-cni-bin\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.128659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24rnp\" (UniqueName: \"kubernetes.io/projected/1b59474e-cb01-47ba-9694-b91ec28f3bda-kube-api-access-24rnp\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-env-overrides\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-sys-fs\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-host\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.127973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/561207ac-633f-450e-8947-c300a6dc4233-ovnkube-config\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-kubelet-config\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128132 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-sys-fs\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128194 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-system-cni-dir\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f20db8a4-fabf-4205-bdef-8436a727be22-tmp-dir\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c819edf-3815-4d46-9355-84b4b578df22-iptables-alerter-script\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-socket-dir-parent\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128315 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-socket-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-systemd\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128364 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b59474e-cb01-47ba-9694-b91ec28f3bda-cni-binary-copy\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.129540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-systemd\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-device-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-cni-netd\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-lib-modules\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-registration-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128767 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-device-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128806 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-host-cni-netd\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-dbus\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c5c89a8-c85f-40ba-8165-b9b7e9cfea46-agent-certs\") pod \"konnectivity-agent-vfzlw\" (UID: \"1c5c89a8-c85f-40ba-8165-b9b7e9cfea46\") " pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128893 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dea9777e-85c2-45d5-a758-8fe5e5b69901-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128906 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ac59238-8719-48c3-b361-c29e700955f6-registration-dir\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-dbus\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.130397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128957 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/561207ac-633f-450e-8947-c300a6dc4233-run-openvswitch\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.131232 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.128957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-modprobe-d\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.132798 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.132774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/561207ac-633f-450e-8947-c300a6dc4233-ovn-node-metrics-cert\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.133942 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.133917 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrf4t\" (UniqueName: \"kubernetes.io/projected/561207ac-633f-450e-8947-c300a6dc4233-kube-api-access-rrf4t\") pod \"ovnkube-node-k9lpg\" (UID: \"561207ac-633f-450e-8947-c300a6dc4233\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.138030 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.138012 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-842pj\" (UniqueName: \"kubernetes.io/projected/dea9777e-85c2-45d5-a758-8fe5e5b69901-kube-api-access-842pj\") pod \"multus-additional-cni-plugins-bhzpt\" (UID: \"dea9777e-85c2-45d5-a758-8fe5e5b69901\") " pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.138137 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.138034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kxmv\" (UniqueName: \"kubernetes.io/projected/3ac59238-8719-48c3-b361-c29e700955f6-kube-api-access-2kxmv\") pod \"aws-ebs-csi-driver-node-8gg9j\" (UID: \"3ac59238-8719-48c3-b361-c29e700955f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.191912 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.191866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" event={"ID":"9e14240b2136a476f867f93a084571a5","Type":"ContainerStarted","Data":"a7c1f04b79aa3dd1289bb0cee64db63616ab8bd2bcd778e08bb1203b0feb4bfd"} Sep 09 23:09:29.193456 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.193430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" event={"ID":"6000383f8fe5b41a9f74a13d8872f717","Type":"ContainerStarted","Data":"b728dc552343f40c0995a772f225bc539e49b90e2db0e7d1caa753ca7d9ac4b4"} Sep 09 23:09:29.230425 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9sxr\" (UniqueName: \"kubernetes.io/projected/71da0503-79c6-4565-a0ff-6c72c37611d3-kube-api-access-g9sxr\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.230518 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:29.230518 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/887791de-ee8b-4a35-9682-2a2c112b28cd-serviceca\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.230518 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-k8s-cni-cncf-io\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.230673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-system-cni-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.230673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-cnibin\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.230673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-etc-kubernetes\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.230673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-etc-kubernetes\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.230673 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.230636 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:29.230904 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.230700 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs podName:a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:29.730687074 +0000 UTC m=+3.062762348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs") pod "network-metrics-daemon-nb2kz" (UID: "a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:29.230904 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-system-cni-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.230904 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-k8s-cni-cncf-io\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.230904 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-kubernetes\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.230904 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-cnibin\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.230904 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c819edf-3815-4d46-9355-84b4b578df22-host-slash\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6gwp\" (UniqueName: \"kubernetes.io/projected/3c819edf-3815-4d46-9355-84b4b578df22-kube-api-access-w6gwp\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysconfig\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3c819edf-3815-4d46-9355-84b4b578df22-host-slash\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-sys\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f20db8a4-fabf-4205-bdef-8436a727be22-hosts-file\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.230999 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/887791de-ee8b-4a35-9682-2a2c112b28cd-serviceca\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-sys\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-cni-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-cni-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-cni-multus\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-kubernetes\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f20db8a4-fabf-4205-bdef-8436a727be22-hosts-file\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-daemon-config\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-multus-certs\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231098 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysconfig\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfr74\" (UniqueName: \"kubernetes.io/projected/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-kube-api-access-tfr74\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4bb6\" (UniqueName: \"kubernetes.io/projected/f20db8a4-fabf-4205-bdef-8436a727be22-kube-api-access-h4bb6\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.231192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-multus-certs\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-cni-bin\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24rnp\" (UniqueName: \"kubernetes.io/projected/1b59474e-cb01-47ba-9694-b91ec28f3bda-kube-api-access-24rnp\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-host\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-cni-bin\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f20db8a4-fabf-4205-bdef-8436a727be22-tmp-dir\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c819edf-3815-4d46-9355-84b4b578df22-iptables-alerter-script\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231318 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-host\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-socket-dir-parent\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b59474e-cb01-47ba-9694-b91ec28f3bda-cni-binary-copy\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-lib-modules\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c5c89a8-c85f-40ba-8165-b9b7e9cfea46-agent-certs\") pod \"konnectivity-agent-vfzlw\" (UID: \"1c5c89a8-c85f-40ba-8165-b9b7e9cfea46\") " pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-modprobe-d\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/887791de-ee8b-4a35-9682-2a2c112b28cd-host\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysctl-d\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71da0503-79c6-4565-a0ff-6c72c37611d3-tmp\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-netns\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f20db8a4-fabf-4205-bdef-8436a727be22-tmp-dir\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c5c89a8-c85f-40ba-8165-b9b7e9cfea46-konnectivity-ca\") pod \"konnectivity-agent-vfzlw\" (UID: \"1c5c89a8-c85f-40ba-8165-b9b7e9cfea46\") " pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231692 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-daemon-config\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsdh\" (UniqueName: \"kubernetes.io/projected/887791de-ee8b-4a35-9682-2a2c112b28cd-kube-api-access-cnsdh\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysctl-conf\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231753 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-socket-dir-parent\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231772 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-conf-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-var-lib-kubelet\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231802 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/887791de-ee8b-4a35-9682-2a2c112b28cd-host\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-kubelet\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-hostroot\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b59474e-cb01-47ba-9694-b91ec28f3bda-cni-binary-copy\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-run\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-lib-modules\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231417 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-cni-multus\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-systemd\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-run\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-tuned\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.232994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231946 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3c819edf-3815-4d46-9355-84b4b578df22-iptables-alerter-script\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231985 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-modprobe-d\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.231997 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-systemd\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.232022 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-var-lib-kubelet\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.232101 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysctl-d\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.232122 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-var-lib-kubelet\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.232141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-sysctl-conf\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.232145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-multus-conf-dir\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.232162 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-hostroot\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.232197 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c5c89a8-c85f-40ba-8165-b9b7e9cfea46-konnectivity-ca\") pod \"konnectivity-agent-vfzlw\" (UID: \"1c5c89a8-c85f-40ba-8165-b9b7e9cfea46\") " pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:29.233922 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.232200 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b59474e-cb01-47ba-9694-b91ec28f3bda-host-run-netns\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.234633 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.234611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/71da0503-79c6-4565-a0ff-6c72c37611d3-etc-tuned\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.234953 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.234935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c5c89a8-c85f-40ba-8165-b9b7e9cfea46-agent-certs\") pod \"konnectivity-agent-vfzlw\" (UID: \"1c5c89a8-c85f-40ba-8165-b9b7e9cfea46\") " pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:29.235110 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.235080 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71da0503-79c6-4565-a0ff-6c72c37611d3-tmp\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.259817 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.259764 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:09:29.259817 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.259789 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:09:29.259817 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.259803 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gww26 for pod openshift-network-diagnostics/network-check-target-j6wvw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:29.259984 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.259874 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26 podName:f49e289a-4fe4-4387-af22-9df77fba7748 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:29.759855782 +0000 UTC m=+3.091931054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gww26" (UniqueName: "kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26") pod "network-check-target-j6wvw" (UID: "f49e289a-4fe4-4387-af22-9df77fba7748") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:29.262670 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.262641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9sxr\" (UniqueName: \"kubernetes.io/projected/71da0503-79c6-4565-a0ff-6c72c37611d3-kube-api-access-g9sxr\") pod \"tuned-6kttg\" (UID: \"71da0503-79c6-4565-a0ff-6c72c37611d3\") " pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.262802 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.262781 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4bb6\" (UniqueName: \"kubernetes.io/projected/f20db8a4-fabf-4205-bdef-8436a727be22-kube-api-access-h4bb6\") pod \"node-resolver-tbnwj\" (UID: \"f20db8a4-fabf-4205-bdef-8436a727be22\") " pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.263310 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.262967 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfr74\" (UniqueName: \"kubernetes.io/projected/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-kube-api-access-tfr74\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:29.263510 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.263490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24rnp\" (UniqueName: \"kubernetes.io/projected/1b59474e-cb01-47ba-9694-b91ec28f3bda-kube-api-access-24rnp\") pod \"multus-bg4h8\" (UID: \"1b59474e-cb01-47ba-9694-b91ec28f3bda\") " pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.264989 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.264964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6gwp\" (UniqueName: \"kubernetes.io/projected/3c819edf-3815-4d46-9355-84b4b578df22-kube-api-access-w6gwp\") pod \"iptables-alerter-btdqf\" (UID: \"3c819edf-3815-4d46-9355-84b4b578df22\") " pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.266511 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.266423 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnsdh\" (UniqueName: \"kubernetes.io/projected/887791de-ee8b-4a35-9682-2a2c112b28cd-kube-api-access-cnsdh\") pod \"node-ca-5sztf\" (UID: \"887791de-ee8b-4a35-9682-2a2c112b28cd\") " pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.276603 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.276578 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:09:29.317640 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.317608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" Sep 09 23:09:29.326598 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.326572 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" Sep 09 23:09:29.340806 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.340778 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:29.348657 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.348633 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:29.358478 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.358457 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6kttg" Sep 09 23:09:29.366139 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.366113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tbnwj" Sep 09 23:09:29.373859 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.373842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5sztf" Sep 09 23:09:29.383687 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.383668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btdqf" Sep 09 23:09:29.390532 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.390516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bg4h8" Sep 09 23:09:29.635824 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.635748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:29.635973 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.635891 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:29.635973 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.635971 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret podName:d4d06d57-79a6-4bb2-8d2f-250f618ebb80 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:30.635948366 +0000 UTC m=+3.968023640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret") pod "global-pull-secret-syncer-72rtw" (UID: "d4d06d57-79a6-4bb2-8d2f-250f618ebb80") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:29.736401 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.736368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:29.736575 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.736497 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:29.736575 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.736563 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs podName:a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:30.736546597 +0000 UTC m=+4.068621867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs") pod "network-metrics-daemon-nb2kz" (UID: "a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:29.837506 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:29.837426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:29.837684 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.837624 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:09:29.837684 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.837653 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:09:29.837684 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.837667 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gww26 for pod openshift-network-diagnostics/network-check-target-j6wvw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:29.837817 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:29.837724 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26 podName:f49e289a-4fe4-4387-af22-9df77fba7748 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:30.837706976 +0000 UTC m=+4.169782247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gww26" (UniqueName: "kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26") pod "network-check-target-j6wvw" (UID: "f49e289a-4fe4-4387-af22-9df77fba7748") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:30.059158 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:30.059046 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:04:29 +0000 UTC" deadline="2028-04-13 03:12:03.643935757 +0000 UTC" Sep 09 23:09:30.059158 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:30.059095 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13948h2m33.58484687s" Sep 09 23:09:30.172009 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:30.171984 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:09:30.185424 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:30.185399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:30.185553 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.185502 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:30.185613 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:30.185579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:30.185695 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.185676 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:30.309350 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:30.309263 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea9777e_85c2_45d5_a758_8fe5e5b69901.slice/crio-c988c180a2ee05aa08855eaeba37cd33b427ba9ad21a84a3e808bc606e815b89 WatchSource:0}: Error finding container c988c180a2ee05aa08855eaeba37cd33b427ba9ad21a84a3e808bc606e815b89: Status 404 returned error can't find the container with id c988c180a2ee05aa08855eaeba37cd33b427ba9ad21a84a3e808bc606e815b89 Sep 09 23:09:30.311900 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:30.311869 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac59238_8719_48c3_b361_c29e700955f6.slice/crio-9f501d91d52e3925d13cc30aad01777f81089b9b108498cff815f8f8ca0baef8 WatchSource:0}: Error finding container 9f501d91d52e3925d13cc30aad01777f81089b9b108498cff815f8f8ca0baef8: Status 404 returned error can't find the container with id 9f501d91d52e3925d13cc30aad01777f81089b9b108498cff815f8f8ca0baef8 Sep 09 23:09:30.316180 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:30.316097 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5c89a8_c85f_40ba_8165_b9b7e9cfea46.slice/crio-b28c6e0d2749ef6e831c0a3a1d87f10be1c7b21baabeef4cd7d875b8c65eca81 WatchSource:0}: Error finding container b28c6e0d2749ef6e831c0a3a1d87f10be1c7b21baabeef4cd7d875b8c65eca81: Status 404 returned error can't find the container with id b28c6e0d2749ef6e831c0a3a1d87f10be1c7b21baabeef4cd7d875b8c65eca81 Sep 09 23:09:30.316372 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:30.316328 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71da0503_79c6_4565_a0ff_6c72c37611d3.slice/crio-936973d2241582d272316125fa7caa429d7568526e161c1c04e9b4186d238d0a WatchSource:0}: Error finding container 936973d2241582d272316125fa7caa429d7568526e161c1c04e9b4186d238d0a: Status 404 returned error can't find the container with id 936973d2241582d272316125fa7caa429d7568526e161c1c04e9b4186d238d0a Sep 09 23:09:30.321313 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:30.321075 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20db8a4_fabf_4205_bdef_8436a727be22.slice/crio-286825fa398eedcacbeb2eebf2e16fba7946db065cbd8d5b2a19631a3e49e4a7 WatchSource:0}: Error finding container 286825fa398eedcacbeb2eebf2e16fba7946db065cbd8d5b2a19631a3e49e4a7: Status 404 returned error can't find the container with id 286825fa398eedcacbeb2eebf2e16fba7946db065cbd8d5b2a19631a3e49e4a7 Sep 09 23:09:30.325500 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:09:30.325476 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c819edf_3815_4d46_9355_84b4b578df22.slice/crio-d0cd7a9a5dcc9c97bea484b38758afb260b3329253557f2022f1b48bf2efffa7 WatchSource:0}: Error finding container d0cd7a9a5dcc9c97bea484b38758afb260b3329253557f2022f1b48bf2efffa7: Status 404 returned error can't find the container with id d0cd7a9a5dcc9c97bea484b38758afb260b3329253557f2022f1b48bf2efffa7 Sep 09 23:09:30.643467 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:30.643440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:30.643571 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.643561 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:30.643618 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.643609 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret podName:d4d06d57-79a6-4bb2-8d2f-250f618ebb80 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:32.643594114 +0000 UTC m=+5.975669385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret") pod "global-pull-secret-syncer-72rtw" (UID: "d4d06d57-79a6-4bb2-8d2f-250f618ebb80") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:30.744563 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:30.744533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:30.744705 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.744670 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:30.744778 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.744740 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs podName:a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:32.744720405 +0000 UTC m=+6.076795689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs") pod "network-metrics-daemon-nb2kz" (UID: "a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:30.846506 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:30.845854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:30.846506 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.846092 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:09:30.846506 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.846113 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:09:30.846506 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.846126 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gww26 for pod openshift-network-diagnostics/network-check-target-j6wvw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:30.846506 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:30.846185 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26 podName:f49e289a-4fe4-4387-af22-9df77fba7748 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:32.846166544 +0000 UTC m=+6.178241818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gww26" (UniqueName: "kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26") pod "network-check-target-j6wvw" (UID: "f49e289a-4fe4-4387-af22-9df77fba7748") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:31.060177 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.060084 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:04:29 +0000 UTC" deadline="2028-03-30 15:32:41.497784334 +0000 UTC" Sep 09 23:09:31.060177 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.060146 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13624h23m10.437642425s" Sep 09 23:09:31.188881 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.188282 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:31.188881 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:31.188437 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:31.207733 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.207693 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" event={"ID":"3ac59238-8719-48c3-b361-c29e700955f6","Type":"ContainerStarted","Data":"9f501d91d52e3925d13cc30aad01777f81089b9b108498cff815f8f8ca0baef8"} Sep 09 23:09:31.215028 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.214992 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" event={"ID":"dea9777e-85c2-45d5-a758-8fe5e5b69901","Type":"ContainerStarted","Data":"c988c180a2ee05aa08855eaeba37cd33b427ba9ad21a84a3e808bc606e815b89"} Sep 09 23:09:31.224944 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.224879 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bg4h8" event={"ID":"1b59474e-cb01-47ba-9694-b91ec28f3bda","Type":"ContainerStarted","Data":"97289f58617ceb5b00552c0ee144777d50f1321d72fb791e9b251800a929f7e3"} Sep 09 23:09:31.235255 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.235218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5sztf" event={"ID":"887791de-ee8b-4a35-9682-2a2c112b28cd","Type":"ContainerStarted","Data":"5df851491ab587576f4687d591c59c816c2d65b9a7327c0afccb6131463ba35a"} Sep 09 23:09:31.241466 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.241439 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6kttg" event={"ID":"71da0503-79c6-4565-a0ff-6c72c37611d3","Type":"ContainerStarted","Data":"936973d2241582d272316125fa7caa429d7568526e161c1c04e9b4186d238d0a"} Sep 09 23:09:31.248057 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.248011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vfzlw" event={"ID":"1c5c89a8-c85f-40ba-8165-b9b7e9cfea46","Type":"ContainerStarted","Data":"b28c6e0d2749ef6e831c0a3a1d87f10be1c7b21baabeef4cd7d875b8c65eca81"} Sep 09 23:09:31.253885 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.253206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" event={"ID":"9e14240b2136a476f867f93a084571a5","Type":"ContainerStarted","Data":"9a2ea595c4681e3cc6f6c8ee1ca507e3fec0f5e51dc9a570e043c7ed34b8e97c"} Sep 09 23:09:31.256876 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.256364 2581 generic.go:356] "Generic (PLEG): container finished" podID="6000383f8fe5b41a9f74a13d8872f717" containerID="02c12a378667d311584cbc40ef4ef61aa9c59f4137505ba31d24bed7c2b7cc71" exitCode=0 Sep 09 23:09:31.256876 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.256453 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" event={"ID":"6000383f8fe5b41a9f74a13d8872f717","Type":"ContainerDied","Data":"02c12a378667d311584cbc40ef4ef61aa9c59f4137505ba31d24bed7c2b7cc71"} Sep 09 23:09:31.260462 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.260438 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"85d1a84b7cda47ce0ea8b5f590bb7fd649fab66cfddcab223a0f70ba6f997351"} Sep 09 23:09:31.264974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.264911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btdqf" event={"ID":"3c819edf-3815-4d46-9355-84b4b578df22","Type":"ContainerStarted","Data":"d0cd7a9a5dcc9c97bea484b38758afb260b3329253557f2022f1b48bf2efffa7"} Sep 09 23:09:31.270394 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.270048 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-106.ec2.internal" podStartSLOduration=2.270029897 podStartE2EDuration="2.270029897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:31.269627866 +0000 UTC m=+4.601703199" watchObservedRunningTime="2026-09-09 23:09:31.270029897 +0000 UTC m=+4.602105194" Sep 09 23:09:31.271677 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:31.271609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tbnwj" event={"ID":"f20db8a4-fabf-4205-bdef-8436a727be22","Type":"ContainerStarted","Data":"286825fa398eedcacbeb2eebf2e16fba7946db065cbd8d5b2a19631a3e49e4a7"} Sep 09 23:09:32.185673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:32.185642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:32.186293 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.185777 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:32.186293 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:32.186189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:32.186456 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.186303 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:32.309455 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:32.309421 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" event={"ID":"6000383f8fe5b41a9f74a13d8872f717","Type":"ContainerStarted","Data":"8f3d7773e1effcd7e96cbb0bc7b1adfdcf51fa960513fa8bf8e6804416bfa160"} Sep 09 23:09:32.662363 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:32.662274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:32.662555 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.662457 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:32.662555 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.662533 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret podName:d4d06d57-79a6-4bb2-8d2f-250f618ebb80 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:36.662510257 +0000 UTC m=+9.994585543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret") pod "global-pull-secret-syncer-72rtw" (UID: "d4d06d57-79a6-4bb2-8d2f-250f618ebb80") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:32.763976 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:32.763377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:32.763976 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.763501 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:32.763976 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.763567 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs podName:a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:36.763546866 +0000 UTC m=+10.095622149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs") pod "network-metrics-daemon-nb2kz" (UID: "a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:32.866184 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:32.865563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:32.866184 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.865731 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:09:32.866184 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.865758 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:09:32.866184 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.865773 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gww26 for pod openshift-network-diagnostics/network-check-target-j6wvw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:32.866184 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:32.865833 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26 podName:f49e289a-4fe4-4387-af22-9df77fba7748 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:36.865814063 +0000 UTC m=+10.197889339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gww26" (UniqueName: "kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26") pod "network-check-target-j6wvw" (UID: "f49e289a-4fe4-4387-af22-9df77fba7748") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:33.188996 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:33.188472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:33.188996 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:33.188608 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:34.185937 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:34.185899 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:34.186136 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:34.186024 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:34.186207 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:34.186146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:34.186312 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:34.186286 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:35.187900 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:35.187864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:35.188365 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:35.188055 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:36.185665 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:36.185569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:36.185665 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:36.185623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:36.186016 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.185717 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:36.186016 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.185896 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:36.698775 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:36.698619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:36.699463 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.698797 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:36.699463 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.698892 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret podName:d4d06d57-79a6-4bb2-8d2f-250f618ebb80 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:44.698868548 +0000 UTC m=+18.030943825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret") pod "global-pull-secret-syncer-72rtw" (UID: "d4d06d57-79a6-4bb2-8d2f-250f618ebb80") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:36.799545 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:36.799462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:36.799721 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.799651 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:36.799781 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.799727 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs podName:a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:44.799705455 +0000 UTC m=+18.131780731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs") pod "network-metrics-daemon-nb2kz" (UID: "a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:36.900658 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:36.900622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:36.900827 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.900779 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:09:36.900827 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.900799 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:09:36.900827 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.900810 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gww26 for pod openshift-network-diagnostics/network-check-target-j6wvw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:36.900990 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:36.900866 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26 podName:f49e289a-4fe4-4387-af22-9df77fba7748 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:44.900847758 +0000 UTC m=+18.232923029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gww26" (UniqueName: "kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26") pod "network-check-target-j6wvw" (UID: "f49e289a-4fe4-4387-af22-9df77fba7748") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:37.186731 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:37.186189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:37.186731 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:37.186310 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:38.185839 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:38.185795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:38.186296 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:38.185951 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:38.186583 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:38.186413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:38.186583 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:38.186540 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:39.185925 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:39.185897 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:39.186375 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:39.186025 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:40.185791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:40.185724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:40.185968 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:40.185865 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:40.185968 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:40.185891 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:40.186401 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:40.185992 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:41.185552 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:41.185520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:41.185717 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:41.185655 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:42.186042 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:42.186010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:42.186446 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:42.186013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:42.186446 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:42.186120 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:42.186446 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:42.186232 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:43.185710 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:43.185672 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:43.185877 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:43.185795 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:44.186013 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:44.185972 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:44.186525 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:44.185983 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:44.186525 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.186105 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:44.186525 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.186218 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:44.758039 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:44.757857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:44.758193 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.758007 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:44.758193 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.758107 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret podName:d4d06d57-79a6-4bb2-8d2f-250f618ebb80 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:00.758092078 +0000 UTC m=+34.090167346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret") pod "global-pull-secret-syncer-72rtw" (UID: "d4d06d57-79a6-4bb2-8d2f-250f618ebb80") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:09:44.859292 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:44.859260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:44.859456 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.859427 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:44.859501 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.859491 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs podName:a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd nodeName:}" failed. No retries permitted until 2026-09-09 23:10:00.859476762 +0000 UTC m=+34.191552035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs") pod "network-metrics-daemon-nb2kz" (UID: "a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:09:44.960423 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:44.960296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:44.960563 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.960472 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:09:44.960563 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.960501 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:09:44.960563 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.960513 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gww26 for pod openshift-network-diagnostics/network-check-target-j6wvw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:44.960563 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:44.960563 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26 podName:f49e289a-4fe4-4387-af22-9df77fba7748 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:00.960549684 +0000 UTC m=+34.292624953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gww26" (UniqueName: "kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26") pod "network-check-target-j6wvw" (UID: "f49e289a-4fe4-4387-af22-9df77fba7748") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:09:45.185879 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:45.185848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:45.186053 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:45.185948 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:46.185173 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:46.185141 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:46.185360 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:46.185258 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:46.185426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:46.185353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:46.185485 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:46.185459 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:47.186811 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:47.186775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:47.187211 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:47.186873 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:48.186052 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:48.186019 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:48.186220 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:48.186023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:48.186220 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:48.186141 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:48.186220 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:48.186194 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:48.360881 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:48.360848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6kttg" event={"ID":"71da0503-79c6-4565-a0ff-6c72c37611d3","Type":"ContainerStarted","Data":"0d8167f19ca12fea46c4830bde34477020c41c8dee6c415927aebed8a0ee5a9a"} Sep 09 23:09:48.385476 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:48.384969 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-106.ec2.internal" podStartSLOduration=19.384949022 podStartE2EDuration="19.384949022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:32.33008528 +0000 UTC m=+5.662160575" watchObservedRunningTime="2026-09-09 23:09:48.384949022 +0000 UTC m=+21.717024314" Sep 09 23:09:49.186249 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.186164 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:49.186431 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:49.186334 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:49.363771 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.363735 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bg4h8" event={"ID":"1b59474e-cb01-47ba-9694-b91ec28f3bda","Type":"ContainerStarted","Data":"71c4a8653ca5c8b02338900513f62fb3e42163a0741ab462eddc2629d06e5cfe"} Sep 09 23:09:49.365341 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.365293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5sztf" event={"ID":"887791de-ee8b-4a35-9682-2a2c112b28cd","Type":"ContainerStarted","Data":"8edf3efd837bfff5f4fca21ec739eac91b382aca2d36cd64b43a0c9505bfc4da"} Sep 09 23:09:49.366834 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.366812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vfzlw" event={"ID":"1c5c89a8-c85f-40ba-8165-b9b7e9cfea46","Type":"ContainerStarted","Data":"84d896df40e2d73ab0cf56e462c672b51398c6c5d91c8a8176d2c9e0f93a589b"} Sep 09 23:09:49.369840 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.369820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"6999c66957e96cdf669f90b719447bcfde6b995768c4f273573ede7cd3716425"} Sep 09 23:09:49.369931 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.369916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"e94285ef2faed934e80ed84b1045363d3f7c10767d934bf4265b5aec76499b73"} Sep 09 23:09:49.369976 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.369963 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"377a7707a953d763907d47d0d363842967c3a0691ac9cfe19a67557d3bd04fb3"} Sep 09 23:09:49.370009 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.369994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"0ac31c8dd3b3b7c2893686b2e2b06654265a7b476dd5056e5a53c5d0ee7619dd"} Sep 09 23:09:49.370049 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.370030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"2ba32d7f413434784faf9215919c68e886e0ea516e5d02d5928929a47be10d98"} Sep 09 23:09:49.370084 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.370078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"6b1d771b7abae297e32dc8c50f16bee2ec3b4fa3c9f868ec8b806a7f9f1415e1"} Sep 09 23:09:49.371155 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.371137 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tbnwj" event={"ID":"f20db8a4-fabf-4205-bdef-8436a727be22","Type":"ContainerStarted","Data":"1caab4de2e8c5857bb041d12df7981dd08f77669cb6bad8c2dcaaeb201fe3ab8"} Sep 09 23:09:49.372473 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.372453 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" event={"ID":"3ac59238-8719-48c3-b361-c29e700955f6","Type":"ContainerStarted","Data":"253c56de28f3a9aabc89c223bd995c2cf1623be0a270baaeeb4bd1a476d31930"} Sep 09 23:09:49.373821 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.373800 2581 generic.go:356] "Generic (PLEG): container finished" podID="dea9777e-85c2-45d5-a758-8fe5e5b69901" containerID="5088ca93324c7bbfdeaf3954fb1a3d16854599d16dfac7e77094b44556fde907" exitCode=0 Sep 09 23:09:49.373901 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.373851 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" event={"ID":"dea9777e-85c2-45d5-a758-8fe5e5b69901","Type":"ContainerDied","Data":"5088ca93324c7bbfdeaf3954fb1a3d16854599d16dfac7e77094b44556fde907"} Sep 09 23:09:49.379388 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.379353 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6kttg" podStartSLOduration=3.497332438 podStartE2EDuration="21.379340588s" totalImagesPullingTime="17.88200815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:48.384784752 +0000 UTC m=+21.716860045" watchObservedRunningTime="2026-09-09 23:09:49.379340588 +0000 UTC m=+22.711415878" Sep 09 23:09:49.379813 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.379791 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bg4h8" podStartSLOduration=3.447080294 podStartE2EDuration="21.379785011s" totalImagesPullingTime="17.932704717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:49.378810622 +0000 UTC m=+22.710885913" watchObservedRunningTime="2026-09-09 23:09:49.379785011 +0000 UTC m=+22.711860301" Sep 09 23:09:49.409899 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.409846 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vfzlw" podStartSLOduration=7.086855449 podStartE2EDuration="21.409830249s" totalImagesPullingTime="14.3229748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:49.4097778 +0000 UTC m=+22.741853090" watchObservedRunningTime="2026-09-09 23:09:49.409830249 +0000 UTC m=+22.741905536" Sep 09 23:09:49.422503 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.422469 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tbnwj" podStartSLOduration=3.5473119239999997 podStartE2EDuration="21.422457464s" totalImagesPullingTime="17.87514554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:49.422141135 +0000 UTC m=+22.754216428" watchObservedRunningTime="2026-09-09 23:09:49.422457464 +0000 UTC m=+22.754532754" Sep 09 23:09:49.437109 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.437045 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5sztf" podStartSLOduration=3.559972202 podStartE2EDuration="21.437032609s" totalImagesPullingTime="17.877060407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:49.436726308 +0000 UTC m=+22.768801599" watchObservedRunningTime="2026-09-09 23:09:49.437032609 +0000 UTC m=+22.769107899" Sep 09 23:09:49.670986 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:49.670949 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:09:50.185572 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:50.185534 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:50.185822 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:50.185582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:50.185822 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:50.185662 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:50.185822 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:50.185781 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:50.225127 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:50.225007 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:09:49.670984311Z","UUID":"b0b7be08-1c7b-4fae-b1de-23f67e20da51","Handler":null,"Name":"","Endpoint":""} Sep 09 23:09:50.226795 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:50.226775 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:09:50.226918 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:50.226812 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:09:50.377643 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:50.377606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btdqf" event={"ID":"3c819edf-3815-4d46-9355-84b4b578df22","Type":"ContainerStarted","Data":"a44ced74bf426532b08fc32d32f78f583f10614cab2f59858ca179fd1ea4641c"} Sep 09 23:09:50.380637 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:50.380600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" event={"ID":"3ac59238-8719-48c3-b361-c29e700955f6","Type":"ContainerStarted","Data":"ba5518187b56c89513677a467c005e38f452b6e705812775cf5256e770c68bd5"} Sep 09 23:09:50.391113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:50.391067 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-btdqf" podStartSLOduration=8.098161707 podStartE2EDuration="22.391054659s" totalImagesPullingTime="14.292892952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:50.390550699 +0000 UTC m=+23.722625992" watchObservedRunningTime="2026-09-09 23:09:50.391054659 +0000 UTC m=+23.723129949" Sep 09 23:09:51.185458 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:51.185362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:51.185608 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:51.185503 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:51.387090 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:51.387043 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"ba87059acab0b6a4b0fee3e24e9879732aebf2cb68f48f0679dfedf3e3b02254"} Sep 09 23:09:51.389446 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:51.389401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" event={"ID":"3ac59238-8719-48c3-b361-c29e700955f6","Type":"ContainerStarted","Data":"13cba37f11b279e1371baa759302abe9fecca9719d7e1d5f9e25aabd581d902d"} Sep 09 23:09:51.405970 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:51.405909 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8gg9j" podStartSLOduration=3.395351911 podStartE2EDuration="23.405892052s" totalImagesPullingTime="20.010540141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:51.405609613 +0000 UTC m=+24.737684904" watchObservedRunningTime="2026-09-09 23:09:51.405892052 +0000 UTC m=+24.737967342" Sep 09 23:09:52.185430 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:52.185397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:52.185603 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:52.185496 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:52.185603 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:52.185516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:52.185717 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:52.185641 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:53.185848 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:53.185816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:53.186361 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:53.185929 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:54.129011 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.128848 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:54.129496 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.129474 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:54.185899 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.185880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:54.186249 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.185880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:54.186249 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:54.186019 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:54.186249 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:54.186038 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:54.399584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.399530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" event={"ID":"561207ac-633f-450e-8947-c300a6dc4233","Type":"ContainerStarted","Data":"a4dd419b0e635f11c4a74687d97b7e2c25443a773a489f50a484725b4c30c7fe"} Sep 09 23:09:54.399808 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.399782 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:54.401559 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.401533 2581 generic.go:356] "Generic (PLEG): container finished" podID="dea9777e-85c2-45d5-a758-8fe5e5b69901" containerID="289eade0d2dd219dd23d56a892d1d5a85ff06784216f937074749a78edcc2978" exitCode=0 Sep 09 23:09:54.401652 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.401612 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" event={"ID":"dea9777e-85c2-45d5-a758-8fe5e5b69901","Type":"ContainerDied","Data":"289eade0d2dd219dd23d56a892d1d5a85ff06784216f937074749a78edcc2978"} Sep 09 23:09:54.401742 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.401725 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:54.402263 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.402195 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vfzlw" Sep 09 23:09:54.414012 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.413990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:54.426393 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:54.425343 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" podStartSLOduration=8.483862168 podStartE2EDuration="26.42532752s" totalImagesPullingTime="17.941465352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:54.423473832 +0000 UTC m=+27.755549123" watchObservedRunningTime="2026-09-09 23:09:54.42532752 +0000 UTC m=+27.757402806" Sep 09 23:09:55.185837 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.185769 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:55.186122 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:55.185938 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:55.403702 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.403671 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:55.404202 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.404188 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:55.417558 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.417535 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:09:55.869207 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.869122 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-72rtw"] Sep 09 23:09:55.869397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.869251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:55.869478 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:55.869398 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:55.872182 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.872157 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j6wvw"] Sep 09 23:09:55.872298 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.872260 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:55.872376 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:55.872358 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:55.879844 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.879817 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nb2kz"] Sep 09 23:09:55.881444 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:55.880331 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:55.881444 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:55.880486 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:56.408180 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:56.408147 2581 generic.go:356] "Generic (PLEG): container finished" podID="dea9777e-85c2-45d5-a758-8fe5e5b69901" containerID="1fa2dd8a538abdaa99ec864dd3d54d30d8a626fc2492c861e3ca2de341ed05b0" exitCode=0 Sep 09 23:09:56.408761 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:56.408234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" event={"ID":"dea9777e-85c2-45d5-a758-8fe5e5b69901","Type":"ContainerDied","Data":"1fa2dd8a538abdaa99ec864dd3d54d30d8a626fc2492c861e3ca2de341ed05b0"} Sep 09 23:09:57.186798 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:57.186764 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:57.186945 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:57.186900 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:09:58.185957 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:58.185927 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:09:58.186289 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:58.186028 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:09:58.186289 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:58.186057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:09:58.186289 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:58.186123 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:09:58.416093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:58.416013 2581 generic.go:356] "Generic (PLEG): container finished" podID="dea9777e-85c2-45d5-a758-8fe5e5b69901" containerID="66673575b73986381d6ab912fb92bcb0531bd96c75fe71925321cfcec074f549" exitCode=0 Sep 09 23:09:58.416093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:58.416074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" event={"ID":"dea9777e-85c2-45d5-a758-8fe5e5b69901","Type":"ContainerDied","Data":"66673575b73986381d6ab912fb92bcb0531bd96c75fe71925321cfcec074f549"} Sep 09 23:09:59.186096 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:09:59.186061 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:09:59.186625 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:09:59.186204 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nb2kz" podUID="a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd" Sep 09 23:10:00.185350 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.185306 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:10:00.185528 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.185326 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:10:00.185528 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.185418 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6wvw" podUID="f49e289a-4fe4-4387-af22-9df77fba7748" Sep 09 23:10:00.185528 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.185504 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-72rtw" podUID="d4d06d57-79a6-4bb2-8d2f-250f618ebb80" Sep 09 23:10:00.773741 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.773714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:10:00.774122 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.773845 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:10:00.774122 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.773901 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret podName:d4d06d57-79a6-4bb2-8d2f-250f618ebb80 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:32.773883827 +0000 UTC m=+66.105959098 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret") pod "global-pull-secret-syncer-72rtw" (UID: "d4d06d57-79a6-4bb2-8d2f-250f618ebb80") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:10:00.874496 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.874431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:10:00.874661 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.874549 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:10:00.874661 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.874623 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs podName:a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd nodeName:}" failed. No retries permitted until 2026-09-09 23:10:32.874601366 +0000 UTC m=+66.206676639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs") pod "network-metrics-daemon-nb2kz" (UID: "a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:10:00.930824 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.930795 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-106.ec2.internal" event="NodeReady" Sep 09 23:10:00.930985 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.930933 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:10:00.975380 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.975293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:10:00.975494 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.975469 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:10:00.975494 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.975490 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:10:00.975560 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.975500 2581 projected.go:196] Error preparing data for projected volume kube-api-access-gww26 for pod openshift-network-diagnostics/network-check-target-j6wvw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:10:00.975560 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:00.975553 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26 podName:f49e289a-4fe4-4387-af22-9df77fba7748 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:32.97553827 +0000 UTC m=+66.307613539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gww26" (UniqueName: "kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26") pod "network-check-target-j6wvw" (UID: "f49e289a-4fe4-4387-af22-9df77fba7748") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:10:00.977474 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.977449 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jt4tm"] Sep 09 23:10:00.980449 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.980422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:00.981115 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.981098 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x8w9q"] Sep 09 23:10:00.982442 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.982417 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:10:00.982442 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.982433 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f58z\"" Sep 09 23:10:00.982570 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.982416 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:10:00.983770 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.983752 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x8w9q" Sep 09 23:10:00.985524 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.985509 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:10:00.985720 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.985705 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:10:00.985771 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.985741 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gc94v\"" Sep 09 23:10:00.985806 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.985774 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:10:00.993061 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.993003 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jt4tm"] Sep 09 23:10:00.993895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:00.993873 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x8w9q"] Sep 09 23:10:01.076667 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.076628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bfg\" (UniqueName: \"kubernetes.io/projected/754321de-157e-4b69-8b09-acf6af60bd40-kube-api-access-s2bfg\") pod \"ingress-canary-x8w9q\" (UID: \"754321de-157e-4b69-8b09-acf6af60bd40\") " pod="openshift-ingress-canary/ingress-canary-x8w9q" Sep 09 23:10:01.076821 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.076695 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5476d\" (UniqueName: \"kubernetes.io/projected/a1406c57-5f7a-4603-bfb1-274f3a956de2-kube-api-access-5476d\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.076821 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.076742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1406c57-5f7a-4603-bfb1-274f3a956de2-config-volume\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.076821 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.076780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.076821 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.076809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/754321de-157e-4b69-8b09-acf6af60bd40-cert\") pod \"ingress-canary-x8w9q\" (UID: \"754321de-157e-4b69-8b09-acf6af60bd40\") " pod="openshift-ingress-canary/ingress-canary-x8w9q" Sep 09 23:10:01.076990 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.076830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1406c57-5f7a-4603-bfb1-274f3a956de2-tmp-dir\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.178035 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.178006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1406c57-5f7a-4603-bfb1-274f3a956de2-config-volume\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.178168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.178041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.178168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.178061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/754321de-157e-4b69-8b09-acf6af60bd40-cert\") pod \"ingress-canary-x8w9q\" (UID: \"754321de-157e-4b69-8b09-acf6af60bd40\") " pod="openshift-ingress-canary/ingress-canary-x8w9q" Sep 09 23:10:01.178168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.178082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1406c57-5f7a-4603-bfb1-274f3a956de2-tmp-dir\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.178168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.178122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bfg\" (UniqueName: \"kubernetes.io/projected/754321de-157e-4b69-8b09-acf6af60bd40-kube-api-access-s2bfg\") pod \"ingress-canary-x8w9q\" (UID: \"754321de-157e-4b69-8b09-acf6af60bd40\") " pod="openshift-ingress-canary/ingress-canary-x8w9q" Sep 09 23:10:01.178168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.178164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5476d\" (UniqueName: \"kubernetes.io/projected/a1406c57-5f7a-4603-bfb1-274f3a956de2-kube-api-access-5476d\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.178486 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:01.178189 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:10:01.178486 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:01.178253 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls podName:a1406c57-5f7a-4603-bfb1-274f3a956de2 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:01.678230905 +0000 UTC m=+35.010306190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls") pod "dns-default-jt4tm" (UID: "a1406c57-5f7a-4603-bfb1-274f3a956de2") : secret "dns-default-metrics-tls" not found Sep 09 23:10:01.178585 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.178496 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1406c57-5f7a-4603-bfb1-274f3a956de2-tmp-dir\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.178630 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.178609 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1406c57-5f7a-4603-bfb1-274f3a956de2-config-volume\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.182665 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.182643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/754321de-157e-4b69-8b09-acf6af60bd40-cert\") pod \"ingress-canary-x8w9q\" (UID: \"754321de-157e-4b69-8b09-acf6af60bd40\") " pod="openshift-ingress-canary/ingress-canary-x8w9q" Sep 09 23:10:01.186000 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.185979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:10:01.187981 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.187960 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:10:01.188106 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.188045 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2q2rs\"" Sep 09 23:10:01.189223 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.189199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5476d\" (UniqueName: \"kubernetes.io/projected/a1406c57-5f7a-4603-bfb1-274f3a956de2-kube-api-access-5476d\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.189577 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.189556 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bfg\" (UniqueName: \"kubernetes.io/projected/754321de-157e-4b69-8b09-acf6af60bd40-kube-api-access-s2bfg\") pod \"ingress-canary-x8w9q\" (UID: \"754321de-157e-4b69-8b09-acf6af60bd40\") " pod="openshift-ingress-canary/ingress-canary-x8w9q" Sep 09 23:10:01.297589 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.297510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x8w9q" Sep 09 23:10:01.587610 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.587359 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x8w9q"] Sep 09 23:10:01.592347 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:01.592300 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754321de_157e_4b69_8b09_acf6af60bd40.slice/crio-5dd22838b86770ca744a708fe0c52044449acb6795fcd1e07f991a75e72e24a8 WatchSource:0}: Error finding container 5dd22838b86770ca744a708fe0c52044449acb6795fcd1e07f991a75e72e24a8: Status 404 returned error can't find the container with id 5dd22838b86770ca744a708fe0c52044449acb6795fcd1e07f991a75e72e24a8 Sep 09 23:10:01.683102 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:01.683071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:01.683236 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:01.683213 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:10:01.683295 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:01.683274 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls podName:a1406c57-5f7a-4603-bfb1-274f3a956de2 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:02.683255837 +0000 UTC m=+36.015331106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls") pod "dns-default-jt4tm" (UID: "a1406c57-5f7a-4603-bfb1-274f3a956de2") : secret "dns-default-metrics-tls" not found Sep 09 23:10:02.186151 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.186117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:10:02.186608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.186127 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:10:02.188773 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.188753 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92n2q\"" Sep 09 23:10:02.188905 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.188798 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:10:02.189361 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.189342 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:10:02.189480 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.189385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:10:02.427460 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.427423 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x8w9q" event={"ID":"754321de-157e-4b69-8b09-acf6af60bd40","Type":"ContainerStarted","Data":"5dd22838b86770ca744a708fe0c52044449acb6795fcd1e07f991a75e72e24a8"} Sep 09 23:10:02.446012 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.445936 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kjmfv"] Sep 09 23:10:02.450963 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.450933 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.453161 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.453135 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:10:02.453284 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.453167 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:10:02.453374 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.453302 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:10:02.456534 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.453706 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:10:02.456534 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.453928 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zrvp\"" Sep 09 23:10:02.460442 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.460421 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kjmfv"] Sep 09 23:10:02.589929 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.589899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.590098 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.589974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.590098 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.590017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abb64122-db22-40f5-834b-03a0d4cdfe79-data-volume\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.590222 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.590106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abb64122-db22-40f5-834b-03a0d4cdfe79-crio-socket\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.590222 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.590148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq588\" (UniqueName: \"kubernetes.io/projected/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-api-access-vq588\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.691230 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.691199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abb64122-db22-40f5-834b-03a0d4cdfe79-crio-socket\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.691230 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.691232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq588\" (UniqueName: \"kubernetes.io/projected/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-api-access-vq588\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.691478 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.691289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:02.691478 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.691336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.691478 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.691352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.691478 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.691372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abb64122-db22-40f5-834b-03a0d4cdfe79-data-volume\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.691478 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:02.691466 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:10:02.691720 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:02.691486 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:10:02.691720 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.691470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abb64122-db22-40f5-834b-03a0d4cdfe79-crio-socket\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.691720 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:02.691547 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:03.191524239 +0000 UTC m=+36.523599528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : configmap "kube-rbac-proxy" not found Sep 09 23:10:02.691720 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:02.691463 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:10:02.691720 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:02.691566 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:03.191556601 +0000 UTC m=+36.523631871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : secret "insights-runtime-extractor-tls" not found Sep 09 23:10:02.691720 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:02.691598 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls podName:a1406c57-5f7a-4603-bfb1-274f3a956de2 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:04.691581704 +0000 UTC m=+38.023656979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls") pod "dns-default-jt4tm" (UID: "a1406c57-5f7a-4603-bfb1-274f3a956de2") : secret "dns-default-metrics-tls" not found Sep 09 23:10:02.691970 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.691954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abb64122-db22-40f5-834b-03a0d4cdfe79-data-volume\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:02.700626 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:02.700569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq588\" (UniqueName: \"kubernetes.io/projected/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-api-access-vq588\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:03.195320 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.195233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:03.195320 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.195281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:03.195320 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:03.195296 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:10:03.195878 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:03.195382 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:04.195363075 +0000 UTC m=+37.527438362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : configmap "kube-rbac-proxy" not found Sep 09 23:10:03.195878 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:03.195455 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:10:03.195878 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:03.195529 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:04.195511087 +0000 UTC m=+37.527586375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : secret "insights-runtime-extractor-tls" not found Sep 09 23:10:03.561075 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.561051 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx"] Sep 09 23:10:03.563648 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.563629 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" Sep 09 23:10:03.565823 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.565570 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 09 23:10:03.565823 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.565601 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rk2ms\"" Sep 09 23:10:03.565823 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.565626 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 09 23:10:03.574399 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.574377 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx"] Sep 09 23:10:03.699468 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.699439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-486pd\" (UniqueName: \"kubernetes.io/projected/83e6c88c-6c45-4b42-97e2-03ac80e00f74-kube-api-access-486pd\") pod \"migrator-fdbb8fdff-ttbvx\" (UID: \"83e6c88c-6c45-4b42-97e2-03ac80e00f74\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" Sep 09 23:10:03.800440 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.800370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-486pd\" (UniqueName: \"kubernetes.io/projected/83e6c88c-6c45-4b42-97e2-03ac80e00f74-kube-api-access-486pd\") pod \"migrator-fdbb8fdff-ttbvx\" (UID: \"83e6c88c-6c45-4b42-97e2-03ac80e00f74\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" Sep 09 23:10:03.808134 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.808108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-486pd\" (UniqueName: \"kubernetes.io/projected/83e6c88c-6c45-4b42-97e2-03ac80e00f74-kube-api-access-486pd\") pod \"migrator-fdbb8fdff-ttbvx\" (UID: \"83e6c88c-6c45-4b42-97e2-03ac80e00f74\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" Sep 09 23:10:03.872625 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:03.872595 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" Sep 09 23:10:04.152704 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:04.152620 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx"] Sep 09 23:10:04.157100 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:04.157075 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e6c88c_6c45_4b42_97e2_03ac80e00f74.slice/crio-c7f1c016f93a34b9a7267e9fa56cb11edb0e317aca02fd3f4dcf0cd45d908236 WatchSource:0}: Error finding container c7f1c016f93a34b9a7267e9fa56cb11edb0e317aca02fd3f4dcf0cd45d908236: Status 404 returned error can't find the container with id c7f1c016f93a34b9a7267e9fa56cb11edb0e317aca02fd3f4dcf0cd45d908236 Sep 09 23:10:04.203833 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:04.203810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:04.204410 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:04.203845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:04.204410 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:04.203898 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:10:04.204410 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:04.203965 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:06.203946279 +0000 UTC m=+39.536021562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : configmap "kube-rbac-proxy" not found Sep 09 23:10:04.204410 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:04.203989 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:10:04.204410 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:04.204030 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:06.204018648 +0000 UTC m=+39.536093934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : secret "insights-runtime-extractor-tls" not found Sep 09 23:10:04.434247 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:04.434168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" event={"ID":"83e6c88c-6c45-4b42-97e2-03ac80e00f74","Type":"ContainerStarted","Data":"c7f1c016f93a34b9a7267e9fa56cb11edb0e317aca02fd3f4dcf0cd45d908236"} Sep 09 23:10:04.438566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:04.438524 2581 generic.go:356] "Generic (PLEG): container finished" podID="dea9777e-85c2-45d5-a758-8fe5e5b69901" containerID="bd2ebb37b7b59ab04aeadad8a1e494313dbcae9f73ea8b67e159627999120410" exitCode=0 Sep 09 23:10:04.438566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:04.438565 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" event={"ID":"dea9777e-85c2-45d5-a758-8fe5e5b69901","Type":"ContainerDied","Data":"bd2ebb37b7b59ab04aeadad8a1e494313dbcae9f73ea8b67e159627999120410"} Sep 09 23:10:04.609845 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:04.609823 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tbnwj_f20db8a4-fabf-4205-bdef-8436a727be22/dns-node-resolver/0.log" Sep 09 23:10:04.706898 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:04.706820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:04.706985 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:04.706966 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:10:04.707035 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:04.707025 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls podName:a1406c57-5f7a-4603-bfb1-274f3a956de2 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:08.707007533 +0000 UTC m=+42.039082804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls") pod "dns-default-jt4tm" (UID: "a1406c57-5f7a-4603-bfb1-274f3a956de2") : secret "dns-default-metrics-tls" not found Sep 09 23:10:05.210673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.210646 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5sztf_887791de-ee8b-4a35-9682-2a2c112b28cd/node-ca/0.log" Sep 09 23:10:05.329848 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.329815 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9pqjd"] Sep 09 23:10:05.337359 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.337328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.340000 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.339648 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9pqjd"] Sep 09 23:10:05.340000 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.339780 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 09 23:10:05.340000 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.339791 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 09 23:10:05.340000 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.339882 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 09 23:10:05.340259 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.340117 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 09 23:10:05.340637 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.340476 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xl57q\"" Sep 09 23:10:05.443972 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.443946 2581 generic.go:356] "Generic (PLEG): container finished" podID="dea9777e-85c2-45d5-a758-8fe5e5b69901" containerID="466740fdd43ac02a4243c2021fd454f3c1004aec980fcad3ee6bffea812026c9" exitCode=0 Sep 09 23:10:05.444099 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.444001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" event={"ID":"dea9777e-85c2-45d5-a758-8fe5e5b69901","Type":"ContainerDied","Data":"466740fdd43ac02a4243c2021fd454f3c1004aec980fcad3ee6bffea812026c9"} Sep 09 23:10:05.513369 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.513340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37b32953-848f-49ed-8478-24a8f624c87e-signing-key\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.513490 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.513378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37b32953-848f-49ed-8478-24a8f624c87e-signing-cabundle\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.513555 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.513534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s2rs\" (UniqueName: \"kubernetes.io/projected/37b32953-848f-49ed-8478-24a8f624c87e-kube-api-access-2s2rs\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.613898 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.613832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s2rs\" (UniqueName: \"kubernetes.io/projected/37b32953-848f-49ed-8478-24a8f624c87e-kube-api-access-2s2rs\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.614072 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.614048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37b32953-848f-49ed-8478-24a8f624c87e-signing-key\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.614139 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.614085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37b32953-848f-49ed-8478-24a8f624c87e-signing-cabundle\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.614820 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.614796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37b32953-848f-49ed-8478-24a8f624c87e-signing-cabundle\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.617029 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.617005 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37b32953-848f-49ed-8478-24a8f624c87e-signing-key\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.621283 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.621258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s2rs\" (UniqueName: \"kubernetes.io/projected/37b32953-848f-49ed-8478-24a8f624c87e-kube-api-access-2s2rs\") pod \"service-ca-75d99c484-9pqjd\" (UID: \"37b32953-848f-49ed-8478-24a8f624c87e\") " pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:05.649297 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:05.649257 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-9pqjd" Sep 09 23:10:06.218549 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:06.218518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:06.218859 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:06.218564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:06.218859 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:06.218623 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:10:06.218859 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:06.218658 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:10:06.218859 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:06.218696 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:10.218681759 +0000 UTC m=+43.550757028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : configmap "kube-rbac-proxy" not found Sep 09 23:10:06.218859 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:06.218743 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:10.218729569 +0000 UTC m=+43.550804842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : secret "insights-runtime-extractor-tls" not found Sep 09 23:10:06.448421 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:06.448331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x8w9q" event={"ID":"754321de-157e-4b69-8b09-acf6af60bd40","Type":"ContainerStarted","Data":"e4b427575af37b3b3dbfad06f37df1bee6eb8f6ae17705c963b3d6da3b603c2f"} Sep 09 23:10:06.452165 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:06.451676 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-9pqjd"] Sep 09 23:10:06.453403 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:06.453291 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" event={"ID":"dea9777e-85c2-45d5-a758-8fe5e5b69901","Type":"ContainerStarted","Data":"15adc6f786c0ea44fb236d2695267031395f628222a25f4ba3b01835fd8ec166"} Sep 09 23:10:06.465011 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:06.464964 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x8w9q" podStartSLOduration=1.8635868279999999 podStartE2EDuration="6.46495064s" totalImagesPullingTime="4.601363812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:06.464556042 +0000 UTC m=+39.796631335" watchObservedRunningTime="2026-09-09 23:10:06.46495064 +0000 UTC m=+39.797025927" Sep 09 23:10:06.487142 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:06.487100 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bhzpt" podStartSLOduration=8.679670822 podStartE2EDuration="38.487090884s" totalImagesPullingTime="29.807420062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:06.486322779 +0000 UTC m=+39.818398061" watchObservedRunningTime="2026-09-09 23:10:06.487090884 +0000 UTC m=+39.819166172" Sep 09 23:10:06.489780 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:06.489755 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b32953_848f_49ed_8478_24a8f624c87e.slice/crio-422aafae446f4a647a77f046b68c462e6925e573a085aaabcdbebcc26477a85c WatchSource:0}: Error finding container 422aafae446f4a647a77f046b68c462e6925e573a085aaabcdbebcc26477a85c: Status 404 returned error can't find the container with id 422aafae446f4a647a77f046b68c462e6925e573a085aaabcdbebcc26477a85c Sep 09 23:10:07.458526 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:07.458490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" event={"ID":"83e6c88c-6c45-4b42-97e2-03ac80e00f74","Type":"ContainerStarted","Data":"3311f3cbb78b3ea1dd9cdc6236197aa22b476c4ff26ba015396f38462fa65fc2"} Sep 09 23:10:07.458984 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:07.458553 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" event={"ID":"83e6c88c-6c45-4b42-97e2-03ac80e00f74","Type":"ContainerStarted","Data":"0c9a94cb1a1d1de49c5047eefc9707f6ff2771bc2c259f369b21bd35e92d78d7"} Sep 09 23:10:07.459996 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:07.459960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-9pqjd" event={"ID":"37b32953-848f-49ed-8478-24a8f624c87e","Type":"ContainerStarted","Data":"422aafae446f4a647a77f046b68c462e6925e573a085aaabcdbebcc26477a85c"} Sep 09 23:10:07.473100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:07.473049 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ttbvx" podStartSLOduration=2.125753668 podStartE2EDuration="4.473031819s" totalImagesPullingTime="2.347278151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:07.472579092 +0000 UTC m=+40.804654384" watchObservedRunningTime="2026-09-09 23:10:07.473031819 +0000 UTC m=+40.805107111" Sep 09 23:10:08.738854 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:08.738823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:08.739189 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:08.738917 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:10:08.739189 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:08.738968 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls podName:a1406c57-5f7a-4603-bfb1-274f3a956de2 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:16.738954047 +0000 UTC m=+50.071029316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls") pod "dns-default-jt4tm" (UID: "a1406c57-5f7a-4603-bfb1-274f3a956de2") : secret "dns-default-metrics-tls" not found Sep 09 23:10:09.466447 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:09.466414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-9pqjd" event={"ID":"37b32953-848f-49ed-8478-24a8f624c87e","Type":"ContainerStarted","Data":"676ca6446c1a669735238ba718c1e98c23206bb9205acf4888c461cb62eaf0d5"} Sep 09 23:10:09.483794 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:09.483749 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-9pqjd" podStartSLOduration=2.127340197 podStartE2EDuration="4.483734353s" totalImagesPullingTime="2.356394156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:09.48275047 +0000 UTC m=+42.814825761" watchObservedRunningTime="2026-09-09 23:10:09.483734353 +0000 UTC m=+42.815809644" Sep 09 23:10:10.248847 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:10.248815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:10.248847 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:10.248847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:10.249305 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:10.248924 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:10:10.249305 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:10.248925 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:10:10.249305 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:10.248975 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:18.248961779 +0000 UTC m=+51.581037049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : secret "insights-runtime-extractor-tls" not found Sep 09 23:10:10.249305 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:10.248988 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:18.248981896 +0000 UTC m=+51.581057164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : configmap "kube-rbac-proxy" not found Sep 09 23:10:16.798223 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:16.798191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:16.800505 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:16.800473 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1406c57-5f7a-4603-bfb1-274f3a956de2-metrics-tls\") pod \"dns-default-jt4tm\" (UID: \"a1406c57-5f7a-4603-bfb1-274f3a956de2\") " pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:16.890895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:16.890865 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:17.207824 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:17.207038 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jt4tm"] Sep 09 23:10:17.212258 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:17.212217 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1406c57_5f7a_4603_bfb1_274f3a956de2.slice/crio-dcbc09716324bc6f17fb9d3637e999bfd2be7054c3087ba43eb8bc6313cb1e2e WatchSource:0}: Error finding container dcbc09716324bc6f17fb9d3637e999bfd2be7054c3087ba43eb8bc6313cb1e2e: Status 404 returned error can't find the container with id dcbc09716324bc6f17fb9d3637e999bfd2be7054c3087ba43eb8bc6313cb1e2e Sep 09 23:10:17.488289 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:17.488251 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jt4tm" event={"ID":"a1406c57-5f7a-4603-bfb1-274f3a956de2","Type":"ContainerStarted","Data":"dcbc09716324bc6f17fb9d3637e999bfd2be7054c3087ba43eb8bc6313cb1e2e"} Sep 09 23:10:18.311799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:18.311766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:18.312258 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:18.311811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:18.312258 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:18.311932 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:10:18.312258 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:18.311979 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls podName:abb64122-db22-40f5-834b-03a0d4cdfe79 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:34.311965692 +0000 UTC m=+67.644040961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjmfv" (UID: "abb64122-db22-40f5-834b-03a0d4cdfe79") : secret "insights-runtime-extractor-tls" not found Sep 09 23:10:18.312498 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:18.312477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abb64122-db22-40f5-834b-03a0d4cdfe79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:19.496059 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:19.496035 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jt4tm" event={"ID":"a1406c57-5f7a-4603-bfb1-274f3a956de2","Type":"ContainerStarted","Data":"d13e0bb421cbfa5bb493b92158f65f0af4eb94618ee8b34fe01e9d9137ea1e24"} Sep 09 23:10:19.496484 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:19.496090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jt4tm" event={"ID":"a1406c57-5f7a-4603-bfb1-274f3a956de2","Type":"ContainerStarted","Data":"08f4bb366f3047ce831cf49d4a5b52f5bf6495d020c82c40518424e0c27a5df5"} Sep 09 23:10:19.496484 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:19.496178 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:19.513503 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:19.513463 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jt4tm" podStartSLOduration=17.516442945 podStartE2EDuration="19.513451709s" totalImagesPullingTime="1.997008764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:19.512954741 +0000 UTC m=+52.845030032" watchObservedRunningTime="2026-09-09 23:10:19.513451709 +0000 UTC m=+52.845527042" Sep 09 23:10:26.206725 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.206688 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-859f49dc7c-bkhhr"] Sep 09 23:10:26.238115 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.238078 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-859f49dc7c-bkhhr"] Sep 09 23:10:26.238282 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.238240 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.240838 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.240816 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 23:10:26.240982 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.240963 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-97thr\"" Sep 09 23:10:26.241033 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.240992 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 23:10:26.241450 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.241433 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 23:10:26.247646 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.247617 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 23:10:26.265266 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.265231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-registry-certificates\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.265459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.265277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-trusted-ca\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.265459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.265329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-installation-pull-secrets\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.265459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.265372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-image-registry-private-configuration\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.265459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.265392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-registry-tls\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.265459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.265406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-ca-trust-extracted\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.265459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.265422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-bound-sa-token\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.265459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.265447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lzsr\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-kube-api-access-6lzsr\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.365830 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.365777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-image-registry-private-configuration\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.365830 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.365829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-registry-tls\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.366095 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.365852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-ca-trust-extracted\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.366095 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.365872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-bound-sa-token\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.366095 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.365887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lzsr\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-kube-api-access-6lzsr\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.366254 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.366106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-registry-certificates\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.366254 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.366170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-trusted-ca\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.366254 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.366239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-installation-pull-secrets\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.366429 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.366287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-ca-trust-extracted\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.367123 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.367091 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-registry-certificates\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.367302 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.367277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-trusted-ca\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.368425 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.368402 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-image-registry-private-configuration\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.368550 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.368531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-registry-tls\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.368627 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.368611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-installation-pull-secrets\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.374236 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.374207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-bound-sa-token\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.374528 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.374507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lzsr\" (UniqueName: \"kubernetes.io/projected/1007abb4-3ef5-4ff3-9099-b48ce334cc1a-kube-api-access-6lzsr\") pod \"image-registry-859f49dc7c-bkhhr\" (UID: \"1007abb4-3ef5-4ff3-9099-b48ce334cc1a\") " pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.549172 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.549128 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:26.842891 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:26.842810 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-859f49dc7c-bkhhr"] Sep 09 23:10:26.845807 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:26.845776 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1007abb4_3ef5_4ff3_9099_b48ce334cc1a.slice/crio-aa777de0f26d85b1cd0cd7da1266bba26e6ea994c48de58321a19616ec15913f WatchSource:0}: Error finding container aa777de0f26d85b1cd0cd7da1266bba26e6ea994c48de58321a19616ec15913f: Status 404 returned error can't find the container with id aa777de0f26d85b1cd0cd7da1266bba26e6ea994c48de58321a19616ec15913f Sep 09 23:10:27.421564 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:27.421537 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9lpg" Sep 09 23:10:27.523240 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:27.523205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" event={"ID":"1007abb4-3ef5-4ff3-9099-b48ce334cc1a","Type":"ContainerStarted","Data":"5a856ceaa0328eaabf44ca0b47e83f8aff1458add2705c9e90a963b6fa2007ab"} Sep 09 23:10:27.523433 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:27.523257 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" event={"ID":"1007abb4-3ef5-4ff3-9099-b48ce334cc1a","Type":"ContainerStarted","Data":"aa777de0f26d85b1cd0cd7da1266bba26e6ea994c48de58321a19616ec15913f"} Sep 09 23:10:27.523433 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:27.523364 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:27.545325 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:27.545240 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" podStartSLOduration=1.545220509 podStartE2EDuration="1.545220509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:27.544486444 +0000 UTC m=+60.876561741" watchObservedRunningTime="2026-09-09 23:10:27.545220509 +0000 UTC m=+60.877295799" Sep 09 23:10:29.502272 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:29.502244 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jt4tm" Sep 09 23:10:30.970532 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:30.970496 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s"] Sep 09 23:10:30.973224 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:30.973206 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" Sep 09 23:10:30.975294 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:30.975269 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 09 23:10:30.975428 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:30.975293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pv7cm\"" Sep 09 23:10:30.981512 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:30.981485 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s"] Sep 09 23:10:31.004492 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:31.004464 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1fd49c71-0e6b-4c88-8cd4-77adb0d083b4-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rx62s\" (UID: \"1fd49c71-0e6b-4c88-8cd4-77adb0d083b4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" Sep 09 23:10:31.104961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:31.104929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1fd49c71-0e6b-4c88-8cd4-77adb0d083b4-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rx62s\" (UID: \"1fd49c71-0e6b-4c88-8cd4-77adb0d083b4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" Sep 09 23:10:31.105090 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:31.105062 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 09 23:10:31.105137 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:31.105126 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd49c71-0e6b-4c88-8cd4-77adb0d083b4-tls-certificates podName:1fd49c71-0e6b-4c88-8cd4-77adb0d083b4 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:31.605110162 +0000 UTC m=+64.937185431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1fd49c71-0e6b-4c88-8cd4-77adb0d083b4-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-rx62s" (UID: "1fd49c71-0e6b-4c88-8cd4-77adb0d083b4") : secret "prometheus-operator-admission-webhook-tls" not found Sep 09 23:10:31.608886 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:31.608852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1fd49c71-0e6b-4c88-8cd4-77adb0d083b4-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rx62s\" (UID: \"1fd49c71-0e6b-4c88-8cd4-77adb0d083b4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" Sep 09 23:10:31.611167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:31.611141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1fd49c71-0e6b-4c88-8cd4-77adb0d083b4-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rx62s\" (UID: \"1fd49c71-0e6b-4c88-8cd4-77adb0d083b4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" Sep 09 23:10:31.883088 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:31.883014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" Sep 09 23:10:32.147729 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:32.147661 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s"] Sep 09 23:10:32.150696 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:32.150672 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd49c71_0e6b_4c88_8cd4_77adb0d083b4.slice/crio-5ff2a8dc808f27058a8b14ea4902555c0beccda197a2c062223c0e1616173efb WatchSource:0}: Error finding container 5ff2a8dc808f27058a8b14ea4902555c0beccda197a2c062223c0e1616173efb: Status 404 returned error can't find the container with id 5ff2a8dc808f27058a8b14ea4902555c0beccda197a2c062223c0e1616173efb Sep 09 23:10:32.543037 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:32.542997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" event={"ID":"1fd49c71-0e6b-4c88-8cd4-77adb0d083b4","Type":"ContainerStarted","Data":"5ff2a8dc808f27058a8b14ea4902555c0beccda197a2c062223c0e1616173efb"} Sep 09 23:10:32.818005 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:32.817926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:10:32.820741 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:32.820711 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:10:32.831756 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:32.831729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4d06d57-79a6-4bb2-8d2f-250f618ebb80-original-pull-secret\") pod \"global-pull-secret-syncer-72rtw\" (UID: \"d4d06d57-79a6-4bb2-8d2f-250f618ebb80\") " pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:10:32.919063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:32.919030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:10:32.922076 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:32.922048 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:10:32.932487 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:32.932464 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd-metrics-certs\") pod \"network-metrics-daemon-nb2kz\" (UID: \"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd\") " pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:10:33.007418 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.007391 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2q2rs\"" Sep 09 23:10:33.015349 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.015320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nb2kz" Sep 09 23:10:33.019727 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.019702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:10:33.021941 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.021925 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:10:33.032744 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.032726 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:10:33.044347 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.044328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gww26\" (UniqueName: \"kubernetes.io/projected/f49e289a-4fe4-4387-af22-9df77fba7748-kube-api-access-gww26\") pod \"network-check-target-j6wvw\" (UID: \"f49e289a-4fe4-4387-af22-9df77fba7748\") " pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:10:33.098386 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.098288 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-72rtw" Sep 09 23:10:33.104622 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.104597 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92n2q\"" Sep 09 23:10:33.112280 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.112261 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:10:33.299976 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.299940 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nb2kz"] Sep 09 23:10:33.376843 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.376759 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-72rtw"] Sep 09 23:10:33.459982 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:33.459950 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64d71a3_b97d_4e4f_aa4b_706d27e1c5cd.slice/crio-b3b55a047b1369c0d5b9af46d6a279f4d61821b8274a5e95cef32822ccfbfbd2 WatchSource:0}: Error finding container b3b55a047b1369c0d5b9af46d6a279f4d61821b8274a5e95cef32822ccfbfbd2: Status 404 returned error can't find the container with id b3b55a047b1369c0d5b9af46d6a279f4d61821b8274a5e95cef32822ccfbfbd2 Sep 09 23:10:33.460627 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:33.460601 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d06d57_79a6_4bb2_8d2f_250f618ebb80.slice/crio-152e6ce0cdb7af56c2ff53edab3360efb508db82a94486139178f7457c5084e7 WatchSource:0}: Error finding container 152e6ce0cdb7af56c2ff53edab3360efb508db82a94486139178f7457c5084e7: Status 404 returned error can't find the container with id 152e6ce0cdb7af56c2ff53edab3360efb508db82a94486139178f7457c5084e7 Sep 09 23:10:33.546888 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.546854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-72rtw" event={"ID":"d4d06d57-79a6-4bb2-8d2f-250f618ebb80","Type":"ContainerStarted","Data":"152e6ce0cdb7af56c2ff53edab3360efb508db82a94486139178f7457c5084e7"} Sep 09 23:10:33.548003 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.547979 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb2kz" event={"ID":"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd","Type":"ContainerStarted","Data":"b3b55a047b1369c0d5b9af46d6a279f4d61821b8274a5e95cef32822ccfbfbd2"} Sep 09 23:10:33.721742 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:33.721714 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j6wvw"] Sep 09 23:10:33.774957 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:33.774930 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49e289a_4fe4_4387_af22_9df77fba7748.slice/crio-772b2f6f81c39aa154ccbe589a4f07a16777f4f066821e89c7dffc3923440ce2 WatchSource:0}: Error finding container 772b2f6f81c39aa154ccbe589a4f07a16777f4f066821e89c7dffc3923440ce2: Status 404 returned error can't find the container with id 772b2f6f81c39aa154ccbe589a4f07a16777f4f066821e89c7dffc3923440ce2 Sep 09 23:10:34.329383 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.329336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:34.332214 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.332137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abb64122-db22-40f5-834b-03a0d4cdfe79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjmfv\" (UID: \"abb64122-db22-40f5-834b-03a0d4cdfe79\") " pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:34.553286 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.553232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j6wvw" event={"ID":"f49e289a-4fe4-4387-af22-9df77fba7748","Type":"ContainerStarted","Data":"772b2f6f81c39aa154ccbe589a4f07a16777f4f066821e89c7dffc3923440ce2"} Sep 09 23:10:34.555093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.555064 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" event={"ID":"1fd49c71-0e6b-4c88-8cd4-77adb0d083b4","Type":"ContainerStarted","Data":"ed881925dd8aac787a38194aa312f700b44bcd8c5a058af7473615e6fdcfcefb"} Sep 09 23:10:34.555371 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.555351 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" Sep 09 23:10:34.561688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.561668 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" Sep 09 23:10:34.567241 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.567219 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zrvp\"" Sep 09 23:10:34.571298 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.571250 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rx62s" podStartSLOduration=2.922673987 podStartE2EDuration="4.571230984s" totalImagesPullingTime="1.648556997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:34.570081731 +0000 UTC m=+67.902157024" watchObservedRunningTime="2026-09-09 23:10:34.571230984 +0000 UTC m=+67.903306277" Sep 09 23:10:34.575635 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:34.575453 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kjmfv" Sep 09 23:10:35.026733 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.026221 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wbzrg"] Sep 09 23:10:35.028740 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.028716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.031187 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.031164 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:10:35.031397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.031384 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 09 23:10:35.031573 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.031556 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:10:35.032058 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.031995 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 09 23:10:35.032058 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.032040 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:10:35.032842 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.032822 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9drl8\"" Sep 09 23:10:35.038407 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.038362 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wbzrg"] Sep 09 23:10:35.066163 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.066038 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kjmfv"] Sep 09 23:10:35.069388 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:35.069359 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb64122_db22_40f5_834b_03a0d4cdfe79.slice/crio-798ccdf52a4ed4b7a23afa16039290cb7425811869dd73e04ea9216df7be81e0 WatchSource:0}: Error finding container 798ccdf52a4ed4b7a23afa16039290cb7425811869dd73e04ea9216df7be81e0: Status 404 returned error can't find the container with id 798ccdf52a4ed4b7a23afa16039290cb7425811869dd73e04ea9216df7be81e0 Sep 09 23:10:35.137039 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.137012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhft6\" (UniqueName: \"kubernetes.io/projected/58fc35e7-b32a-440b-9e3f-8e3dd754a161-kube-api-access-dhft6\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.137155 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.137061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58fc35e7-b32a-440b-9e3f-8e3dd754a161-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.137155 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.137129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.137280 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.137172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.238358 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.238298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhft6\" (UniqueName: \"kubernetes.io/projected/58fc35e7-b32a-440b-9e3f-8e3dd754a161-kube-api-access-dhft6\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.238549 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.238371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58fc35e7-b32a-440b-9e3f-8e3dd754a161-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.238549 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.238413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.238549 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.238441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.238725 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:35.238622 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 09 23:10:35.238725 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:35.238681 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-tls podName:58fc35e7-b32a-440b-9e3f-8e3dd754a161 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:35.73866405 +0000 UTC m=+69.070739339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-wbzrg" (UID: "58fc35e7-b32a-440b-9e3f-8e3dd754a161") : secret "prometheus-operator-tls" not found Sep 09 23:10:35.239230 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.239202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58fc35e7-b32a-440b-9e3f-8e3dd754a161-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.242082 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.242044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.248604 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.248577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhft6\" (UniqueName: \"kubernetes.io/projected/58fc35e7-b32a-440b-9e3f-8e3dd754a161-kube-api-access-dhft6\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.561702 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.561662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb2kz" event={"ID":"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd","Type":"ContainerStarted","Data":"edb7d7eb528e079b2db38447ed4fe3f942c6767b2b6df5385d311cf2306db7bd"} Sep 09 23:10:35.562081 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.561729 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nb2kz" event={"ID":"a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd","Type":"ContainerStarted","Data":"00a0c17ca265780d9705cecc0d2de93d211abbc7ec9738d5a232233b6b3b3c23"} Sep 09 23:10:35.563722 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.563684 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjmfv" event={"ID":"abb64122-db22-40f5-834b-03a0d4cdfe79","Type":"ContainerStarted","Data":"67abcd26bb5848ff2ad7f40ee08b997368c426f36d53bc2a4530b086541a2cea"} Sep 09 23:10:35.563851 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.563754 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjmfv" event={"ID":"abb64122-db22-40f5-834b-03a0d4cdfe79","Type":"ContainerStarted","Data":"798ccdf52a4ed4b7a23afa16039290cb7425811869dd73e04ea9216df7be81e0"} Sep 09 23:10:35.579651 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.579594 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nb2kz" podStartSLOduration=66.222788044 podStartE2EDuration="1m7.57957448s" totalImagesPullingTime="1.356786436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:35.578009614 +0000 UTC m=+68.910084907" watchObservedRunningTime="2026-09-09 23:10:35.57957448 +0000 UTC m=+68.911649774" Sep 09 23:10:35.742036 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.741993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.744882 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.744853 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/58fc35e7-b32a-440b-9e3f-8e3dd754a161-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wbzrg\" (UID: \"58fc35e7-b32a-440b-9e3f-8e3dd754a161\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:35.945737 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:35.945638 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" Sep 09 23:10:36.317813 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:36.317757 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wbzrg"] Sep 09 23:10:36.320067 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:36.320040 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fc35e7_b32a_440b_9e3f_8e3dd754a161.slice/crio-b059487d1218e9ab02f48ddc5e5c34e9e4dce2c80633551d178ab7a2183c34e5 WatchSource:0}: Error finding container b059487d1218e9ab02f48ddc5e5c34e9e4dce2c80633551d178ab7a2183c34e5: Status 404 returned error can't find the container with id b059487d1218e9ab02f48ddc5e5c34e9e4dce2c80633551d178ab7a2183c34e5 Sep 09 23:10:36.571163 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:36.571081 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjmfv" event={"ID":"abb64122-db22-40f5-834b-03a0d4cdfe79","Type":"ContainerStarted","Data":"2f20656f36298d367924f5173e893c4017fd455d669f1ae8dafc543e9ec270bd"} Sep 09 23:10:36.572791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:36.572755 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" event={"ID":"58fc35e7-b32a-440b-9e3f-8e3dd754a161","Type":"ContainerStarted","Data":"b059487d1218e9ab02f48ddc5e5c34e9e4dce2c80633551d178ab7a2183c34e5"} Sep 09 23:10:39.585234 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:39.585184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j6wvw" event={"ID":"f49e289a-4fe4-4387-af22-9df77fba7748","Type":"ContainerStarted","Data":"d1f74e38d7e11cf55e536f763937586239384af9f0d54ecefe53037bc8641cb0"} Sep 09 23:10:39.585725 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:39.585297 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:10:39.586982 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:39.586957 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-72rtw" event={"ID":"d4d06d57-79a6-4bb2-8d2f-250f618ebb80","Type":"ContainerStarted","Data":"cdbd190cb1f4261fc536d9271f4c82c5ae49378ad12a51dd85735a1e460b0b80"} Sep 09 23:10:39.613966 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:39.613926 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j6wvw" podStartSLOduration=66.620120574 podStartE2EDuration="1m11.613908453s" totalImagesPullingTime="4.993787879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:39.613438217 +0000 UTC m=+72.945513512" watchObservedRunningTime="2026-09-09 23:10:39.613908453 +0000 UTC m=+72.945983745" Sep 09 23:10:40.593107 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:40.593078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjmfv" event={"ID":"abb64122-db22-40f5-834b-03a0d4cdfe79","Type":"ContainerStarted","Data":"7113ad8c07a3933ef5a9457c57ce33d3aabee99336c00352d924810d9ad4e3ac"} Sep 09 23:10:40.594679 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:40.594652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" event={"ID":"58fc35e7-b32a-440b-9e3f-8e3dd754a161","Type":"ContainerStarted","Data":"caaf9442d58e951f60b1c9a3d57ab45ad074886aed33d98b01e3ff78207c15b8"} Sep 09 23:10:40.612323 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:40.612271 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kjmfv" podStartSLOduration=33.408646577 podStartE2EDuration="38.612257374s" totalImagesPullingTime="5.203610797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:10:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:40.61101902 +0000 UTC m=+73.943094324" watchObservedRunningTime="2026-09-09 23:10:40.612257374 +0000 UTC m=+73.944332666" Sep 09 23:10:40.612424 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:40.612388 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-72rtw" podStartSLOduration=67.283276936 podStartE2EDuration="1m12.612381966s" totalImagesPullingTime="5.32910503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:39.645023199 +0000 UTC m=+72.977098494" watchObservedRunningTime="2026-09-09 23:10:40.612381966 +0000 UTC m=+73.944457254" Sep 09 23:10:41.600385 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:41.600340 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" event={"ID":"58fc35e7-b32a-440b-9e3f-8e3dd754a161","Type":"ContainerStarted","Data":"7d77263eb0572bbeb6615afcde94ae4404aa5aa36d7a48a953d6ec2bdd34ab94"} Sep 09 23:10:41.618924 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:41.618861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-wbzrg" podStartSLOduration=2.532397402 podStartE2EDuration="6.618839433s" totalImagesPullingTime="4.086442031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:41.617957911 +0000 UTC m=+74.950033202" watchObservedRunningTime="2026-09-09 23:10:41.618839433 +0000 UTC m=+74.950914725" Sep 09 23:10:43.399372 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.399335 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb"] Sep 09 23:10:43.402119 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.402100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.404572 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.404523 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-696kc\"" Sep 09 23:10:43.405082 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.404918 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 23:10:43.408168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.408146 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 23:10:43.417203 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.417181 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb"] Sep 09 23:10:43.447530 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.447495 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-64c7x"] Sep 09 23:10:43.449930 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.449907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.453453 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.453433 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:10:43.453701 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.453676 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:10:43.453812 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.453795 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:10:43.454374 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.454352 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6cvrn\"" Sep 09 23:10:43.496401 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-sys\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.496498 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-wtmp\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.496498 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-accelerators-collector-config\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.496498 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-tls\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.496653 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88mxc\" (UniqueName: \"kubernetes.io/projected/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-kube-api-access-88mxc\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.496653 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzm8s\" (UniqueName: \"kubernetes.io/projected/e1709014-06ad-4db8-9847-5371b785bac2-kube-api-access-zzm8s\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.496653 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.496799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-root\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.496799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1709014-06ad-4db8-9847-5371b785bac2-metrics-client-ca\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.496799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.496799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.496799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-textfile\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.497041 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.496804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.597799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-sys\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.597907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-wtmp\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.597907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-accelerators-collector-config\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.597907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-tls\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.597907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88mxc\" (UniqueName: \"kubernetes.io/projected/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-kube-api-access-88mxc\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.597907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzm8s\" (UniqueName: \"kubernetes.io/projected/e1709014-06ad-4db8-9847-5371b785bac2-kube-api-access-zzm8s\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.597907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597893 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-sys\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.597907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.598305 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-root\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.598305 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.597985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1709014-06ad-4db8-9847-5371b785bac2-metrics-client-ca\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.598305 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.598015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.598305 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.598041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.598305 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.598072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-textfile\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.598305 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.598099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.598608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.598439 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-accelerators-collector-config\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.598608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.598527 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.598608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.598577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-wtmp\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.598841 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.598824 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e1709014-06ad-4db8-9847-5371b785bac2-root\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.599016 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:43.598996 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 23:10:43.599195 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:43.599183 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-tls podName:e1709014-06ad-4db8-9847-5371b785bac2 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:44.099162319 +0000 UTC m=+77.431237594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-tls") pod "node-exporter-64c7x" (UID: "e1709014-06ad-4db8-9847-5371b785bac2") : secret "node-exporter-tls" not found Sep 09 23:10:43.599276 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.599199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-textfile\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.599385 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.599278 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1709014-06ad-4db8-9847-5371b785bac2-metrics-client-ca\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.600913 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.600892 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.601105 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.601085 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.601694 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.601675 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.610834 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.610683 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzm8s\" (UniqueName: \"kubernetes.io/projected/e1709014-06ad-4db8-9847-5371b785bac2-kube-api-access-zzm8s\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:43.610834 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.610805 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88mxc\" (UniqueName: \"kubernetes.io/projected/c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96-kube-api-access-88mxc\") pod \"openshift-state-metrics-657fd6c54-wbhjb\" (UID: \"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.713488 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.713439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" Sep 09 23:10:43.987659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:43.987633 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb"] Sep 09 23:10:43.990456 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:43.990413 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b6b22f_0af5_4f88_98a4_d1fd7ec8cb96.slice/crio-0751933786ee8f1520532d6681221315319053a0ba11bf1e12c07f0ae340268d WatchSource:0}: Error finding container 0751933786ee8f1520532d6681221315319053a0ba11bf1e12c07f0ae340268d: Status 404 returned error can't find the container with id 0751933786ee8f1520532d6681221315319053a0ba11bf1e12c07f0ae340268d Sep 09 23:10:44.102240 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.102216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-tls\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:44.104178 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.104155 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e1709014-06ad-4db8-9847-5371b785bac2-node-exporter-tls\") pod \"node-exporter-64c7x\" (UID: \"e1709014-06ad-4db8-9847-5371b785bac2\") " pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:44.361917 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.361836 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-64c7x" Sep 09 23:10:44.373320 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:44.373279 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1709014_06ad_4db8_9847_5371b785bac2.slice/crio-1a42d4211a8a8defce7178a65e530b122a809ac24ecd5b8322fdfea4957d006b WatchSource:0}: Error finding container 1a42d4211a8a8defce7178a65e530b122a809ac24ecd5b8322fdfea4957d006b: Status 404 returned error can't find the container with id 1a42d4211a8a8defce7178a65e530b122a809ac24ecd5b8322fdfea4957d006b Sep 09 23:10:44.512246 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.512214 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:10:44.515369 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.515351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.521343 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.521303 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:10:44.521488 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.521388 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:10:44.521488 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.521436 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:10:44.521488 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.521462 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:10:44.521905 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.521393 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:10:44.521905 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.521541 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:10:44.522567 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.522548 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4xv56\"" Sep 09 23:10:44.522979 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.522961 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:10:44.523481 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.523466 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:10:44.532153 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.532124 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:10:44.556714 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.556686 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-web-config\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606933 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhqv9\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-kube-api-access-zhqv9\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606933 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606933 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.606933 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.606517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-out\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.613683 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.613608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64c7x" event={"ID":"e1709014-06ad-4db8-9847-5371b785bac2","Type":"ContainerStarted","Data":"1a42d4211a8a8defce7178a65e530b122a809ac24ecd5b8322fdfea4957d006b"} Sep 09 23:10:44.615623 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.615595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" event={"ID":"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96","Type":"ContainerStarted","Data":"d1f4d6f4ac92786351b2f68b1bf6fc9125b3bba457af146e8bee8684658851ee"} Sep 09 23:10:44.615735 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.615648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" event={"ID":"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96","Type":"ContainerStarted","Data":"76d877128d5ed0381819881c56733b865e328f3fed19aa0a22286d34c579b574"} Sep 09 23:10:44.615735 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.615669 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" event={"ID":"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96","Type":"ContainerStarted","Data":"0751933786ee8f1520532d6681221315319053a0ba11bf1e12c07f0ae340268d"} Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-web-config\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhqv9\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-kube-api-access-zhqv9\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.707976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-out\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.708012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.708038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.708066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.708685 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.708096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.709260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.709008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.709548 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.709482 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.710080 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.710037 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.711799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.711771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.711991 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.711970 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-web-config\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.712123 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.712101 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-out\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.712210 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.712153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.712210 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.712158 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.712337 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.712273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.712659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.712637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.713206 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.713184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.713498 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.713482 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.719986 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.719966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhqv9\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-kube-api-access-zhqv9\") pod \"alertmanager-main-0\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:44.825175 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:44.825130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:10:45.130613 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:45.130535 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:10:45.201800 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:45.201761 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4bfe8f_1974_43ad_aa27_dd16d44ac6aa.slice/crio-5466cc03c90a1a47e5920abdee7566ef3ed0162d44cc4b8e4396da0c37302c7a WatchSource:0}: Error finding container 5466cc03c90a1a47e5920abdee7566ef3ed0162d44cc4b8e4396da0c37302c7a: Status 404 returned error can't find the container with id 5466cc03c90a1a47e5920abdee7566ef3ed0162d44cc4b8e4396da0c37302c7a Sep 09 23:10:45.620261 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:45.620226 2581 generic.go:356] "Generic (PLEG): container finished" podID="e1709014-06ad-4db8-9847-5371b785bac2" containerID="74ce6300eafe56dff59e7890be458d03565ce5a63596ddec5460fe91b6448b6a" exitCode=0 Sep 09 23:10:45.620649 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:45.620338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64c7x" event={"ID":"e1709014-06ad-4db8-9847-5371b785bac2","Type":"ContainerDied","Data":"74ce6300eafe56dff59e7890be458d03565ce5a63596ddec5460fe91b6448b6a"} Sep 09 23:10:45.622735 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:45.622699 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" event={"ID":"c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96","Type":"ContainerStarted","Data":"dfd6a90fb85d2c8f70eb473bb3498bf17a3d0026be09c36ed58fe09f0339dba0"} Sep 09 23:10:45.623952 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:45.623927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerStarted","Data":"5466cc03c90a1a47e5920abdee7566ef3ed0162d44cc4b8e4396da0c37302c7a"} Sep 09 23:10:45.663105 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:45.663062 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-wbhjb" podStartSLOduration=1.321921081 podStartE2EDuration="2.663043799s" totalImagesPullingTime="1.341122718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:45.662073671 +0000 UTC m=+78.994148963" watchObservedRunningTime="2026-09-09 23:10:45.663043799 +0000 UTC m=+78.995119090" Sep 09 23:10:46.433797 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.433760 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb"] Sep 09 23:10:46.438186 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.438151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.440978 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.440896 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 23:10:46.441221 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.441199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2791ag1414s6p\"" Sep 09 23:10:46.441297 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.441265 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 23:10:46.441561 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.441538 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 23:10:46.441675 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.441572 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 23:10:46.441778 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.441760 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m8bws\"" Sep 09 23:10:46.441917 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.441900 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 23:10:46.450828 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.450798 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb"] Sep 09 23:10:46.522479 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.522445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.522662 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.522514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-grpc-tls\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.522662 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.522596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbfkl\" (UniqueName: \"kubernetes.io/projected/58bfdd96-8989-44c7-8af4-4e54a3531185-kube-api-access-jbfkl\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.522742 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.522658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.522742 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.522689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-tls\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.522742 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.522720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.522850 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.522746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58bfdd96-8989-44c7-8af4-4e54a3531185-metrics-client-ca\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.522850 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.522799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.624037 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.624003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.624482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.624054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-grpc-tls\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.624482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.624082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfkl\" (UniqueName: \"kubernetes.io/projected/58bfdd96-8989-44c7-8af4-4e54a3531185-kube-api-access-jbfkl\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.624482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.624108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.624482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.624127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-tls\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.624482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.624157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.624482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.624175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58bfdd96-8989-44c7-8af4-4e54a3531185-metrics-client-ca\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.624482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.624203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.625065 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.625021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58bfdd96-8989-44c7-8af4-4e54a3531185-metrics-client-ca\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.627239 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.627210 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-grpc-tls\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.627377 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.627239 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.627377 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.627292 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.627470 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.627417 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-tls\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.627524 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.627469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.627524 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.627473 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58bfdd96-8989-44c7-8af4-4e54a3531185-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.632473 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.632438 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64c7x" event={"ID":"e1709014-06ad-4db8-9847-5371b785bac2","Type":"ContainerStarted","Data":"bd2abf32577f62a7c4728ecfb02dccb6ac4b23332be322a5afd2ad24e007f631"} Sep 09 23:10:46.632607 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.632501 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64c7x" event={"ID":"e1709014-06ad-4db8-9847-5371b785bac2","Type":"ContainerStarted","Data":"d4b863dc87fc8a04e0193d6211a8e9a39c71935a39d06d273313b2a4e3dc1d48"} Sep 09 23:10:46.634120 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.634094 2581 generic.go:356] "Generic (PLEG): container finished" podID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerID="d1c3b0c99ca3799de2c9ee2c3f08ef88958793c4c3e3770c69cc9b6a5a1d7182" exitCode=0 Sep 09 23:10:46.634225 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.634174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerDied","Data":"d1c3b0c99ca3799de2c9ee2c3f08ef88958793c4c3e3770c69cc9b6a5a1d7182"} Sep 09 23:10:46.634437 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.634419 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbfkl\" (UniqueName: \"kubernetes.io/projected/58bfdd96-8989-44c7-8af4-4e54a3531185-kube-api-access-jbfkl\") pod \"thanos-querier-5bc4bc6d59-k66hb\" (UID: \"58bfdd96-8989-44c7-8af4-4e54a3531185\") " pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:46.653227 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.653169 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-64c7x" podStartSLOduration=2.531241135 podStartE2EDuration="3.653149688s" totalImagesPullingTime="1.057394807s" totalInitContainerRuntime="64.513746ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:46.651800944 +0000 UTC m=+79.983876238" watchObservedRunningTime="2026-09-09 23:10:46.653149688 +0000 UTC m=+79.985224979" Sep 09 23:10:46.753493 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:46.753450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:47.042127 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.042046 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb"] Sep 09 23:10:47.045497 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:47.045464 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bfdd96_8989_44c7_8af4_4e54a3531185.slice/crio-8bc4fb1e770346bbf1b1f0fd4243512f1bddb0973e8bbdb9e4a75a80a1a0803f WatchSource:0}: Error finding container 8bc4fb1e770346bbf1b1f0fd4243512f1bddb0973e8bbdb9e4a75a80a1a0803f: Status 404 returned error can't find the container with id 8bc4fb1e770346bbf1b1f0fd4243512f1bddb0973e8bbdb9e4a75a80a1a0803f Sep 09 23:10:47.639234 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.639202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" event={"ID":"58bfdd96-8989-44c7-8af4-4e54a3531185","Type":"ContainerStarted","Data":"8bc4fb1e770346bbf1b1f0fd4243512f1bddb0973e8bbdb9e4a75a80a1a0803f"} Sep 09 23:10:47.931673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.931593 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk"] Sep 09 23:10:47.934998 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.934970 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:47.938994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.938969 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 23:10:47.939858 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.939689 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dn855\"" Sep 09 23:10:47.939858 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.939698 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:10:47.939858 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.939746 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 23:10:47.939858 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.939760 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 23:10:47.940454 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.940433 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7hsi0ca49083s\"" Sep 09 23:10:47.949411 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:47.949387 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk"] Sep 09 23:10:48.036897 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.036860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-client-ca-bundle\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.036897 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.036911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88026525-de91-4288-b5fa-663370e634e2-audit-log\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.037129 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.036977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-secret-metrics-server-client-certs\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.037129 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.037034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-secret-metrics-server-tls\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.037129 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.037094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88026525-de91-4288-b5fa-663370e634e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.037129 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.037119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88026525-de91-4288-b5fa-663370e634e2-metrics-server-audit-profiles\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.037351 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.037144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lldv9\" (UniqueName: \"kubernetes.io/projected/88026525-de91-4288-b5fa-663370e634e2-kube-api-access-lldv9\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.138369 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.138332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88026525-de91-4288-b5fa-663370e634e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.138369 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.138368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88026525-de91-4288-b5fa-663370e634e2-metrics-server-audit-profiles\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.138581 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.138389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lldv9\" (UniqueName: \"kubernetes.io/projected/88026525-de91-4288-b5fa-663370e634e2-kube-api-access-lldv9\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.138581 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.138484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-client-ca-bundle\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.138697 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.138607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88026525-de91-4288-b5fa-663370e634e2-audit-log\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.138697 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.138665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-secret-metrics-server-client-certs\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.138807 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.138713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-secret-metrics-server-tls\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.139189 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.139164 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88026525-de91-4288-b5fa-663370e634e2-audit-log\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.139797 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.139744 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88026525-de91-4288-b5fa-663370e634e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.141442 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.141391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88026525-de91-4288-b5fa-663370e634e2-metrics-server-audit-profiles\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.148685 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.148661 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lldv9\" (UniqueName: \"kubernetes.io/projected/88026525-de91-4288-b5fa-663370e634e2-kube-api-access-lldv9\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.149348 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.149276 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-client-ca-bundle\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.149451 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.149404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-secret-metrics-server-tls\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.157141 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.155455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88026525-de91-4288-b5fa-663370e634e2-secret-metrics-server-client-certs\") pod \"metrics-server-56d7bcfcf8-9mnlk\" (UID: \"88026525-de91-4288-b5fa-663370e634e2\") " pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.184094 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.183869 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd"] Sep 09 23:10:48.188986 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.188944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:48.191445 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.191210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-79rsb\"" Sep 09 23:10:48.191445 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.191212 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 09 23:10:48.199357 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.199274 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd"] Sep 09 23:10:48.239660 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.239629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15123462-5864-4a1b-898b-fbe1bc22fb18-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8q5hd\" (UID: \"15123462-5864-4a1b-898b-fbe1bc22fb18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:48.239792 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.239680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl5m7\" (UniqueName: \"kubernetes.io/projected/15123462-5864-4a1b-898b-fbe1bc22fb18-kube-api-access-rl5m7\") pod \"monitoring-plugin-85bbbbbf4-8q5hd\" (UID: \"15123462-5864-4a1b-898b-fbe1bc22fb18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:48.250584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.250561 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:10:48.340753 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.340728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl5m7\" (UniqueName: \"kubernetes.io/projected/15123462-5864-4a1b-898b-fbe1bc22fb18-kube-api-access-rl5m7\") pod \"monitoring-plugin-85bbbbbf4-8q5hd\" (UID: \"15123462-5864-4a1b-898b-fbe1bc22fb18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:48.340886 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.340831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15123462-5864-4a1b-898b-fbe1bc22fb18-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8q5hd\" (UID: \"15123462-5864-4a1b-898b-fbe1bc22fb18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:48.340969 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:48.340953 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 09 23:10:48.341034 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:10:48.341022 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15123462-5864-4a1b-898b-fbe1bc22fb18-monitoring-plugin-cert podName:15123462-5864-4a1b-898b-fbe1bc22fb18 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:48.841002152 +0000 UTC m=+82.173077435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/15123462-5864-4a1b-898b-fbe1bc22fb18-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-8q5hd" (UID: "15123462-5864-4a1b-898b-fbe1bc22fb18") : secret "monitoring-plugin-cert" not found Sep 09 23:10:48.355945 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.355920 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl5m7\" (UniqueName: \"kubernetes.io/projected/15123462-5864-4a1b-898b-fbe1bc22fb18-kube-api-access-rl5m7\") pod \"monitoring-plugin-85bbbbbf4-8q5hd\" (UID: \"15123462-5864-4a1b-898b-fbe1bc22fb18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:48.531557 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.531531 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-859f49dc7c-bkhhr" Sep 09 23:10:48.670872 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.670839 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68bf5d6565-wvgm8"] Sep 09 23:10:48.674502 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.674479 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.676606 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.676579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 09 23:10:48.676606 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.676579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4qfkw\"" Sep 09 23:10:48.676982 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.676949 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 09 23:10:48.677574 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.677554 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 09 23:10:48.677666 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.677613 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 09 23:10:48.677666 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.677653 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 09 23:10:48.684380 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.684357 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 09 23:10:48.692754 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.692733 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68bf5d6565-wvgm8"] Sep 09 23:10:48.744756 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.744730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-federate-client-tls\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.744887 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.744770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.744887 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.744840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7gpv\" (UniqueName: \"kubernetes.io/projected/0e4095a1-b63b-43b3-bcc2-112fb7976c07-kube-api-access-d7gpv\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.744887 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.744869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-serving-certs-ca-bundle\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.745044 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.744944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.745044 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.744978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-metrics-client-ca\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.745044 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.745005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-secret-telemeter-client\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.745187 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.745044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-telemeter-client-tls\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.845613 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.845557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-federate-client-tls\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.845613 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.845597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.845778 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.845657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7gpv\" (UniqueName: \"kubernetes.io/projected/0e4095a1-b63b-43b3-bcc2-112fb7976c07-kube-api-access-d7gpv\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.845778 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.845681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-serving-certs-ca-bundle\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.845778 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.845718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15123462-5864-4a1b-898b-fbe1bc22fb18-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8q5hd\" (UID: \"15123462-5864-4a1b-898b-fbe1bc22fb18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:48.846075 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.846042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.846197 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.846082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-metrics-client-ca\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.846197 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.846127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-secret-telemeter-client\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.846197 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.846179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-telemeter-client-tls\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.846525 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.846480 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-serving-certs-ca-bundle\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.846622 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.846605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.847199 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.847119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e4095a1-b63b-43b3-bcc2-112fb7976c07-metrics-client-ca\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.848677 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.848644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15123462-5864-4a1b-898b-fbe1bc22fb18-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-8q5hd\" (UID: \"15123462-5864-4a1b-898b-fbe1bc22fb18\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:48.848767 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.848696 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.848896 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.848875 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-federate-client-tls\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.848950 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.848929 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-telemeter-client-tls\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.849143 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.849122 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0e4095a1-b63b-43b3-bcc2-112fb7976c07-secret-telemeter-client\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.855244 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.855224 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7gpv\" (UniqueName: \"kubernetes.io/projected/0e4095a1-b63b-43b3-bcc2-112fb7976c07-kube-api-access-d7gpv\") pod \"telemeter-client-68bf5d6565-wvgm8\" (UID: \"0e4095a1-b63b-43b3-bcc2-112fb7976c07\") " pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:48.862405 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.862382 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-p6946"] Sep 09 23:10:48.867062 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.867023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-p6946" Sep 09 23:10:48.869220 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.869196 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h5q42\"" Sep 09 23:10:48.869341 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.869242 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 23:10:48.869540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.869523 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 23:10:48.874502 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.874479 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-p6946"] Sep 09 23:10:48.946958 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.946924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7xpj\" (UniqueName: \"kubernetes.io/projected/5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce-kube-api-access-j7xpj\") pod \"downloads-85d98c998f-p6946\" (UID: \"5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce\") " pod="openshift-console/downloads-85d98c998f-p6946" Sep 09 23:10:48.986071 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:48.986045 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" Sep 09 23:10:49.047353 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.047296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7xpj\" (UniqueName: \"kubernetes.io/projected/5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce-kube-api-access-j7xpj\") pod \"downloads-85d98c998f-p6946\" (UID: \"5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce\") " pod="openshift-console/downloads-85d98c998f-p6946" Sep 09 23:10:49.057924 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.057896 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7xpj\" (UniqueName: \"kubernetes.io/projected/5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce-kube-api-access-j7xpj\") pod \"downloads-85d98c998f-p6946\" (UID: \"5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce\") " pod="openshift-console/downloads-85d98c998f-p6946" Sep 09 23:10:49.101459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.101432 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:49.178454 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.178423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-p6946" Sep 09 23:10:49.280755 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.280718 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk"] Sep 09 23:10:49.287846 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:49.287809 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88026525_de91_4288_b5fa_663370e634e2.slice/crio-56ea0e64d3113a091c7b47361cb3fc14e70e96a146e810e139d5272a6f2af563 WatchSource:0}: Error finding container 56ea0e64d3113a091c7b47361cb3fc14e70e96a146e810e139d5272a6f2af563: Status 404 returned error can't find the container with id 56ea0e64d3113a091c7b47361cb3fc14e70e96a146e810e139d5272a6f2af563 Sep 09 23:10:49.303753 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.303665 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68bf5d6565-wvgm8"] Sep 09 23:10:49.306986 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:49.306960 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4095a1_b63b_43b3_bcc2_112fb7976c07.slice/crio-c703a337b9a51d1cb445a36d16bf5c00036ebb1cf651d8981ebce317af11d1fb WatchSource:0}: Error finding container c703a337b9a51d1cb445a36d16bf5c00036ebb1cf651d8981ebce317af11d1fb: Status 404 returned error can't find the container with id c703a337b9a51d1cb445a36d16bf5c00036ebb1cf651d8981ebce317af11d1fb Sep 09 23:10:49.391540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.391506 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd"] Sep 09 23:10:49.394275 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:49.394244 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15123462_5864_4a1b_898b_fbe1bc22fb18.slice/crio-34a4e44eb1ae0a2c7af7740472b5e7884b344de9fdd66c9af3cdc050c80233c6 WatchSource:0}: Error finding container 34a4e44eb1ae0a2c7af7740472b5e7884b344de9fdd66c9af3cdc050c80233c6: Status 404 returned error can't find the container with id 34a4e44eb1ae0a2c7af7740472b5e7884b344de9fdd66c9af3cdc050c80233c6 Sep 09 23:10:49.463057 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.463026 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-p6946"] Sep 09 23:10:49.465931 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:10:49.465908 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c80e9d0_b4e3_4a42_8bbf_5025da78e0ce.slice/crio-42b4013524345e75b47179f53c281abf25788aa216753db5d2b2e021b60ac451 WatchSource:0}: Error finding container 42b4013524345e75b47179f53c281abf25788aa216753db5d2b2e021b60ac451: Status 404 returned error can't find the container with id 42b4013524345e75b47179f53c281abf25788aa216753db5d2b2e021b60ac451 Sep 09 23:10:49.649820 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.649721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" event={"ID":"88026525-de91-4288-b5fa-663370e634e2","Type":"ContainerStarted","Data":"56ea0e64d3113a091c7b47361cb3fc14e70e96a146e810e139d5272a6f2af563"} Sep 09 23:10:49.651237 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.651207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" event={"ID":"0e4095a1-b63b-43b3-bcc2-112fb7976c07","Type":"ContainerStarted","Data":"c703a337b9a51d1cb445a36d16bf5c00036ebb1cf651d8981ebce317af11d1fb"} Sep 09 23:10:49.655189 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.655155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerStarted","Data":"fbf1c357c8c8de9c0339559e1875792f84d75b3935c5bb35f1843c9d6956a0a9"} Sep 09 23:10:49.655328 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.655227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerStarted","Data":"1c4c965ed89ab8598933463d714e619feacb25900e8eb22a2176c1b7f7c420cd"} Sep 09 23:10:49.655328 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.655269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerStarted","Data":"a7ceb791f5b89a2209b1fe94cd30bb468c75f45186d87580ea95803cef1b64a5"} Sep 09 23:10:49.655561 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.655330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerStarted","Data":"d20ae1888263ae36ccca4f4eb8bfffeb90470e27369e3dce04babb45f4ed50cf"} Sep 09 23:10:49.655561 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.655369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerStarted","Data":"fb2e4f627e9de01c951cf333e32c7778c37434642cb5731a0ab8826673bb5cc1"} Sep 09 23:10:49.658103 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.658076 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" event={"ID":"58bfdd96-8989-44c7-8af4-4e54a3531185","Type":"ContainerStarted","Data":"2cc0dba7538c628af0c07eb6ba9370511a6f2566461227d0ef6f5cb6a8a70b3d"} Sep 09 23:10:49.658232 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.658147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" event={"ID":"58bfdd96-8989-44c7-8af4-4e54a3531185","Type":"ContainerStarted","Data":"5547d20741806611af02868febba2549b993ddd9acdba7ee69254ee003646b6c"} Sep 09 23:10:49.658232 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.658195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" event={"ID":"58bfdd96-8989-44c7-8af4-4e54a3531185","Type":"ContainerStarted","Data":"540611cb756eb934c8cc2e5c3fb42e05cf1aa058a2f015d2c4f45ff4643ddbce"} Sep 09 23:10:49.659637 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.659612 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-p6946" event={"ID":"5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce","Type":"ContainerStarted","Data":"42b4013524345e75b47179f53c281abf25788aa216753db5d2b2e021b60ac451"} Sep 09 23:10:49.661156 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:49.661135 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" event={"ID":"15123462-5864-4a1b-898b-fbe1bc22fb18","Type":"ContainerStarted","Data":"34a4e44eb1ae0a2c7af7740472b5e7884b344de9fdd66c9af3cdc050c80233c6"} Sep 09 23:10:50.679766 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:50.679261 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerStarted","Data":"ae3496c4ac859d0150b40f43d85d6e83e3bb23b28aad0debb5db0f1ed3591ad2"} Sep 09 23:10:50.688562 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:50.688525 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" event={"ID":"58bfdd96-8989-44c7-8af4-4e54a3531185","Type":"ContainerStarted","Data":"2bc843041eca327cd2d5f819ad2c88ef2508d0c31f5086b641c78fab29a1c65b"} Sep 09 23:10:50.713156 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:50.712965 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.908874857 podStartE2EDuration="6.712936599s" totalImagesPullingTime="4.776607034s" totalInitContainerRuntime="27.454708ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:50.704071857 +0000 UTC m=+84.036147146" watchObservedRunningTime="2026-09-09 23:10:50.712936599 +0000 UTC m=+84.045011873" Sep 09 23:10:51.699093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:51.698907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" event={"ID":"58bfdd96-8989-44c7-8af4-4e54a3531185","Type":"ContainerStarted","Data":"7aaeefa1e4051ff195d1c4909863bab6e97791faa8df0a22e61c82bfbf031be3"} Sep 09 23:10:51.699093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:51.698992 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" event={"ID":"58bfdd96-8989-44c7-8af4-4e54a3531185","Type":"ContainerStarted","Data":"98b6dc86561de1f81cbaa67adf09f8139dd457d1c836006f6d45815d15fe233b"} Sep 09 23:10:51.726274 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:51.726047 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" podStartSLOduration=2.541103591 podStartE2EDuration="5.726027435s" totalImagesPullingTime="3.184923844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:51.723573892 +0000 UTC m=+85.055649185" watchObservedRunningTime="2026-09-09 23:10:51.726027435 +0000 UTC m=+85.058102742" Sep 09 23:10:52.706169 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.706131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" event={"ID":"88026525-de91-4288-b5fa-663370e634e2","Type":"ContainerStarted","Data":"9988afb27354f08c7e9ce1cf9098e5beb1cf96d3978aa63a38237a9aa6811dec"} Sep 09 23:10:52.709495 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.708941 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" event={"ID":"0e4095a1-b63b-43b3-bcc2-112fb7976c07","Type":"ContainerStarted","Data":"ef26235197c6b6dfceebcdaeee87dccb98a34e8e91d182451c218e186d8ab839"} Sep 09 23:10:52.709495 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.709001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" event={"ID":"0e4095a1-b63b-43b3-bcc2-112fb7976c07","Type":"ContainerStarted","Data":"54b4bda40669f36f8c23460012e3921a021cad436dc22fa57dad884553853aea"} Sep 09 23:10:52.709495 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.709032 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" event={"ID":"0e4095a1-b63b-43b3-bcc2-112fb7976c07","Type":"ContainerStarted","Data":"89fc94aed06bc9be2b0fe3292ab6d92fa013d9559db86d46a54558bb51a980f9"} Sep 09 23:10:52.710744 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.710716 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" event={"ID":"15123462-5864-4a1b-898b-fbe1bc22fb18","Type":"ContainerStarted","Data":"179821fa63d2b0eb037d485a712134b5bf8aea760896005f23f6c37045ff7faf"} Sep 09 23:10:52.711027 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.711012 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:52.711130 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.711042 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:10:52.717068 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.717045 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" Sep 09 23:10:52.725727 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.725683 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" podStartSLOduration=2.652690197 podStartE2EDuration="5.725665356s" totalImagesPullingTime="3.072975159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:52.723883885 +0000 UTC m=+86.055959176" watchObservedRunningTime="2026-09-09 23:10:52.725665356 +0000 UTC m=+86.057740651" Sep 09 23:10:52.740463 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.740424 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-8q5hd" podStartSLOduration=1.7728043759999998 podStartE2EDuration="4.740405892s" totalImagesPullingTime="2.967601516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:52.74038847 +0000 UTC m=+86.072463762" watchObservedRunningTime="2026-09-09 23:10:52.740405892 +0000 UTC m=+86.072481190" Sep 09 23:10:52.768941 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:52.768867 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68bf5d6565-wvgm8" podStartSLOduration=1.7083314 podStartE2EDuration="4.768848992s" totalImagesPullingTime="3.060517592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:52.76672492 +0000 UTC m=+86.098800206" watchObservedRunningTime="2026-09-09 23:10:52.768848992 +0000 UTC m=+86.100924282" Sep 09 23:10:58.723786 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:10:58.723741 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bc4bc6d59-k66hb" Sep 09 23:11:02.180368 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.180330 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75447bf4d4-wqnpn"] Sep 09 23:11:02.185053 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.185032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.187919 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.187893 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 23:11:02.188614 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.188586 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 23:11:02.188614 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.188601 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 23:11:02.188773 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.188633 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 23:11:02.188773 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.188586 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 23:11:02.188773 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.188680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-97wqv\"" Sep 09 23:11:02.201357 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.201331 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75447bf4d4-wqnpn"] Sep 09 23:11:02.285993 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.285963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-serving-cert\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.286140 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.286014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-oauth-config\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.286140 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.286126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-service-ca\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.286239 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.286171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7p7x\" (UniqueName: \"kubernetes.io/projected/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-kube-api-access-n7p7x\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.286239 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.286230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-oauth-serving-cert\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.286340 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.286257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-config\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.387431 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.387403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-serving-cert\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.387584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.387448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-oauth-config\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.387584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.387501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-service-ca\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.387584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.387536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7p7x\" (UniqueName: \"kubernetes.io/projected/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-kube-api-access-n7p7x\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.387584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.387573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-oauth-serving-cert\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.387790 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.387596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-config\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.388301 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.388274 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-config\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.388619 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.388593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-oauth-serving-cert\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.388700 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.388632 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-service-ca\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.390233 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.390163 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-serving-cert\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.390374 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.390351 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-oauth-config\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.396550 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.396528 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7p7x\" (UniqueName: \"kubernetes.io/projected/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-kube-api-access-n7p7x\") pod \"console-75447bf4d4-wqnpn\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:02.495738 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:02.495707 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:07.158147 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:07.158113 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75447bf4d4-wqnpn"] Sep 09 23:11:07.180487 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:11:07.180459 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b68bfcd_3b3b_40b8_84c5_c68a15ddb39c.slice/crio-d77020fbdfa2f4a9acd028b6e29d8f851de859a781b7fc71a86ba991342bafac WatchSource:0}: Error finding container d77020fbdfa2f4a9acd028b6e29d8f851de859a781b7fc71a86ba991342bafac: Status 404 returned error can't find the container with id d77020fbdfa2f4a9acd028b6e29d8f851de859a781b7fc71a86ba991342bafac Sep 09 23:11:07.788961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:07.788913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-p6946" event={"ID":"5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce","Type":"ContainerStarted","Data":"b1e81b7d3613cb0f2897bb25594d79612e4928ab67df9cc0d03aec5e946713e0"} Sep 09 23:11:07.789241 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:07.788994 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-p6946" Sep 09 23:11:07.790797 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:07.790768 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75447bf4d4-wqnpn" event={"ID":"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c","Type":"ContainerStarted","Data":"d77020fbdfa2f4a9acd028b6e29d8f851de859a781b7fc71a86ba991342bafac"} Sep 09 23:11:07.796012 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:07.795988 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-p6946" Sep 09 23:11:07.814639 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:07.814585 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-p6946" podStartSLOduration=2.035277224 podStartE2EDuration="19.814569514s" totalImagesPullingTime="17.77929229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:07.813199976 +0000 UTC m=+101.145275267" watchObservedRunningTime="2026-09-09 23:11:07.814569514 +0000 UTC m=+101.146644805" Sep 09 23:11:08.251426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:08.251386 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:11:08.251842 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:08.251465 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:11:10.598183 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:10.598147 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j6wvw" Sep 09 23:11:10.969366 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:10.969334 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6469f4dc-4cz25"] Sep 09 23:11:10.988506 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:10.988468 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6469f4dc-4cz25"] Sep 09 23:11:10.988678 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:10.988608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:10.996385 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:10.996360 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 23:11:11.166441 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.166409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-oauth-config\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.166547 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.166460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-trusted-ca-bundle\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.166547 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.166523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-oauth-serving-cert\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.166636 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.166596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-serving-cert\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.166688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.166631 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-config\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.166688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.166677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-service-ca\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.166792 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.166755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s58xm\" (UniqueName: \"kubernetes.io/projected/c65151dc-3ca7-4a01-ae1e-9da462400ee9-kube-api-access-s58xm\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.267406 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.267374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-service-ca\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.267592 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.267445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s58xm\" (UniqueName: \"kubernetes.io/projected/c65151dc-3ca7-4a01-ae1e-9da462400ee9-kube-api-access-s58xm\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.267592 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.267478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-oauth-config\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.267592 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.267505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-trusted-ca-bundle\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.267592 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.267535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-oauth-serving-cert\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.267592 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.267581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-serving-cert\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.267861 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.267602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-config\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.268400 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.268211 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-service-ca\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.268400 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.268335 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-config\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.268572 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.268489 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-oauth-serving-cert\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.269126 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.269103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-trusted-ca-bundle\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.270397 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.270377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-oauth-config\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.270580 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.270546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-serving-cert\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.276858 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.276828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s58xm\" (UniqueName: \"kubernetes.io/projected/c65151dc-3ca7-4a01-ae1e-9da462400ee9-kube-api-access-s58xm\") pod \"console-c6469f4dc-4cz25\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.300787 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.300755 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:11.612839 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.612812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6469f4dc-4cz25"] Sep 09 23:11:11.615800 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:11:11.615765 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65151dc_3ca7_4a01_ae1e_9da462400ee9.slice/crio-8666fb28077707e24ccfde530f0acd91a0ae83632e36ad7689f9e97062f0d2a8 WatchSource:0}: Error finding container 8666fb28077707e24ccfde530f0acd91a0ae83632e36ad7689f9e97062f0d2a8: Status 404 returned error can't find the container with id 8666fb28077707e24ccfde530f0acd91a0ae83632e36ad7689f9e97062f0d2a8 Sep 09 23:11:11.814275 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.814229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75447bf4d4-wqnpn" event={"ID":"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c","Type":"ContainerStarted","Data":"0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293"} Sep 09 23:11:11.816270 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.816246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6469f4dc-4cz25" event={"ID":"c65151dc-3ca7-4a01-ae1e-9da462400ee9","Type":"ContainerStarted","Data":"cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df"} Sep 09 23:11:11.816414 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.816289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6469f4dc-4cz25" event={"ID":"c65151dc-3ca7-4a01-ae1e-9da462400ee9","Type":"ContainerStarted","Data":"8666fb28077707e24ccfde530f0acd91a0ae83632e36ad7689f9e97062f0d2a8"} Sep 09 23:11:11.833151 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.833089 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75447bf4d4-wqnpn" podStartSLOduration=5.868124648 podStartE2EDuration="9.83306973s" totalImagesPullingTime="3.964945082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:11.832856491 +0000 UTC m=+105.164931783" watchObservedRunningTime="2026-09-09 23:11:11.83306973 +0000 UTC m=+105.165145018" Sep 09 23:11:11.851602 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:11.851541 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6469f4dc-4cz25" podStartSLOduration=1.851517239 podStartE2EDuration="1.851517239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:11.850490877 +0000 UTC m=+105.182566169" watchObservedRunningTime="2026-09-09 23:11:11.851517239 +0000 UTC m=+105.183592532" Sep 09 23:11:12.496438 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:12.496400 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:12.496643 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:12.496569 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:12.503081 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:12.503054 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:12.826113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:12.825996 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:21.301930 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:21.301889 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:21.302521 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:21.301950 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:21.306768 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:21.306747 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:21.862141 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:21.862115 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:11:21.910702 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:21.910669 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75447bf4d4-wqnpn"] Sep 09 23:11:28.256584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:28.256552 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:11:28.260407 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:28.260385 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56d7bcfcf8-9mnlk" Sep 09 23:11:46.930253 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:46.930188 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75447bf4d4-wqnpn" podUID="0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" containerName="console" containerID="cri-o://0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293" gracePeriod=15 Sep 09 23:11:47.220059 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.220030 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:47.340636 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.340600 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-serving-cert\") pod \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " Sep 09 23:11:47.340888 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.340868 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-oauth-config\") pod \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " Sep 09 23:11:47.341024 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.341008 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-service-ca\") pod \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " Sep 09 23:11:47.341147 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.341129 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-oauth-serving-cert\") pod \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " Sep 09 23:11:47.341271 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.341257 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-config\") pod \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " Sep 09 23:11:47.341495 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.341478 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7p7x\" (UniqueName: \"kubernetes.io/projected/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-kube-api-access-n7p7x\") pod \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\" (UID: \"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c\") " Sep 09 23:11:47.342021 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.341974 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" (UID: "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:11:47.342288 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.342265 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" (UID: "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:11:47.342550 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.342526 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-config" (OuterVolumeSpecName: "console-config") pod "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" (UID: "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:11:47.347471 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.347445 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" (UID: "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:11:47.351445 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.351404 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" (UID: "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:11:47.352015 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.351993 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-kube-api-access-n7p7x" (OuterVolumeSpecName: "kube-api-access-n7p7x") pod "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" (UID: "0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c"). InnerVolumeSpecName "kube-api-access-n7p7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:11:47.443100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.443007 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-oauth-config\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:11:47.443100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.443050 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-service-ca\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:11:47.443100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.443067 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-oauth-serving-cert\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:11:47.443100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.443081 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-config\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:11:47.443100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.443095 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7p7x\" (UniqueName: \"kubernetes.io/projected/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-kube-api-access-n7p7x\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:11:47.443521 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.443112 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c-console-serving-cert\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:11:47.966655 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.966621 2581 generic.go:356] "Generic (PLEG): container finished" podID="0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" containerID="0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293" exitCode=0 Sep 09 23:11:47.967022 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.966686 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75447bf4d4-wqnpn" Sep 09 23:11:47.967022 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.966706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75447bf4d4-wqnpn" event={"ID":"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c","Type":"ContainerDied","Data":"0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293"} Sep 09 23:11:47.967022 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.966761 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75447bf4d4-wqnpn" event={"ID":"0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c","Type":"ContainerDied","Data":"d77020fbdfa2f4a9acd028b6e29d8f851de859a781b7fc71a86ba991342bafac"} Sep 09 23:11:47.967022 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.966784 2581 scope.go:117] "RemoveContainer" containerID="0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293" Sep 09 23:11:47.976294 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.976272 2581 scope.go:117] "RemoveContainer" containerID="0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293" Sep 09 23:11:47.976652 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:11:47.976629 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293\": container with ID starting with 0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293 not found: ID does not exist" containerID="0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293" Sep 09 23:11:47.976736 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.976660 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293"} err="failed to get container status \"0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293\": rpc error: code = NotFound desc = could not find container \"0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293\": container with ID starting with 0edb6fc401f511c2de8d2cbad0d73b4d6f8d4a6fe0523fe36b4e45fb752ad293 not found: ID does not exist" Sep 09 23:11:47.988123 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.988105 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75447bf4d4-wqnpn"] Sep 09 23:11:47.995895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:47.995875 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75447bf4d4-wqnpn"] Sep 09 23:11:49.190914 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:11:49.190873 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" path="/var/lib/kubelet/pods/0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c/volumes" Sep 09 23:12:00.850992 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.850960 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d54bd574b-kxjcp"] Sep 09 23:12:00.851438 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.851285 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" containerName="console" Sep 09 23:12:00.851438 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.851297 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" containerName="console" Sep 09 23:12:00.851438 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.851381 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b68bfcd-3b3b-40b8-84c5-c68a15ddb39c" containerName="console" Sep 09 23:12:00.854033 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.854018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:00.863705 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.863680 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d54bd574b-kxjcp"] Sep 09 23:12:00.939426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.939399 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wckgx\" (UniqueName: \"kubernetes.io/projected/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-kube-api-access-wckgx\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:00.939566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.939429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-oauth-serving-cert\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:00.939566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.939450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-oauth-config\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:00.939566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.939467 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-service-ca\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:00.939566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.939560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-serving-cert\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:00.939715 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.939583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-config\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:00.939715 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:00.939610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-trusted-ca-bundle\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.040844 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.040817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-trusted-ca-bundle\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.040964 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.040871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wckgx\" (UniqueName: \"kubernetes.io/projected/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-kube-api-access-wckgx\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.040964 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.040889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-oauth-serving-cert\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.040964 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.040919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-oauth-config\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.040964 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.040935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-service-ca\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.041144 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.040969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-serving-cert\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.041144 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.040995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-config\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.041753 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.041724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-oauth-serving-cert\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.041888 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.041786 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-config\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.041888 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.041803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-service-ca\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.042007 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.041911 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-trusted-ca-bundle\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.043560 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.043528 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-serving-cert\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.043640 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.043571 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-oauth-config\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.048162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.048140 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wckgx\" (UniqueName: \"kubernetes.io/projected/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-kube-api-access-wckgx\") pod \"console-7d54bd574b-kxjcp\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.164064 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.164006 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:01.436520 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:01.436499 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d54bd574b-kxjcp"] Sep 09 23:12:01.438970 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:12:01.438943 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43346e9f_6fdf_459d_8ed2_b7e10ae28dcc.slice/crio-0b23b2b36077182b5c97c3f4af2fb8c789ad1e18f990cb5e78b70db42a5115bb WatchSource:0}: Error finding container 0b23b2b36077182b5c97c3f4af2fb8c789ad1e18f990cb5e78b70db42a5115bb: Status 404 returned error can't find the container with id 0b23b2b36077182b5c97c3f4af2fb8c789ad1e18f990cb5e78b70db42a5115bb Sep 09 23:12:02.032469 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:02.032422 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d54bd574b-kxjcp" event={"ID":"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc","Type":"ContainerStarted","Data":"afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039"} Sep 09 23:12:02.032871 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:02.032483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d54bd574b-kxjcp" event={"ID":"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc","Type":"ContainerStarted","Data":"0b23b2b36077182b5c97c3f4af2fb8c789ad1e18f990cb5e78b70db42a5115bb"} Sep 09 23:12:02.051624 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:02.051571 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d54bd574b-kxjcp" podStartSLOduration=2.051554282 podStartE2EDuration="2.051554282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:02.050602061 +0000 UTC m=+155.382677400" watchObservedRunningTime="2026-09-09 23:12:02.051554282 +0000 UTC m=+155.383629673" Sep 09 23:12:03.910619 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:03.910581 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:12:03.911059 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:03.910986 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="alertmanager" containerID="cri-o://fb2e4f627e9de01c951cf333e32c7778c37434642cb5731a0ab8826673bb5cc1" gracePeriod=120 Sep 09 23:12:03.911059 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:03.911015 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy-metric" containerID="cri-o://fbf1c357c8c8de9c0339559e1875792f84d75b3935c5bb35f1843c9d6956a0a9" gracePeriod=120 Sep 09 23:12:03.911059 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:03.911039 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy-web" containerID="cri-o://a7ceb791f5b89a2209b1fe94cd30bb468c75f45186d87580ea95803cef1b64a5" gracePeriod=120 Sep 09 23:12:03.911223 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:03.911052 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="prom-label-proxy" containerID="cri-o://ae3496c4ac859d0150b40f43d85d6e83e3bb23b28aad0debb5db0f1ed3591ad2" gracePeriod=120 Sep 09 23:12:03.911223 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:03.911092 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="config-reloader" containerID="cri-o://d20ae1888263ae36ccca4f4eb8bfffeb90470e27369e3dce04babb45f4ed50cf" gracePeriod=120 Sep 09 23:12:03.911223 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:03.911099 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy" containerID="cri-o://1c4c965ed89ab8598933463d714e619feacb25900e8eb22a2176c1b7f7c420cd" gracePeriod=120 Sep 09 23:12:04.044096 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:04.044073 2581 generic.go:356] "Generic (PLEG): container finished" podID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerID="ae3496c4ac859d0150b40f43d85d6e83e3bb23b28aad0debb5db0f1ed3591ad2" exitCode=0 Sep 09 23:12:04.044096 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:04.044094 2581 generic.go:356] "Generic (PLEG): container finished" podID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerID="1c4c965ed89ab8598933463d714e619feacb25900e8eb22a2176c1b7f7c420cd" exitCode=0 Sep 09 23:12:04.044096 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:04.044100 2581 generic.go:356] "Generic (PLEG): container finished" podID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerID="d20ae1888263ae36ccca4f4eb8bfffeb90470e27369e3dce04babb45f4ed50cf" exitCode=0 Sep 09 23:12:04.044263 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:04.044105 2581 generic.go:356] "Generic (PLEG): container finished" podID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerID="fb2e4f627e9de01c951cf333e32c7778c37434642cb5731a0ab8826673bb5cc1" exitCode=0 Sep 09 23:12:04.044263 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:04.044147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerDied","Data":"ae3496c4ac859d0150b40f43d85d6e83e3bb23b28aad0debb5db0f1ed3591ad2"} Sep 09 23:12:04.044263 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:04.044214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerDied","Data":"1c4c965ed89ab8598933463d714e619feacb25900e8eb22a2176c1b7f7c420cd"} Sep 09 23:12:04.044263 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:04.044241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerDied","Data":"d20ae1888263ae36ccca4f4eb8bfffeb90470e27369e3dce04babb45f4ed50cf"} Sep 09 23:12:04.044416 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:04.044267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerDied","Data":"fb2e4f627e9de01c951cf333e32c7778c37434642cb5731a0ab8826673bb5cc1"} Sep 09 23:12:05.051849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.051818 2581 generic.go:356] "Generic (PLEG): container finished" podID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerID="fbf1c357c8c8de9c0339559e1875792f84d75b3935c5bb35f1843c9d6956a0a9" exitCode=0 Sep 09 23:12:05.051849 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.051841 2581 generic.go:356] "Generic (PLEG): container finished" podID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerID="a7ceb791f5b89a2209b1fe94cd30bb468c75f45186d87580ea95803cef1b64a5" exitCode=0 Sep 09 23:12:05.052231 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.051890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerDied","Data":"fbf1c357c8c8de9c0339559e1875792f84d75b3935c5bb35f1843c9d6956a0a9"} Sep 09 23:12:05.052231 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.051984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerDied","Data":"a7ceb791f5b89a2209b1fe94cd30bb468c75f45186d87580ea95803cef1b64a5"} Sep 09 23:12:05.160741 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.160719 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:05.276545 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276516 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-main-tls\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276545 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276547 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-tls-assets\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276724 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276591 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276724 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276620 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276724 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276655 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-metrics-client-ca\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276724 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276676 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-web-config\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276724 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276699 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhqv9\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-kube-api-access-zhqv9\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276737 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-trusted-ca-bundle\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276763 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-out\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276797 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-cluster-tls-config\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276831 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276858 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-volume\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.276974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.276880 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-main-db\") pod \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\" (UID: \"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa\") " Sep 09 23:12:05.277272 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.277058 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:12:05.277272 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.277163 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-metrics-client-ca\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.277407 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.277364 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:12:05.278005 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.277934 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:12:05.279535 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.279507 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:12:05.279980 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.279942 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:05.280089 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.280024 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:05.280154 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.280103 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-volume" (OuterVolumeSpecName: "config-volume") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:05.280536 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.280503 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:05.280772 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.280747 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-kube-api-access-zhqv9" (OuterVolumeSpecName: "kube-api-access-zhqv9") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "kube-api-access-zhqv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:12:05.280880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.280845 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-out" (OuterVolumeSpecName: "config-out") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:12:05.281700 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.281671 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:05.284274 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.284252 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:05.290620 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.290600 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-web-config" (OuterVolumeSpecName: "web-config") pod "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" (UID: "9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:05.378349 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378303 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-web-config\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378352 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhqv9\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-kube-api-access-zhqv9\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378363 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378372 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-out\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378380 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-cluster-tls-config\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378389 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378398 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-config-volume\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378405 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-alertmanager-main-db\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378425 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-main-tls\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378435 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-tls-assets\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378444 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:05.378459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:05.378453 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:06.059948 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.059919 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa","Type":"ContainerDied","Data":"5466cc03c90a1a47e5920abdee7566ef3ed0162d44cc4b8e4396da0c37302c7a"} Sep 09 23:12:06.060272 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.059947 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.060272 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.059998 2581 scope.go:117] "RemoveContainer" containerID="ae3496c4ac859d0150b40f43d85d6e83e3bb23b28aad0debb5db0f1ed3591ad2" Sep 09 23:12:06.070191 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.070172 2581 scope.go:117] "RemoveContainer" containerID="fbf1c357c8c8de9c0339559e1875792f84d75b3935c5bb35f1843c9d6956a0a9" Sep 09 23:12:06.077332 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.077297 2581 scope.go:117] "RemoveContainer" containerID="1c4c965ed89ab8598933463d714e619feacb25900e8eb22a2176c1b7f7c420cd" Sep 09 23:12:06.084874 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.084854 2581 scope.go:117] "RemoveContainer" containerID="a7ceb791f5b89a2209b1fe94cd30bb468c75f45186d87580ea95803cef1b64a5" Sep 09 23:12:06.085549 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.085530 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:12:06.089532 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.089511 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:12:06.092413 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.092391 2581 scope.go:117] "RemoveContainer" containerID="d20ae1888263ae36ccca4f4eb8bfffeb90470e27369e3dce04babb45f4ed50cf" Sep 09 23:12:06.099780 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.099759 2581 scope.go:117] "RemoveContainer" containerID="fb2e4f627e9de01c951cf333e32c7778c37434642cb5731a0ab8826673bb5cc1" Sep 09 23:12:06.107027 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.107010 2581 scope.go:117] "RemoveContainer" containerID="d1c3b0c99ca3799de2c9ee2c3f08ef88958793c4c3e3770c69cc9b6a5a1d7182" Sep 09 23:12:06.115561 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115541 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:12:06.115874 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115861 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="config-reloader" Sep 09 23:12:06.115920 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115879 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="config-reloader" Sep 09 23:12:06.115920 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115900 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy-metric" Sep 09 23:12:06.115920 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115906 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy-metric" Sep 09 23:12:06.115920 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115914 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="prom-label-proxy" Sep 09 23:12:06.115920 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115920 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="prom-label-proxy" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115931 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="init-config-reloader" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115936 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="init-config-reloader" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115943 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy-web" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115950 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy-web" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115961 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="alertmanager" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115968 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="alertmanager" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115976 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.115981 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.116031 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="prom-label-proxy" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.116044 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.116050 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy-metric" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.116057 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="config-reloader" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.116062 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="kube-rbac-proxy-web" Sep 09 23:12:06.116063 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.116069 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" containerName="alertmanager" Sep 09 23:12:06.118791 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.118775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.121104 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121049 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:12:06.121104 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4xv56\"" Sep 09 23:12:06.121104 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121093 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:12:06.121326 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121105 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:12:06.121326 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121150 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:12:06.121326 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121192 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:12:06.121525 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121491 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:12:06.121608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121528 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:12:06.121608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.121569 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:12:06.126056 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.126040 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:12:06.136739 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.136719 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:12:06.183608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183708 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183708 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183708 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183708 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183676 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183708 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-config-out\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-web-config\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.183895 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.183880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dhx\" (UniqueName: \"kubernetes.io/projected/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-kube-api-access-k2dhx\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.284996 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.284973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-config-out\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-web-config\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dhx\" (UniqueName: \"kubernetes.io/projected/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-kube-api-access-k2dhx\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285375 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285375 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285375 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285375 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.285375 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.285374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.286337 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.286117 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.287107 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.286930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288295 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288243 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288295 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288295 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288275 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-config-out\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288295 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288570 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288570 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288570 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288417 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-web-config\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288570 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288457 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288750 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.288991 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.288972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.289682 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.289664 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.290279 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.290261 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.293049 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.293025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dhx\" (UniqueName: \"kubernetes.io/projected/ce1442b3-e8ec-4d36-ba36-4fe14e0414e8-kube-api-access-k2dhx\") pod \"alertmanager-main-0\" (UID: \"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.428897 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.428876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:06.705518 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:06.705451 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:12:06.708569 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:12:06.708539 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1442b3_e8ec_4d36_ba36_4fe14e0414e8.slice/crio-8a52e3e6efab21bab16e248ba6c68d7c869a4a448201e3e3ed6c77d8e91d2e64 WatchSource:0}: Error finding container 8a52e3e6efab21bab16e248ba6c68d7c869a4a448201e3e3ed6c77d8e91d2e64: Status 404 returned error can't find the container with id 8a52e3e6efab21bab16e248ba6c68d7c869a4a448201e3e3ed6c77d8e91d2e64 Sep 09 23:12:07.066357 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:07.066303 2581 generic.go:356] "Generic (PLEG): container finished" podID="ce1442b3-e8ec-4d36-ba36-4fe14e0414e8" containerID="15d4bb1416d5f74036118274c491d543d545e9c11a633728dd6f122136353e48" exitCode=0 Sep 09 23:12:07.066750 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:07.066416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8","Type":"ContainerDied","Data":"15d4bb1416d5f74036118274c491d543d545e9c11a633728dd6f122136353e48"} Sep 09 23:12:07.066750 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:07.066522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8","Type":"ContainerStarted","Data":"8a52e3e6efab21bab16e248ba6c68d7c869a4a448201e3e3ed6c77d8e91d2e64"} Sep 09 23:12:07.191618 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:07.191592 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa" path="/var/lib/kubelet/pods/9b4bfe8f-1974-43ad-aa27-dd16d44ac6aa/volumes" Sep 09 23:12:08.077644 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:08.077612 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8","Type":"ContainerStarted","Data":"d3bf9a7a521c01991911e290efc0148824fa31e57f3c0672854ea6d551654ca4"} Sep 09 23:12:08.078007 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:08.077675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8","Type":"ContainerStarted","Data":"7cb7adb8f32d50550087099f127268f54085f64eed50cf57bae2d6e58638b9d1"} Sep 09 23:12:08.078007 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:08.077706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8","Type":"ContainerStarted","Data":"901b9c666012315ba5ef5f1b6709d85b6b809a597ad642399d40f57a75b85377"} Sep 09 23:12:08.078007 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:08.077733 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8","Type":"ContainerStarted","Data":"a55c4329869f4ca05518528446fb9b75bf31f7bbc3d1de9b7900185d6fcd67d2"} Sep 09 23:12:08.078007 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:08.077758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8","Type":"ContainerStarted","Data":"c75e3fbbe9c03d72f239636222812d0914ad2817a0537efb58cc981f024e68b4"} Sep 09 23:12:08.078007 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:08.077782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ce1442b3-e8ec-4d36-ba36-4fe14e0414e8","Type":"ContainerStarted","Data":"d721ef8623e3422dfed1a792105ca9c0efee53f70fe669a3711ea5cd7b2b36f4"} Sep 09 23:12:08.106584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:08.106525 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.09197861 podStartE2EDuration="2.106504979s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.526369ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:08.103605862 +0000 UTC m=+161.435681154" watchObservedRunningTime="2026-09-09 23:12:08.106504979 +0000 UTC m=+161.438580270" Sep 09 23:12:11.164516 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:11.164478 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:11.164896 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:11.164540 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:11.169342 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:11.169301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:12.102513 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:12.102479 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:12:12.144372 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:12.144342 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6469f4dc-4cz25"] Sep 09 23:12:37.164362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.164278 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c6469f4dc-4cz25" podUID="c65151dc-3ca7-4a01-ae1e-9da462400ee9" containerName="console" containerID="cri-o://cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df" gracePeriod=15 Sep 09 23:12:37.399232 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.399208 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:12:37.424046 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.423981 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-serving-cert\") pod \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " Sep 09 23:12:37.424046 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424023 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-config\") pod \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " Sep 09 23:12:37.424216 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424080 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-service-ca\") pod \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " Sep 09 23:12:37.424216 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424124 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-oauth-serving-cert\") pod \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " Sep 09 23:12:37.424216 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424170 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s58xm\" (UniqueName: \"kubernetes.io/projected/c65151dc-3ca7-4a01-ae1e-9da462400ee9-kube-api-access-s58xm\") pod \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " Sep 09 23:12:37.424388 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424222 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-trusted-ca-bundle\") pod \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " Sep 09 23:12:37.424388 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424258 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-oauth-config\") pod \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\" (UID: \"c65151dc-3ca7-4a01-ae1e-9da462400ee9\") " Sep 09 23:12:37.424690 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424551 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c65151dc-3ca7-4a01-ae1e-9da462400ee9" (UID: "c65151dc-3ca7-4a01-ae1e-9da462400ee9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:12:37.424690 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424561 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-config" (OuterVolumeSpecName: "console-config") pod "c65151dc-3ca7-4a01-ae1e-9da462400ee9" (UID: "c65151dc-3ca7-4a01-ae1e-9da462400ee9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:12:37.424854 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424818 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-service-ca" (OuterVolumeSpecName: "service-ca") pod "c65151dc-3ca7-4a01-ae1e-9da462400ee9" (UID: "c65151dc-3ca7-4a01-ae1e-9da462400ee9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:12:37.424965 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.424939 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c65151dc-3ca7-4a01-ae1e-9da462400ee9" (UID: "c65151dc-3ca7-4a01-ae1e-9da462400ee9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:12:37.426584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.426566 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c65151dc-3ca7-4a01-ae1e-9da462400ee9" (UID: "c65151dc-3ca7-4a01-ae1e-9da462400ee9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:37.426678 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.426618 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c65151dc-3ca7-4a01-ae1e-9da462400ee9" (UID: "c65151dc-3ca7-4a01-ae1e-9da462400ee9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:12:37.426952 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.426927 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65151dc-3ca7-4a01-ae1e-9da462400ee9-kube-api-access-s58xm" (OuterVolumeSpecName: "kube-api-access-s58xm") pod "c65151dc-3ca7-4a01-ae1e-9da462400ee9" (UID: "c65151dc-3ca7-4a01-ae1e-9da462400ee9"). InnerVolumeSpecName "kube-api-access-s58xm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:12:37.525680 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.525649 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-service-ca\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:37.525680 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.525680 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-oauth-serving-cert\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:37.525680 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.525689 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s58xm\" (UniqueName: \"kubernetes.io/projected/c65151dc-3ca7-4a01-ae1e-9da462400ee9-kube-api-access-s58xm\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:37.525844 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.525700 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-trusted-ca-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:37.525844 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.525709 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-oauth-config\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:37.530332 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.526122 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-serving-cert\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:37.530332 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:37.526151 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c65151dc-3ca7-4a01-ae1e-9da462400ee9-console-config\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:12:38.220896 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.220858 2581 generic.go:356] "Generic (PLEG): container finished" podID="c65151dc-3ca7-4a01-ae1e-9da462400ee9" containerID="cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df" exitCode=0 Sep 09 23:12:38.221298 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.220917 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6469f4dc-4cz25" Sep 09 23:12:38.221298 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.220961 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6469f4dc-4cz25" event={"ID":"c65151dc-3ca7-4a01-ae1e-9da462400ee9","Type":"ContainerDied","Data":"cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df"} Sep 09 23:12:38.221298 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.221022 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6469f4dc-4cz25" event={"ID":"c65151dc-3ca7-4a01-ae1e-9da462400ee9","Type":"ContainerDied","Data":"8666fb28077707e24ccfde530f0acd91a0ae83632e36ad7689f9e97062f0d2a8"} Sep 09 23:12:38.221298 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.221045 2581 scope.go:117] "RemoveContainer" containerID="cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df" Sep 09 23:12:38.230263 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.230247 2581 scope.go:117] "RemoveContainer" containerID="cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df" Sep 09 23:12:38.230540 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:12:38.230520 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df\": container with ID starting with cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df not found: ID does not exist" containerID="cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df" Sep 09 23:12:38.230593 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.230548 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df"} err="failed to get container status \"cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df\": rpc error: code = NotFound desc = could not find container \"cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df\": container with ID starting with cd35a03011a77e97d482a72baf7e2f63de3f89266e6463cb0575b71b9a4d62df not found: ID does not exist" Sep 09 23:12:38.240271 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.240250 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6469f4dc-4cz25"] Sep 09 23:12:38.244202 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:38.244180 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6469f4dc-4cz25"] Sep 09 23:12:39.190603 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:39.190564 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65151dc-3ca7-4a01-ae1e-9da462400ee9" path="/var/lib/kubelet/pods/c65151dc-3ca7-4a01-ae1e-9da462400ee9/volumes" Sep 09 23:12:45.101168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.101131 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk"] Sep 09 23:12:45.101566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.101512 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65151dc-3ca7-4a01-ae1e-9da462400ee9" containerName="console" Sep 09 23:12:45.101566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.101523 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65151dc-3ca7-4a01-ae1e-9da462400ee9" containerName="console" Sep 09 23:12:45.101636 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.101574 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c65151dc-3ca7-4a01-ae1e-9da462400ee9" containerName="console" Sep 09 23:12:45.104430 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.104412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.106765 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.106734 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:12:45.106881 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.106740 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:12:45.107425 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.107410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf4vc\"" Sep 09 23:12:45.112068 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.112047 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk"] Sep 09 23:12:45.187501 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.187468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glbrv\" (UniqueName: \"kubernetes.io/projected/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-kube-api-access-glbrv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.187693 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.187546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.187693 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.187585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.288142 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.288108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glbrv\" (UniqueName: \"kubernetes.io/projected/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-kube-api-access-glbrv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.288283 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.288252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.288354 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.288287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.288653 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.288636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.288720 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.288704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.296158 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.296133 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glbrv\" (UniqueName: \"kubernetes.io/projected/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-kube-api-access-glbrv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.414465 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.414405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:12:45.684175 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:45.684080 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk"] Sep 09 23:12:45.687262 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:12:45.687236 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d01aa1_ba72_4d0e_91cc_cdabafb5e64c.slice/crio-2b26e80d80a1267364d4e94881a466e1311745404fe9ddebf83cb8ebd35387de WatchSource:0}: Error finding container 2b26e80d80a1267364d4e94881a466e1311745404fe9ddebf83cb8ebd35387de: Status 404 returned error can't find the container with id 2b26e80d80a1267364d4e94881a466e1311745404fe9ddebf83cb8ebd35387de Sep 09 23:12:46.252867 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:46.252826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" event={"ID":"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c","Type":"ContainerStarted","Data":"2b26e80d80a1267364d4e94881a466e1311745404fe9ddebf83cb8ebd35387de"} Sep 09 23:12:52.280502 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:52.280468 2581 generic.go:356] "Generic (PLEG): container finished" podID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerID="545f462f981d444fbf52455f08bd3857a4cef1ed2170051a337797d36369b5af" exitCode=0 Sep 09 23:12:52.280856 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:52.280563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" event={"ID":"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c","Type":"ContainerDied","Data":"545f462f981d444fbf52455f08bd3857a4cef1ed2170051a337797d36369b5af"} Sep 09 23:12:55.298302 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:55.298264 2581 generic.go:356] "Generic (PLEG): container finished" podID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerID="9bc5e10abc5c23386b9141ba319baa8776a01d1102d7985a00a7c2272dd62fee" exitCode=0 Sep 09 23:12:55.298692 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:12:55.298361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" event={"ID":"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c","Type":"ContainerDied","Data":"9bc5e10abc5c23386b9141ba319baa8776a01d1102d7985a00a7c2272dd62fee"} Sep 09 23:13:02.331783 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:02.331746 2581 generic.go:356] "Generic (PLEG): container finished" podID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerID="49b530a0a983ead4651c588a4168c30a0fa975191444de1aeabfa44e11fe1691" exitCode=0 Sep 09 23:13:02.332209 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:02.331814 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" event={"ID":"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c","Type":"ContainerDied","Data":"49b530a0a983ead4651c588a4168c30a0fa975191444de1aeabfa44e11fe1691"} Sep 09 23:13:03.458606 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.458580 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:13:03.554491 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.554450 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-bundle\") pod \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " Sep 09 23:13:03.554491 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.554502 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glbrv\" (UniqueName: \"kubernetes.io/projected/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-kube-api-access-glbrv\") pod \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " Sep 09 23:13:03.554677 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.554558 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-util\") pod \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\" (UID: \"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c\") " Sep 09 23:13:03.555120 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.555095 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-bundle" (OuterVolumeSpecName: "bundle") pod "81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" (UID: "81d01aa1-ba72-4d0e-91cc-cdabafb5e64c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:03.556762 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.556731 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-kube-api-access-glbrv" (OuterVolumeSpecName: "kube-api-access-glbrv") pod "81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" (UID: "81d01aa1-ba72-4d0e-91cc-cdabafb5e64c"). InnerVolumeSpecName "kube-api-access-glbrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:03.561207 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.561182 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-util" (OuterVolumeSpecName: "util") pod "81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" (UID: "81d01aa1-ba72-4d0e-91cc-cdabafb5e64c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:03.656014 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.655930 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-util\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:03.656014 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.655961 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:03.656014 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:03.655975 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glbrv\" (UniqueName: \"kubernetes.io/projected/81d01aa1-ba72-4d0e-91cc-cdabafb5e64c-kube-api-access-glbrv\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:04.343944 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:04.343912 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" Sep 09 23:13:04.344106 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:04.343915 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d2bxk" event={"ID":"81d01aa1-ba72-4d0e-91cc-cdabafb5e64c","Type":"ContainerDied","Data":"2b26e80d80a1267364d4e94881a466e1311745404fe9ddebf83cb8ebd35387de"} Sep 09 23:13:04.344106 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:04.344037 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b26e80d80a1267364d4e94881a466e1311745404fe9ddebf83cb8ebd35387de" Sep 09 23:13:08.109270 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.109233 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g"] Sep 09 23:13:08.109661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.109564 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerName="extract" Sep 09 23:13:08.109661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.109575 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerName="extract" Sep 09 23:13:08.109661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.109592 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerName="util" Sep 09 23:13:08.109661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.109598 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerName="util" Sep 09 23:13:08.109661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.109611 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerName="pull" Sep 09 23:13:08.109661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.109616 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerName="pull" Sep 09 23:13:08.109661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.109662 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="81d01aa1-ba72-4d0e-91cc-cdabafb5e64c" containerName="extract" Sep 09 23:13:08.113155 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.113138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" Sep 09 23:13:08.115474 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.115453 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rwh46\"" Sep 09 23:13:08.115474 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.115467 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:13:08.115627 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.115493 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 09 23:13:08.126321 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.126286 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g"] Sep 09 23:13:08.195061 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.195031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x8jt\" (UniqueName: \"kubernetes.io/projected/ada25f47-3d6a-42dd-84a3-f779bbb83f4e-kube-api-access-8x8jt\") pod \"cert-manager-operator-controller-manager-55c444bf86-4d28g\" (UID: \"ada25f47-3d6a-42dd-84a3-f779bbb83f4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" Sep 09 23:13:08.195153 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.195067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada25f47-3d6a-42dd-84a3-f779bbb83f4e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4d28g\" (UID: \"ada25f47-3d6a-42dd-84a3-f779bbb83f4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" Sep 09 23:13:08.295749 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.295724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x8jt\" (UniqueName: \"kubernetes.io/projected/ada25f47-3d6a-42dd-84a3-f779bbb83f4e-kube-api-access-8x8jt\") pod \"cert-manager-operator-controller-manager-55c444bf86-4d28g\" (UID: \"ada25f47-3d6a-42dd-84a3-f779bbb83f4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" Sep 09 23:13:08.295855 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.295760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada25f47-3d6a-42dd-84a3-f779bbb83f4e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4d28g\" (UID: \"ada25f47-3d6a-42dd-84a3-f779bbb83f4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" Sep 09 23:13:08.296099 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.296082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada25f47-3d6a-42dd-84a3-f779bbb83f4e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4d28g\" (UID: \"ada25f47-3d6a-42dd-84a3-f779bbb83f4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" Sep 09 23:13:08.306421 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.306402 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x8jt\" (UniqueName: \"kubernetes.io/projected/ada25f47-3d6a-42dd-84a3-f779bbb83f4e-kube-api-access-8x8jt\") pod \"cert-manager-operator-controller-manager-55c444bf86-4d28g\" (UID: \"ada25f47-3d6a-42dd-84a3-f779bbb83f4e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" Sep 09 23:13:08.421471 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.421417 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" Sep 09 23:13:08.693900 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:08.693875 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g"] Sep 09 23:13:08.696268 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:13:08.696244 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada25f47_3d6a_42dd_84a3_f779bbb83f4e.slice/crio-42cef6bc0f0d63e31409a20650172d870fcd160e86e45c0f7905f35bedd9271d WatchSource:0}: Error finding container 42cef6bc0f0d63e31409a20650172d870fcd160e86e45c0f7905f35bedd9271d: Status 404 returned error can't find the container with id 42cef6bc0f0d63e31409a20650172d870fcd160e86e45c0f7905f35bedd9271d Sep 09 23:13:09.365295 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:09.365260 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" event={"ID":"ada25f47-3d6a-42dd-84a3-f779bbb83f4e","Type":"ContainerStarted","Data":"42cef6bc0f0d63e31409a20650172d870fcd160e86e45c0f7905f35bedd9271d"} Sep 09 23:13:10.371447 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:10.371411 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" event={"ID":"ada25f47-3d6a-42dd-84a3-f779bbb83f4e","Type":"ContainerStarted","Data":"2caa832e82fec4de382add2e076e774dffae9fd7639c6fa86da8da443a843f48"} Sep 09 23:13:10.395418 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:10.395367 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4d28g" podStartSLOduration=0.818810632 podStartE2EDuration="2.395350696s" totalImagesPullingTime="1.576540064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:10.394441936 +0000 UTC m=+223.726517226" watchObservedRunningTime="2026-09-09 23:13:10.395350696 +0000 UTC m=+223.727425986" Sep 09 23:13:11.535986 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.535951 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw"] Sep 09 23:13:11.538540 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.538522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.540824 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.540794 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:13:11.540976 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.540879 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:13:11.541731 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.541711 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf4vc\"" Sep 09 23:13:11.549524 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.549491 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw"] Sep 09 23:13:11.721845 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.721812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.722008 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.721873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q55vx\" (UniqueName: \"kubernetes.io/projected/90052a29-9bac-430e-a9f3-10adbc09a39a-kube-api-access-q55vx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.722008 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.721901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.822601 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.822532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.822601 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.822591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q55vx\" (UniqueName: \"kubernetes.io/projected/90052a29-9bac-430e-a9f3-10adbc09a39a-kube-api-access-q55vx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.822749 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.822627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.822994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.822971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.823037 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.822995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.830844 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.830821 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q55vx\" (UniqueName: \"kubernetes.io/projected/90052a29-9bac-430e-a9f3-10adbc09a39a-kube-api-access-q55vx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:11.848296 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:11.848265 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:12.129499 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:12.129475 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw"] Sep 09 23:13:12.131680 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:13:12.131652 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90052a29_9bac_430e_a9f3_10adbc09a39a.slice/crio-e7e36a2b092a470b91ca8943dcc4b0e1fb489bb909857bac47443e5df3f0f78e WatchSource:0}: Error finding container e7e36a2b092a470b91ca8943dcc4b0e1fb489bb909857bac47443e5df3f0f78e: Status 404 returned error can't find the container with id e7e36a2b092a470b91ca8943dcc4b0e1fb489bb909857bac47443e5df3f0f78e Sep 09 23:13:12.381240 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:12.381176 2581 generic.go:356] "Generic (PLEG): container finished" podID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerID="7662fc795154b5035ab4f82f2de3ff4eebf6783789a1297519e8b41edccbe6b7" exitCode=0 Sep 09 23:13:12.381363 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:12.381235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" event={"ID":"90052a29-9bac-430e-a9f3-10adbc09a39a","Type":"ContainerDied","Data":"7662fc795154b5035ab4f82f2de3ff4eebf6783789a1297519e8b41edccbe6b7"} Sep 09 23:13:12.381363 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:12.381280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" event={"ID":"90052a29-9bac-430e-a9f3-10adbc09a39a","Type":"ContainerStarted","Data":"e7e36a2b092a470b91ca8943dcc4b0e1fb489bb909857bac47443e5df3f0f78e"} Sep 09 23:13:13.158383 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.158289 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m66dx"] Sep 09 23:13:13.160616 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.160597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:13.162872 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.162850 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:13:13.162986 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.162891 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:13:13.163038 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.162993 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qkk6p\"" Sep 09 23:13:13.169219 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.169188 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m66dx"] Sep 09 23:13:13.335456 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.335406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvkt\" (UniqueName: \"kubernetes.io/projected/7679f8d4-d354-4007-82f2-d5fa4f2e3613-kube-api-access-pwvkt\") pod \"cert-manager-webhook-6486ffd997-m66dx\" (UID: \"7679f8d4-d354-4007-82f2-d5fa4f2e3613\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:13.335456 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.335458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7679f8d4-d354-4007-82f2-d5fa4f2e3613-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m66dx\" (UID: \"7679f8d4-d354-4007-82f2-d5fa4f2e3613\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:13.436886 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.436808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvkt\" (UniqueName: \"kubernetes.io/projected/7679f8d4-d354-4007-82f2-d5fa4f2e3613-kube-api-access-pwvkt\") pod \"cert-manager-webhook-6486ffd997-m66dx\" (UID: \"7679f8d4-d354-4007-82f2-d5fa4f2e3613\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:13.436886 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.436854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7679f8d4-d354-4007-82f2-d5fa4f2e3613-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m66dx\" (UID: \"7679f8d4-d354-4007-82f2-d5fa4f2e3613\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:13.444522 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.444495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7679f8d4-d354-4007-82f2-d5fa4f2e3613-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m66dx\" (UID: \"7679f8d4-d354-4007-82f2-d5fa4f2e3613\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:13.444645 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.444554 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvkt\" (UniqueName: \"kubernetes.io/projected/7679f8d4-d354-4007-82f2-d5fa4f2e3613-kube-api-access-pwvkt\") pod \"cert-manager-webhook-6486ffd997-m66dx\" (UID: \"7679f8d4-d354-4007-82f2-d5fa4f2e3613\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:13.477592 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:13.477567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:14.162251 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:14.162229 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m66dx"] Sep 09 23:13:14.164485 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:13:14.164462 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7679f8d4_d354_4007_82f2_d5fa4f2e3613.slice/crio-54ed31688c4b6a0f27a7f2ff954744bd942877acbd178315c6637e44f421ea29 WatchSource:0}: Error finding container 54ed31688c4b6a0f27a7f2ff954744bd942877acbd178315c6637e44f421ea29: Status 404 returned error can't find the container with id 54ed31688c4b6a0f27a7f2ff954744bd942877acbd178315c6637e44f421ea29 Sep 09 23:13:14.394005 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:14.393969 2581 generic.go:356] "Generic (PLEG): container finished" podID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerID="89cddc785ceaa3d29d180a5cb5e50631b40cfe0e63c77f75cc205bcde16eae9b" exitCode=0 Sep 09 23:13:14.394176 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:14.394048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" event={"ID":"90052a29-9bac-430e-a9f3-10adbc09a39a","Type":"ContainerDied","Data":"89cddc785ceaa3d29d180a5cb5e50631b40cfe0e63c77f75cc205bcde16eae9b"} Sep 09 23:13:14.395283 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:14.395258 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" event={"ID":"7679f8d4-d354-4007-82f2-d5fa4f2e3613","Type":"ContainerStarted","Data":"54ed31688c4b6a0f27a7f2ff954744bd942877acbd178315c6637e44f421ea29"} Sep 09 23:13:15.402748 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:15.402640 2581 generic.go:356] "Generic (PLEG): container finished" podID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerID="5bad8705670ec97709a2fa796b60299f5646cc7245f612330e89c9aa77f1ec37" exitCode=0 Sep 09 23:13:15.402748 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:15.402720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" event={"ID":"90052a29-9bac-430e-a9f3-10adbc09a39a","Type":"ContainerDied","Data":"5bad8705670ec97709a2fa796b60299f5646cc7245f612330e89c9aa77f1ec37"} Sep 09 23:13:16.584089 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.584065 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:16.766780 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.766752 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-util\") pod \"90052a29-9bac-430e-a9f3-10adbc09a39a\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " Sep 09 23:13:16.766937 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.766785 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-bundle\") pod \"90052a29-9bac-430e-a9f3-10adbc09a39a\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " Sep 09 23:13:16.766937 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.766829 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q55vx\" (UniqueName: \"kubernetes.io/projected/90052a29-9bac-430e-a9f3-10adbc09a39a-kube-api-access-q55vx\") pod \"90052a29-9bac-430e-a9f3-10adbc09a39a\" (UID: \"90052a29-9bac-430e-a9f3-10adbc09a39a\") " Sep 09 23:13:16.767197 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.767163 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-bundle" (OuterVolumeSpecName: "bundle") pod "90052a29-9bac-430e-a9f3-10adbc09a39a" (UID: "90052a29-9bac-430e-a9f3-10adbc09a39a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:16.768841 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.768812 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90052a29-9bac-430e-a9f3-10adbc09a39a-kube-api-access-q55vx" (OuterVolumeSpecName: "kube-api-access-q55vx") pod "90052a29-9bac-430e-a9f3-10adbc09a39a" (UID: "90052a29-9bac-430e-a9f3-10adbc09a39a"). InnerVolumeSpecName "kube-api-access-q55vx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:16.771915 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.771868 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-util" (OuterVolumeSpecName: "util") pod "90052a29-9bac-430e-a9f3-10adbc09a39a" (UID: "90052a29-9bac-430e-a9f3-10adbc09a39a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:16.868139 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.868116 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-util\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:16.868139 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.868135 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90052a29-9bac-430e-a9f3-10adbc09a39a-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:16.868252 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:16.868145 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q55vx\" (UniqueName: \"kubernetes.io/projected/90052a29-9bac-430e-a9f3-10adbc09a39a-kube-api-access-q55vx\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:17.414009 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:17.413980 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" Sep 09 23:13:17.414192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:17.413982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frr9mw" event={"ID":"90052a29-9bac-430e-a9f3-10adbc09a39a","Type":"ContainerDied","Data":"e7e36a2b092a470b91ca8943dcc4b0e1fb489bb909857bac47443e5df3f0f78e"} Sep 09 23:13:17.414192 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:17.414106 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7e36a2b092a470b91ca8943dcc4b0e1fb489bb909857bac47443e5df3f0f78e" Sep 09 23:13:17.415711 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:17.415687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" event={"ID":"7679f8d4-d354-4007-82f2-d5fa4f2e3613","Type":"ContainerStarted","Data":"058bae5db731e451e0762214953fe3fbf61d27c289128e1bc42b0e88f0689574"} Sep 09 23:13:17.415834 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:17.415766 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:17.435612 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:17.435569 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" podStartSLOduration=2.000972501 podStartE2EDuration="4.435555645s" totalImagesPullingTime="2.434583144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:17.433898772 +0000 UTC m=+230.765974064" watchObservedRunningTime="2026-09-09 23:13:17.435555645 +0000 UTC m=+230.767630935" Sep 09 23:13:22.947301 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.947260 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fr2w7"] Sep 09 23:13:22.947688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.947623 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerName="extract" Sep 09 23:13:22.947688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.947636 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerName="extract" Sep 09 23:13:22.947688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.947650 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerName="util" Sep 09 23:13:22.947688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.947656 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerName="util" Sep 09 23:13:22.947688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.947665 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerName="pull" Sep 09 23:13:22.947688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.947671 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerName="pull" Sep 09 23:13:22.947881 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.947724 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="90052a29-9bac-430e-a9f3-10adbc09a39a" containerName="extract" Sep 09 23:13:22.950763 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.950744 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fr2w7" Sep 09 23:13:22.952885 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.952860 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dfrzw\"" Sep 09 23:13:22.961241 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:22.961217 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fr2w7"] Sep 09 23:13:23.008776 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.008751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjqkk\" (UniqueName: \"kubernetes.io/projected/7c531590-0784-40c6-b315-632327866f60-kube-api-access-tjqkk\") pod \"cert-manager-55b4d954d5-fr2w7\" (UID: \"7c531590-0784-40c6-b315-632327866f60\") " pod="cert-manager/cert-manager-55b4d954d5-fr2w7" Sep 09 23:13:23.008863 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.008791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c531590-0784-40c6-b315-632327866f60-bound-sa-token\") pod \"cert-manager-55b4d954d5-fr2w7\" (UID: \"7c531590-0784-40c6-b315-632327866f60\") " pod="cert-manager/cert-manager-55b4d954d5-fr2w7" Sep 09 23:13:23.109926 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.109903 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjqkk\" (UniqueName: \"kubernetes.io/projected/7c531590-0784-40c6-b315-632327866f60-kube-api-access-tjqkk\") pod \"cert-manager-55b4d954d5-fr2w7\" (UID: \"7c531590-0784-40c6-b315-632327866f60\") " pod="cert-manager/cert-manager-55b4d954d5-fr2w7" Sep 09 23:13:23.110026 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.109946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c531590-0784-40c6-b315-632327866f60-bound-sa-token\") pod \"cert-manager-55b4d954d5-fr2w7\" (UID: \"7c531590-0784-40c6-b315-632327866f60\") " pod="cert-manager/cert-manager-55b4d954d5-fr2w7" Sep 09 23:13:23.118080 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.118050 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7c531590-0784-40c6-b315-632327866f60-bound-sa-token\") pod \"cert-manager-55b4d954d5-fr2w7\" (UID: \"7c531590-0784-40c6-b315-632327866f60\") " pod="cert-manager/cert-manager-55b4d954d5-fr2w7" Sep 09 23:13:23.118176 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.118159 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjqkk\" (UniqueName: \"kubernetes.io/projected/7c531590-0784-40c6-b315-632327866f60-kube-api-access-tjqkk\") pod \"cert-manager-55b4d954d5-fr2w7\" (UID: \"7c531590-0784-40c6-b315-632327866f60\") " pod="cert-manager/cert-manager-55b4d954d5-fr2w7" Sep 09 23:13:23.260790 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.260768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fr2w7" Sep 09 23:13:23.422223 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.422198 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m66dx" Sep 09 23:13:23.531819 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:23.531797 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fr2w7"] Sep 09 23:13:23.534153 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:13:23.534123 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c531590_0784_40c6_b315_632327866f60.slice/crio-d2023b39c5db8d68ec9e98bd51db4ce76155f41ddcf6614c0625ac311a3a30b3 WatchSource:0}: Error finding container d2023b39c5db8d68ec9e98bd51db4ce76155f41ddcf6614c0625ac311a3a30b3: Status 404 returned error can't find the container with id d2023b39c5db8d68ec9e98bd51db4ce76155f41ddcf6614c0625ac311a3a30b3 Sep 09 23:13:24.450872 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.450839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fr2w7" event={"ID":"7c531590-0784-40c6-b315-632327866f60","Type":"ContainerStarted","Data":"250a0da77675447e3d9a888fa8405d11303b568d8ea46d3704ba7b4d91b8786b"} Sep 09 23:13:24.451194 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.450880 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fr2w7" event={"ID":"7c531590-0784-40c6-b315-632327866f60","Type":"ContainerStarted","Data":"d2023b39c5db8d68ec9e98bd51db4ce76155f41ddcf6614c0625ac311a3a30b3"} Sep 09 23:13:24.467089 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.467039 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fr2w7" podStartSLOduration=2.467023051 podStartE2EDuration="2.467023051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:24.46610978 +0000 UTC m=+237.798185063" watchObservedRunningTime="2026-09-09 23:13:24.467023051 +0000 UTC m=+237.799098342" Sep 09 23:13:24.576362 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.576334 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g"] Sep 09 23:13:24.581198 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.581165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" Sep 09 23:13:24.583858 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.583834 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9gsdr\"" Sep 09 23:13:24.584037 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.584022 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:13:24.584094 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.584057 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:13:24.588071 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.588040 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g"] Sep 09 23:13:24.621237 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.621209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mwtz\" (UniqueName: \"kubernetes.io/projected/57d52a45-aa83-46f4-bc1b-745503c0315d-kube-api-access-6mwtz\") pod \"openshift-lws-operator-fd8ccff4c-dxq7g\" (UID: \"57d52a45-aa83-46f4-bc1b-745503c0315d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" Sep 09 23:13:24.621385 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.621280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d52a45-aa83-46f4-bc1b-745503c0315d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dxq7g\" (UID: \"57d52a45-aa83-46f4-bc1b-745503c0315d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" Sep 09 23:13:24.722485 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.722457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mwtz\" (UniqueName: \"kubernetes.io/projected/57d52a45-aa83-46f4-bc1b-745503c0315d-kube-api-access-6mwtz\") pod \"openshift-lws-operator-fd8ccff4c-dxq7g\" (UID: \"57d52a45-aa83-46f4-bc1b-745503c0315d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" Sep 09 23:13:24.722608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.722527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d52a45-aa83-46f4-bc1b-745503c0315d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dxq7g\" (UID: \"57d52a45-aa83-46f4-bc1b-745503c0315d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" Sep 09 23:13:24.722854 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.722833 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d52a45-aa83-46f4-bc1b-745503c0315d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dxq7g\" (UID: \"57d52a45-aa83-46f4-bc1b-745503c0315d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" Sep 09 23:13:24.729931 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.729911 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mwtz\" (UniqueName: \"kubernetes.io/projected/57d52a45-aa83-46f4-bc1b-745503c0315d-kube-api-access-6mwtz\") pod \"openshift-lws-operator-fd8ccff4c-dxq7g\" (UID: \"57d52a45-aa83-46f4-bc1b-745503c0315d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" Sep 09 23:13:24.892091 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:24.892063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" Sep 09 23:13:25.168259 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:25.168189 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g"] Sep 09 23:13:25.171552 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:13:25.171522 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57d52a45_aa83_46f4_bc1b_745503c0315d.slice/crio-8e29f099482bf77d019e107ed2fd995de5a23ed4a09080b0047de8ec8933efaa WatchSource:0}: Error finding container 8e29f099482bf77d019e107ed2fd995de5a23ed4a09080b0047de8ec8933efaa: Status 404 returned error can't find the container with id 8e29f099482bf77d019e107ed2fd995de5a23ed4a09080b0047de8ec8933efaa Sep 09 23:13:25.456894 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:25.456822 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" event={"ID":"57d52a45-aa83-46f4-bc1b-745503c0315d","Type":"ContainerStarted","Data":"8e29f099482bf77d019e107ed2fd995de5a23ed4a09080b0047de8ec8933efaa"} Sep 09 23:13:27.469548 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:27.469512 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" event={"ID":"57d52a45-aa83-46f4-bc1b-745503c0315d","Type":"ContainerStarted","Data":"9442e3754208152b5dbb441707e2770c8d15f09c5fd7a2423cef11ce3bdedf31"} Sep 09 23:13:27.487504 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:27.487464 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dxq7g" podStartSLOduration=1.946680662 podStartE2EDuration="3.487449142s" totalImagesPullingTime="1.54076848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:27.485722192 +0000 UTC m=+240.817797478" watchObservedRunningTime="2026-09-09 23:13:27.487449142 +0000 UTC m=+240.819524432" Sep 09 23:13:30.915343 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.915271 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9"] Sep 09 23:13:30.920744 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.920715 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:30.923184 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.923115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf4vc\"" Sep 09 23:13:30.923184 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.923157 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:13:30.923913 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.923879 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:13:30.926995 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.926970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9"] Sep 09 23:13:30.972099 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.972076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:30.972188 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.972105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnmmb\" (UniqueName: \"kubernetes.io/projected/514297d6-27f7-40e2-bd26-25c9c44f0cfb-kube-api-access-rnmmb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:30.972188 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:30.972143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:31.073244 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:31.073224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:31.073365 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:31.073253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmmb\" (UniqueName: \"kubernetes.io/projected/514297d6-27f7-40e2-bd26-25c9c44f0cfb-kube-api-access-rnmmb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:31.073365 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:31.073282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:31.073625 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:31.073607 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:31.073666 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:31.073633 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:31.081745 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:31.081724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmmb\" (UniqueName: \"kubernetes.io/projected/514297d6-27f7-40e2-bd26-25c9c44f0cfb-kube-api-access-rnmmb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:31.232736 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:31.232716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:31.505782 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:31.505670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9"] Sep 09 23:13:31.507818 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:13:31.507789 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514297d6_27f7_40e2_bd26_25c9c44f0cfb.slice/crio-bafe3af867ca39b2887343791eda6ff93b1aa48dd3213df691bdc05ab7f50c77 WatchSource:0}: Error finding container bafe3af867ca39b2887343791eda6ff93b1aa48dd3213df691bdc05ab7f50c77: Status 404 returned error can't find the container with id bafe3af867ca39b2887343791eda6ff93b1aa48dd3213df691bdc05ab7f50c77 Sep 09 23:13:32.495370 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:32.495342 2581 generic.go:356] "Generic (PLEG): container finished" podID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerID="376e9dc306368eefd01c56bd512582b519753b5e50e2b56d7e9bde9a7b298c94" exitCode=0 Sep 09 23:13:32.495797 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:32.495377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" event={"ID":"514297d6-27f7-40e2-bd26-25c9c44f0cfb","Type":"ContainerDied","Data":"376e9dc306368eefd01c56bd512582b519753b5e50e2b56d7e9bde9a7b298c94"} Sep 09 23:13:32.495797 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:32.495438 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" event={"ID":"514297d6-27f7-40e2-bd26-25c9c44f0cfb","Type":"ContainerStarted","Data":"bafe3af867ca39b2887343791eda6ff93b1aa48dd3213df691bdc05ab7f50c77"} Sep 09 23:13:33.501754 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:33.501722 2581 generic.go:356] "Generic (PLEG): container finished" podID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerID="6063b532067becee7f027aec85434f2c2f8b984ad5c195ce891500c8b36f272e" exitCode=0 Sep 09 23:13:33.502111 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:33.501793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" event={"ID":"514297d6-27f7-40e2-bd26-25c9c44f0cfb","Type":"ContainerDied","Data":"6063b532067becee7f027aec85434f2c2f8b984ad5c195ce891500c8b36f272e"} Sep 09 23:13:34.508652 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:34.508618 2581 generic.go:356] "Generic (PLEG): container finished" podID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerID="53b010e79dadc1d061896fc0e6da33ef117f4760c81c6e66db6568f64f63564d" exitCode=0 Sep 09 23:13:34.509081 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:34.508672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" event={"ID":"514297d6-27f7-40e2-bd26-25c9c44f0cfb","Type":"ContainerDied","Data":"53b010e79dadc1d061896fc0e6da33ef117f4760c81c6e66db6568f64f63564d"} Sep 09 23:13:35.653651 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.653627 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:35.710045 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.710021 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-bundle\") pod \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " Sep 09 23:13:35.710151 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.710058 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-util\") pod \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " Sep 09 23:13:35.710151 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.710116 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnmmb\" (UniqueName: \"kubernetes.io/projected/514297d6-27f7-40e2-bd26-25c9c44f0cfb-kube-api-access-rnmmb\") pod \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\" (UID: \"514297d6-27f7-40e2-bd26-25c9c44f0cfb\") " Sep 09 23:13:35.710807 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.710782 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-bundle" (OuterVolumeSpecName: "bundle") pod "514297d6-27f7-40e2-bd26-25c9c44f0cfb" (UID: "514297d6-27f7-40e2-bd26-25c9c44f0cfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:35.712116 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.712092 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514297d6-27f7-40e2-bd26-25c9c44f0cfb-kube-api-access-rnmmb" (OuterVolumeSpecName: "kube-api-access-rnmmb") pod "514297d6-27f7-40e2-bd26-25c9c44f0cfb" (UID: "514297d6-27f7-40e2-bd26-25c9c44f0cfb"). InnerVolumeSpecName "kube-api-access-rnmmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:35.715332 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.715298 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-util" (OuterVolumeSpecName: "util") pod "514297d6-27f7-40e2-bd26-25c9c44f0cfb" (UID: "514297d6-27f7-40e2-bd26-25c9c44f0cfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:35.811098 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.811035 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnmmb\" (UniqueName: \"kubernetes.io/projected/514297d6-27f7-40e2-bd26-25c9c44f0cfb-kube-api-access-rnmmb\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:35.811098 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.811061 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:35.811098 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:35.811075 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/514297d6-27f7-40e2-bd26-25c9c44f0cfb-util\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:36.519808 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:36.519782 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" Sep 09 23:13:36.519962 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:36.519802 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvdmp9" event={"ID":"514297d6-27f7-40e2-bd26-25c9c44f0cfb","Type":"ContainerDied","Data":"bafe3af867ca39b2887343791eda6ff93b1aa48dd3213df691bdc05ab7f50c77"} Sep 09 23:13:36.519962 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:36.519845 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bafe3af867ca39b2887343791eda6ff93b1aa48dd3213df691bdc05ab7f50c77" Sep 09 23:13:40.732901 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.732861 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh"] Sep 09 23:13:40.733273 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.733203 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerName="util" Sep 09 23:13:40.733273 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.733216 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerName="util" Sep 09 23:13:40.733273 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.733240 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerName="extract" Sep 09 23:13:40.733273 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.733245 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerName="extract" Sep 09 23:13:40.733273 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.733253 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerName="pull" Sep 09 23:13:40.733273 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.733258 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerName="pull" Sep 09 23:13:40.733482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.733337 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="514297d6-27f7-40e2-bd26-25c9c44f0cfb" containerName="extract" Sep 09 23:13:40.735776 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.735754 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.738006 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.737977 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:13:40.738143 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.737977 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:13:40.738143 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.738020 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf4vc\"" Sep 09 23:13:40.747114 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.747090 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh"] Sep 09 23:13:40.848077 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.848053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.848188 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.848083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7g8c\" (UniqueName: \"kubernetes.io/projected/6c458b19-5b0f-4592-98d4-38a40e91a969-kube-api-access-z7g8c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.848188 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.848108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.948946 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.948916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.949064 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.948956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7g8c\" (UniqueName: \"kubernetes.io/projected/6c458b19-5b0f-4592-98d4-38a40e91a969-kube-api-access-z7g8c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.949064 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.948994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.949407 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.949386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.949407 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.949400 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:40.957505 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:40.957484 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7g8c\" (UniqueName: \"kubernetes.io/projected/6c458b19-5b0f-4592-98d4-38a40e91a969-kube-api-access-z7g8c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:41.046051 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:41.046000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:41.323226 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:41.323202 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh"] Sep 09 23:13:41.325247 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:13:41.325210 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c458b19_5b0f_4592_98d4_38a40e91a969.slice/crio-348cf5591841757aeb9dcdaf9cdd05e103aaee475c5ff34e147f85952771ed4f WatchSource:0}: Error finding container 348cf5591841757aeb9dcdaf9cdd05e103aaee475c5ff34e147f85952771ed4f: Status 404 returned error can't find the container with id 348cf5591841757aeb9dcdaf9cdd05e103aaee475c5ff34e147f85952771ed4f Sep 09 23:13:41.545197 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:41.545163 2581 generic.go:356] "Generic (PLEG): container finished" podID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerID="4ed1d223d94d18621e5441ee5c97ef7d06f4b08994517246c4b500b6250ce446" exitCode=0 Sep 09 23:13:41.545291 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:41.545212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" event={"ID":"6c458b19-5b0f-4592-98d4-38a40e91a969","Type":"ContainerDied","Data":"4ed1d223d94d18621e5441ee5c97ef7d06f4b08994517246c4b500b6250ce446"} Sep 09 23:13:41.545291 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:41.545262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" event={"ID":"6c458b19-5b0f-4592-98d4-38a40e91a969","Type":"ContainerStarted","Data":"348cf5591841757aeb9dcdaf9cdd05e103aaee475c5ff34e147f85952771ed4f"} Sep 09 23:13:42.551472 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.551437 2581 generic.go:356] "Generic (PLEG): container finished" podID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerID="dedf29f89b347438fcfd36358ad6bce9d7a48225a762ba01a22abffd3d96d689" exitCode=0 Sep 09 23:13:42.551827 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.551519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" event={"ID":"6c458b19-5b0f-4592-98d4-38a40e91a969","Type":"ContainerDied","Data":"dedf29f89b347438fcfd36358ad6bce9d7a48225a762ba01a22abffd3d96d689"} Sep 09 23:13:42.711432 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.711394 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58"] Sep 09 23:13:42.715340 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.715296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.718971 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.718935 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:13:42.719084 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.719001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:13:42.719350 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.719326 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:13:42.719461 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.719414 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l5dkq\"" Sep 09 23:13:42.719779 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.719760 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:13:42.741298 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.741270 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58"] Sep 09 23:13:42.767141 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.767113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f59580ac-a555-4cfc-b47b-1cc5582f4e07-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.767270 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.767169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xcp8\" (UniqueName: \"kubernetes.io/projected/f59580ac-a555-4cfc-b47b-1cc5582f4e07-kube-api-access-9xcp8\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.767270 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.767260 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f59580ac-a555-4cfc-b47b-1cc5582f4e07-manifests\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.767385 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.767291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f59580ac-a555-4cfc-b47b-1cc5582f4e07-tmp\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.767385 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.767366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f59580ac-a555-4cfc-b47b-1cc5582f4e07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.868552 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.868489 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f59580ac-a555-4cfc-b47b-1cc5582f4e07-manifests\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.868552 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.868519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f59580ac-a555-4cfc-b47b-1cc5582f4e07-tmp\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.868552 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.868546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f59580ac-a555-4cfc-b47b-1cc5582f4e07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.868777 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.868575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f59580ac-a555-4cfc-b47b-1cc5582f4e07-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.868777 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.868602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xcp8\" (UniqueName: \"kubernetes.io/projected/f59580ac-a555-4cfc-b47b-1cc5582f4e07-kube-api-access-9xcp8\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.868965 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.868936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f59580ac-a555-4cfc-b47b-1cc5582f4e07-manifests\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.870919 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.870889 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f59580ac-a555-4cfc-b47b-1cc5582f4e07-tmp\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.870994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.870944 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f59580ac-a555-4cfc-b47b-1cc5582f4e07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.871068 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.871052 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f59580ac-a555-4cfc-b47b-1cc5582f4e07-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:42.880196 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:42.880173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xcp8\" (UniqueName: \"kubernetes.io/projected/f59580ac-a555-4cfc-b47b-1cc5582f4e07-kube-api-access-9xcp8\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-mhr58\" (UID: \"f59580ac-a555-4cfc-b47b-1cc5582f4e07\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:43.026526 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:43.026507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:43.308091 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:43.308059 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58"] Sep 09 23:13:43.311610 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:13:43.311580 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59580ac_a555_4cfc_b47b_1cc5582f4e07.slice/crio-a06d641dbc68b5464c145eebb71bb313a80f454316ae8ad2dcaf14b1b8657ebe WatchSource:0}: Error finding container a06d641dbc68b5464c145eebb71bb313a80f454316ae8ad2dcaf14b1b8657ebe: Status 404 returned error can't find the container with id a06d641dbc68b5464c145eebb71bb313a80f454316ae8ad2dcaf14b1b8657ebe Sep 09 23:13:43.559553 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:43.559484 2581 generic.go:356] "Generic (PLEG): container finished" podID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerID="717208d28774c24088ae540e323134631690be3825611e2012a1d64602ebe342" exitCode=0 Sep 09 23:13:43.559933 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:43.559574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" event={"ID":"6c458b19-5b0f-4592-98d4-38a40e91a969","Type":"ContainerDied","Data":"717208d28774c24088ae540e323134631690be3825611e2012a1d64602ebe342"} Sep 09 23:13:43.561119 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:43.561093 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" event={"ID":"f59580ac-a555-4cfc-b47b-1cc5582f4e07","Type":"ContainerStarted","Data":"a06d641dbc68b5464c145eebb71bb313a80f454316ae8ad2dcaf14b1b8657ebe"} Sep 09 23:13:46.210412 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.210390 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:46.299977 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.299956 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7g8c\" (UniqueName: \"kubernetes.io/projected/6c458b19-5b0f-4592-98d4-38a40e91a969-kube-api-access-z7g8c\") pod \"6c458b19-5b0f-4592-98d4-38a40e91a969\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " Sep 09 23:13:46.300096 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.299992 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-util\") pod \"6c458b19-5b0f-4592-98d4-38a40e91a969\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " Sep 09 23:13:46.300096 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.300036 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-bundle\") pod \"6c458b19-5b0f-4592-98d4-38a40e91a969\" (UID: \"6c458b19-5b0f-4592-98d4-38a40e91a969\") " Sep 09 23:13:46.300790 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.300764 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-bundle" (OuterVolumeSpecName: "bundle") pod "6c458b19-5b0f-4592-98d4-38a40e91a969" (UID: "6c458b19-5b0f-4592-98d4-38a40e91a969"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:46.301872 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.301844 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c458b19-5b0f-4592-98d4-38a40e91a969-kube-api-access-z7g8c" (OuterVolumeSpecName: "kube-api-access-z7g8c") pod "6c458b19-5b0f-4592-98d4-38a40e91a969" (UID: "6c458b19-5b0f-4592-98d4-38a40e91a969"). InnerVolumeSpecName "kube-api-access-z7g8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:46.306218 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.306184 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-util" (OuterVolumeSpecName: "util") pod "6c458b19-5b0f-4592-98d4-38a40e91a969" (UID: "6c458b19-5b0f-4592-98d4-38a40e91a969"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:46.401482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.401447 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:46.401482 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.401484 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7g8c\" (UniqueName: \"kubernetes.io/projected/6c458b19-5b0f-4592-98d4-38a40e91a969-kube-api-access-z7g8c\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:46.401633 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.401498 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c458b19-5b0f-4592-98d4-38a40e91a969-util\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:13:46.583464 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.583432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" event={"ID":"6c458b19-5b0f-4592-98d4-38a40e91a969","Type":"ContainerDied","Data":"348cf5591841757aeb9dcdaf9cdd05e103aaee475c5ff34e147f85952771ed4f"} Sep 09 23:13:46.583464 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.583459 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zshfh" Sep 09 23:13:46.583681 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.583485 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="348cf5591841757aeb9dcdaf9cdd05e103aaee475c5ff34e147f85952771ed4f" Sep 09 23:13:46.585579 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:46.585547 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" event={"ID":"f59580ac-a555-4cfc-b47b-1cc5582f4e07","Type":"ContainerStarted","Data":"6af164bae199f83106958d76d67359f9ac62b67777bd4d7ebeb693a51c182cca"} Sep 09 23:13:47.592481 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:47.592409 2581 generic.go:356] "Generic (PLEG): container finished" podID="f59580ac-a555-4cfc-b47b-1cc5582f4e07" containerID="6af164bae199f83106958d76d67359f9ac62b67777bd4d7ebeb693a51c182cca" exitCode=0 Sep 09 23:13:47.592481 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:47.592470 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" event={"ID":"f59580ac-a555-4cfc-b47b-1cc5582f4e07","Type":"ContainerDied","Data":"6af164bae199f83106958d76d67359f9ac62b67777bd4d7ebeb693a51c182cca"} Sep 09 23:13:48.599504 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:48.599471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" event={"ID":"f59580ac-a555-4cfc-b47b-1cc5582f4e07","Type":"ContainerStarted","Data":"8a6cb7160360239a966c09da59d524e35ccf8eccd778731cbfddaa7c4407d3fe"} Sep 09 23:13:48.599880 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:48.599581 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:13:48.626000 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:48.625956 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" podStartSLOduration=2.173789962 podStartE2EDuration="6.625942931s" totalImagesPullingTime="3.450483205s" totalInitContainerRuntime="1.001669764s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:48.623381366 +0000 UTC m=+261.955456658" watchObservedRunningTime="2026-09-09 23:13:48.625942931 +0000 UTC m=+261.958018223" Sep 09 23:13:59.606032 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:13:59.605954 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-mhr58" Sep 09 23:14:10.996107 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:10.996065 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7"] Sep 09 23:14:10.996567 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:10.996473 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerName="pull" Sep 09 23:14:10.996567 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:10.996488 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerName="pull" Sep 09 23:14:10.996567 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:10.996508 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerName="extract" Sep 09 23:14:10.996567 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:10.996515 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerName="extract" Sep 09 23:14:10.996567 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:10.996526 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerName="util" Sep 09 23:14:10.996567 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:10.996532 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerName="util" Sep 09 23:14:10.996756 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:10.996613 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c458b19-5b0f-4592-98d4-38a40e91a969" containerName="extract" Sep 09 23:14:11.004078 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.004051 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.006664 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.006638 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:14:11.006819 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.006692 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vt9gf\"" Sep 09 23:14:11.007056 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.007039 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:14:11.007493 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.007463 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:14:11.014398 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.014373 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7"] Sep 09 23:14:11.086643 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.086747 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqdh\" (UniqueName: \"kubernetes.io/projected/5f149fdc-f02b-493d-8435-4ceb6102416e-kube-api-access-jvqdh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.086747 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.086747 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.086851 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.086851 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f149fdc-f02b-493d-8435-4ceb6102416e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.086851 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.086940 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.086940 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.086925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187491 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187491 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187649 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187649 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqdh\" (UniqueName: \"kubernetes.io/projected/5f149fdc-f02b-493d-8435-4ceb6102416e-kube-api-access-jvqdh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187812 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187871 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187871 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187844 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187971 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187971 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f149fdc-f02b-493d-8435-4ceb6102416e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.187971 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.187926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.188127 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.188071 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.188242 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.188217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.188441 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.188419 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.188712 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.188694 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f149fdc-f02b-493d-8435-4ceb6102416e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.189817 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.189800 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.190498 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.190481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.206840 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.206809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f149fdc-f02b-493d-8435-4ceb6102416e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.207937 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.207921 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqdh\" (UniqueName: \"kubernetes.io/projected/5f149fdc-f02b-493d-8435-4ceb6102416e-kube-api-access-jvqdh\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7\" (UID: \"5f149fdc-f02b-493d-8435-4ceb6102416e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.317100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.317050 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:11.593893 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.593866 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7"] Sep 09 23:14:11.595882 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:14:11.595856 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f149fdc_f02b_493d_8435_4ceb6102416e.slice/crio-a301126efda504141f39b44f0dcb32877ce1f4c334b58390a26761a4cf8526c3 WatchSource:0}: Error finding container a301126efda504141f39b44f0dcb32877ce1f4c334b58390a26761a4cf8526c3: Status 404 returned error can't find the container with id a301126efda504141f39b44f0dcb32877ce1f4c334b58390a26761a4cf8526c3 Sep 09 23:14:11.715027 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:11.715000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" event={"ID":"5f149fdc-f02b-493d-8435-4ceb6102416e","Type":"ContainerStarted","Data":"a301126efda504141f39b44f0dcb32877ce1f4c334b58390a26761a4cf8526c3"} Sep 09 23:14:12.543678 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.543638 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f4786"] Sep 09 23:14:12.547140 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.547118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:12.549719 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.549628 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 09 23:14:12.549719 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.549628 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m55b5\"" Sep 09 23:14:12.554593 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.554572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f4786"] Sep 09 23:14:12.699917 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.699745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx6tv\" (UniqueName: \"kubernetes.io/projected/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-kube-api-access-gx6tv\") pod \"odh-model-controller-7998c67dc4-f4786\" (UID: \"8f09cc5b-73fb-4ae7-b65c-5078dc925c96\") " pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:12.699917 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.699817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-cert\") pod \"odh-model-controller-7998c67dc4-f4786\" (UID: \"8f09cc5b-73fb-4ae7-b65c-5078dc925c96\") " pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:12.800773 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.800693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx6tv\" (UniqueName: \"kubernetes.io/projected/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-kube-api-access-gx6tv\") pod \"odh-model-controller-7998c67dc4-f4786\" (UID: \"8f09cc5b-73fb-4ae7-b65c-5078dc925c96\") " pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:12.800773 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.800757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-cert\") pod \"odh-model-controller-7998c67dc4-f4786\" (UID: \"8f09cc5b-73fb-4ae7-b65c-5078dc925c96\") " pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:12.800956 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:14:12.800882 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 09 23:14:12.800956 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:14:12.800947 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-cert podName:8f09cc5b-73fb-4ae7-b65c-5078dc925c96 nodeName:}" failed. No retries permitted until 2026-09-09 23:14:13.300926135 +0000 UTC m=+286.633001410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-cert") pod "odh-model-controller-7998c67dc4-f4786" (UID: "8f09cc5b-73fb-4ae7-b65c-5078dc925c96") : secret "odh-model-controller-webhook-cert" not found Sep 09 23:14:12.810020 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:12.809989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx6tv\" (UniqueName: \"kubernetes.io/projected/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-kube-api-access-gx6tv\") pod \"odh-model-controller-7998c67dc4-f4786\" (UID: \"8f09cc5b-73fb-4ae7-b65c-5078dc925c96\") " pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:13.306046 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:13.306000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-cert\") pod \"odh-model-controller-7998c67dc4-f4786\" (UID: \"8f09cc5b-73fb-4ae7-b65c-5078dc925c96\") " pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:13.308686 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:13.308659 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f09cc5b-73fb-4ae7-b65c-5078dc925c96-cert\") pod \"odh-model-controller-7998c67dc4-f4786\" (UID: \"8f09cc5b-73fb-4ae7-b65c-5078dc925c96\") " pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:13.460687 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:13.460649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:14.162608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:14.162566 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:14:14.162964 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:14.162665 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:14:14.162964 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:14.162720 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:14:14.345051 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:14.344969 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f4786"] Sep 09 23:14:14.349187 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:14:14.349148 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f09cc5b_73fb_4ae7_b65c_5078dc925c96.slice/crio-54de4c97dc6e56104512b5ff3a90e80490fb6b6ade7d88151b00cfb51738ded6 WatchSource:0}: Error finding container 54de4c97dc6e56104512b5ff3a90e80490fb6b6ade7d88151b00cfb51738ded6: Status 404 returned error can't find the container with id 54de4c97dc6e56104512b5ff3a90e80490fb6b6ade7d88151b00cfb51738ded6 Sep 09 23:14:14.732744 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:14.732712 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f4786" event={"ID":"8f09cc5b-73fb-4ae7-b65c-5078dc925c96","Type":"ContainerStarted","Data":"54de4c97dc6e56104512b5ff3a90e80490fb6b6ade7d88151b00cfb51738ded6"} Sep 09 23:14:14.734212 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:14.734191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" event={"ID":"5f149fdc-f02b-493d-8435-4ceb6102416e","Type":"ContainerStarted","Data":"e63d096dac1d32ef185214fc6d4e64a603d88f8c27797d394605b007fa4e9d28"} Sep 09 23:14:14.753542 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:14.753497 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" podStartSLOduration=2.189023283 podStartE2EDuration="4.753482402s" totalImagesPullingTime="2.564459119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:14.752512836 +0000 UTC m=+288.084588127" watchObservedRunningTime="2026-09-09 23:14:14.753482402 +0000 UTC m=+288.085557696" Sep 09 23:14:15.317197 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:15.317162 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:15.323111 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:15.323084 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:15.739894 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:15.739861 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:15.740761 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:15.740738 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7" Sep 09 23:14:17.752729 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:17.752688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f4786" event={"ID":"8f09cc5b-73fb-4ae7-b65c-5078dc925c96","Type":"ContainerStarted","Data":"0c667590a382030fa740931022dee9ad340d440b06eb0c9518358ae303906ebe"} Sep 09 23:14:17.768602 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:17.768556 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-f4786" podStartSLOduration=3.151706703 podStartE2EDuration="5.768542174s" totalImagesPullingTime="2.616835471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:17.767397083 +0000 UTC m=+291.099472394" watchObservedRunningTime="2026-09-09 23:14:17.768542174 +0000 UTC m=+291.100617464" Sep 09 23:14:18.757780 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:18.757750 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:20.355183 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.355144 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f"] Sep 09 23:14:20.358607 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.358584 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.361498 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.361471 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:14:20.361609 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.361471 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:14:20.361609 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.361522 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:14:20.361609 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.361539 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d9pg5\"" Sep 09 23:14:20.367493 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.367471 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f"] Sep 09 23:14:20.465599 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.465568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-metrics-cert\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.465716 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.465606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-manager-config\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.465716 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.465635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkps\" (UniqueName: \"kubernetes.io/projected/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-kube-api-access-phkps\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.465789 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.465745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-cert\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.566173 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.566148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-cert\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.566300 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.566193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-metrics-cert\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.566300 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.566213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-manager-config\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.566300 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.566242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkps\" (UniqueName: \"kubernetes.io/projected/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-kube-api-access-phkps\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.566938 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.566915 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-manager-config\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.568543 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.568515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-cert\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.568670 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.568650 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-metrics-cert\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.578966 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.578944 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkps\" (UniqueName: \"kubernetes.io/projected/ab8a8c92-5d46-4e8d-8ba9-f6d78a030335-kube-api-access-phkps\") pod \"lws-controller-manager-6996bb7bf7-qqj4f\" (UID: \"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335\") " pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.670680 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.670609 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:20.941048 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:20.941023 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f"] Sep 09 23:14:20.943031 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:14:20.943001 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8a8c92_5d46_4e8d_8ba9_f6d78a030335.slice/crio-3fcd1b602a0bb88270dce1643f6d8d3cf21ea1fd38505929c04f8e29de829b66 WatchSource:0}: Error finding container 3fcd1b602a0bb88270dce1643f6d8d3cf21ea1fd38505929c04f8e29de829b66: Status 404 returned error can't find the container with id 3fcd1b602a0bb88270dce1643f6d8d3cf21ea1fd38505929c04f8e29de829b66 Sep 09 23:14:21.776157 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:21.776105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" event={"ID":"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335","Type":"ContainerStarted","Data":"3fcd1b602a0bb88270dce1643f6d8d3cf21ea1fd38505929c04f8e29de829b66"} Sep 09 23:14:22.399725 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.399650 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5"] Sep 09 23:14:22.402754 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.402737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:22.405207 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.405184 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pkrxk\"" Sep 09 23:14:22.405714 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.405697 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 09 23:14:22.419417 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.419393 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5"] Sep 09 23:14:22.588940 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.588898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17fb0ec4-89b3-41cb-b592-020b25cba975-cert\") pod \"kserve-controller-manager-d6f4b65b8-xz4l5\" (UID: \"17fb0ec4-89b3-41cb-b592-020b25cba975\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:22.589134 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.589009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl5rt\" (UniqueName: \"kubernetes.io/projected/17fb0ec4-89b3-41cb-b592-020b25cba975-kube-api-access-rl5rt\") pod \"kserve-controller-manager-d6f4b65b8-xz4l5\" (UID: \"17fb0ec4-89b3-41cb-b592-020b25cba975\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:22.690352 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.690268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17fb0ec4-89b3-41cb-b592-020b25cba975-cert\") pod \"kserve-controller-manager-d6f4b65b8-xz4l5\" (UID: \"17fb0ec4-89b3-41cb-b592-020b25cba975\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:22.690475 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.690357 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl5rt\" (UniqueName: \"kubernetes.io/projected/17fb0ec4-89b3-41cb-b592-020b25cba975-kube-api-access-rl5rt\") pod \"kserve-controller-manager-d6f4b65b8-xz4l5\" (UID: \"17fb0ec4-89b3-41cb-b592-020b25cba975\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:22.690475 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:14:22.690433 2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 09 23:14:22.690583 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:14:22.690510 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17fb0ec4-89b3-41cb-b592-020b25cba975-cert podName:17fb0ec4-89b3-41cb-b592-020b25cba975 nodeName:}" failed. No retries permitted until 2026-09-09 23:14:23.19048825 +0000 UTC m=+296.522563529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/17fb0ec4-89b3-41cb-b592-020b25cba975-cert") pod "kserve-controller-manager-d6f4b65b8-xz4l5" (UID: "17fb0ec4-89b3-41cb-b592-020b25cba975") : secret "kserve-webhook-server-cert" not found Sep 09 23:14:22.712938 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.712908 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl5rt\" (UniqueName: \"kubernetes.io/projected/17fb0ec4-89b3-41cb-b592-020b25cba975-kube-api-access-rl5rt\") pod \"kserve-controller-manager-d6f4b65b8-xz4l5\" (UID: \"17fb0ec4-89b3-41cb-b592-020b25cba975\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:22.784688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.784661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" event={"ID":"ab8a8c92-5d46-4e8d-8ba9-f6d78a030335","Type":"ContainerStarted","Data":"2562dd5b7f540e591a6e8f4b0c5f3d3b97cdbfd7f5347e773cd8e510e86a0609"} Sep 09 23:14:22.785015 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.784769 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:22.809665 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:22.809624 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" podStartSLOduration=1.662715572 podStartE2EDuration="2.809595926s" totalImagesPullingTime="1.146880354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:22.807402217 +0000 UTC m=+296.139477498" watchObservedRunningTime="2026-09-09 23:14:22.809595926 +0000 UTC m=+296.141671216" Sep 09 23:14:23.194356 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:23.194331 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17fb0ec4-89b3-41cb-b592-020b25cba975-cert\") pod \"kserve-controller-manager-d6f4b65b8-xz4l5\" (UID: \"17fb0ec4-89b3-41cb-b592-020b25cba975\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:23.196609 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:23.196589 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17fb0ec4-89b3-41cb-b592-020b25cba975-cert\") pod \"kserve-controller-manager-d6f4b65b8-xz4l5\" (UID: \"17fb0ec4-89b3-41cb-b592-020b25cba975\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:23.313477 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:23.313452 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:23.614813 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:14:23.614775 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fb0ec4_89b3_41cb_b592_020b25cba975.slice/crio-3ff64ead40047b3a6e55229f8a707f049d28291f54e673894e2c025fbcfcedb2 WatchSource:0}: Error finding container 3ff64ead40047b3a6e55229f8a707f049d28291f54e673894e2c025fbcfcedb2: Status 404 returned error can't find the container with id 3ff64ead40047b3a6e55229f8a707f049d28291f54e673894e2c025fbcfcedb2 Sep 09 23:14:23.616522 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:23.616498 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5"] Sep 09 23:14:23.791144 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:23.791115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" event={"ID":"17fb0ec4-89b3-41cb-b592-020b25cba975","Type":"ContainerStarted","Data":"3ff64ead40047b3a6e55229f8a707f049d28291f54e673894e2c025fbcfcedb2"} Sep 09 23:14:26.811210 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:26.811169 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" event={"ID":"17fb0ec4-89b3-41cb-b592-020b25cba975","Type":"ContainerStarted","Data":"512a48a31c7abe3034498b0335849331b508a0be2d2559691884f26b2b39f656"} Sep 09 23:14:26.811632 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:26.811355 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:14:26.832991 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:26.832938 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" podStartSLOduration=2.278899106 podStartE2EDuration="4.832922084s" totalImagesPullingTime="2.554022978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:26.83078505 +0000 UTC m=+300.162860343" watchObservedRunningTime="2026-09-09 23:14:26.832922084 +0000 UTC m=+300.164997374" Sep 09 23:14:27.049046 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:27.049022 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:14:29.764793 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:29.764766 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-f4786" Sep 09 23:14:33.793691 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:33.793660 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6996bb7bf7-qqj4f" Sep 09 23:14:57.821682 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:14:57.821654 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xz4l5" Sep 09 23:15:17.197597 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.197561 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j"] Sep 09 23:15:17.202801 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.202782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.205054 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.205016 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:15:17.205178 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.205061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mf4vc\"" Sep 09 23:15:17.205178 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.205093 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:15:17.208834 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.208807 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j"] Sep 09 23:15:17.301004 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.300981 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm"] Sep 09 23:15:17.304046 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.304029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.313857 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.313834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm"] Sep 09 23:15:17.317502 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.317479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g67j5\" (UniqueName: \"kubernetes.io/projected/f19b4051-259b-4634-a414-b4c18db69486-kube-api-access-g67j5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.317659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.317638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.317792 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.317673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.386636 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.386615 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87"] Sep 09 23:15:17.391117 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.391091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.399598 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.399568 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87"] Sep 09 23:15:17.418577 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.418557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.418672 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.418589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.418672 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.418618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nmzv\" (UniqueName: \"kubernetes.io/projected/914cb885-6f37-429d-9ac6-1e6fc4787be3-kube-api-access-4nmzv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.418672 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.418640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.418786 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.418685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.418786 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.418766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g67j5\" (UniqueName: \"kubernetes.io/projected/f19b4051-259b-4634-a414-b4c18db69486-kube-api-access-g67j5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.418990 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.418968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.419028 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.418985 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.425979 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.425961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g67j5\" (UniqueName: \"kubernetes.io/projected/f19b4051-259b-4634-a414-b4c18db69486-kube-api-access-g67j5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.488478 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.488457 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h"] Sep 09 23:15:17.491105 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.491090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.499515 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.499495 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h"] Sep 09 23:15:17.514064 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.514046 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:17.519981 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.519957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r99w9\" (UniqueName: \"kubernetes.io/projected/3d1e3227-0094-44e2-8b95-5884d66d2c84-kube-api-access-r99w9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.520081 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.519988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.520081 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.520021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nmzv\" (UniqueName: \"kubernetes.io/projected/914cb885-6f37-429d-9ac6-1e6fc4787be3-kube-api-access-4nmzv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.520081 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.520058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.520258 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.520087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.520258 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.520153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.520404 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.520391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.520459 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.520432 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.527663 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.527642 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nmzv\" (UniqueName: \"kubernetes.io/projected/914cb885-6f37-429d-9ac6-1e6fc4787be3-kube-api-access-4nmzv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.618358 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.618329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:17.620761 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.620610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.620761 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.620668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r99w9\" (UniqueName: \"kubernetes.io/projected/3d1e3227-0094-44e2-8b95-5884d66d2c84-kube-api-access-r99w9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.620761 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.620729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.620918 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.620797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.620918 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.620849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.621035 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.620945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd5xg\" (UniqueName: \"kubernetes.io/projected/af2293d9-5150-43f1-88c0-bd23670ae4d5-kube-api-access-rd5xg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.621089 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.621071 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.621197 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.621181 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.629053 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.629033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r99w9\" (UniqueName: \"kubernetes.io/projected/3d1e3227-0094-44e2-8b95-5884d66d2c84-kube-api-access-r99w9\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.703638 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.703608 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:17.721584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.721550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.721691 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.721671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd5xg\" (UniqueName: \"kubernetes.io/projected/af2293d9-5150-43f1-88c0-bd23670ae4d5-kube-api-access-rd5xg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.721750 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.721731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.721942 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.721916 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.722038 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.722010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.730190 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.730167 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd5xg\" (UniqueName: \"kubernetes.io/projected/af2293d9-5150-43f1-88c0-bd23670ae4d5-kube-api-access-rd5xg\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.784045 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.784018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j"] Sep 09 23:15:17.785953 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:15:17.785928 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19b4051_259b_4634_a414_b4c18db69486.slice/crio-f37788695010bee9b712048df259472c07eed2c7e24ca522848e1e95abc121fb WatchSource:0}: Error finding container f37788695010bee9b712048df259472c07eed2c7e24ca522848e1e95abc121fb: Status 404 returned error can't find the container with id f37788695010bee9b712048df259472c07eed2c7e24ca522848e1e95abc121fb Sep 09 23:15:17.800613 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.800597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:17.888270 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.888245 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm"] Sep 09 23:15:17.893535 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:15:17.890661 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914cb885_6f37_429d_9ac6_1e6fc4787be3.slice/crio-2c6f2d55f6b35cb16d1ef23de732484b7485c32bbae07ee52a3e6c5c96c2ec3f WatchSource:0}: Error finding container 2c6f2d55f6b35cb16d1ef23de732484b7485c32bbae07ee52a3e6c5c96c2ec3f: Status 404 returned error can't find the container with id 2c6f2d55f6b35cb16d1ef23de732484b7485c32bbae07ee52a3e6c5c96c2ec3f Sep 09 23:15:17.972494 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:17.972471 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87"] Sep 09 23:15:17.973722 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:15:17.973700 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1e3227_0094_44e2_8b95_5884d66d2c84.slice/crio-ad859303b7f8df5405a638e1988d011329c5808ed44eb353cf799162d8452abe WatchSource:0}: Error finding container ad859303b7f8df5405a638e1988d011329c5808ed44eb353cf799162d8452abe: Status 404 returned error can't find the container with id ad859303b7f8df5405a638e1988d011329c5808ed44eb353cf799162d8452abe Sep 09 23:15:18.072167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.072142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h"] Sep 09 23:15:18.088567 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.088541 2581 generic.go:356] "Generic (PLEG): container finished" podID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerID="9124c09fcf2b8caad6c8d12e4e980b4f22ffb8519bfe65d0b924e4229dd1189a" exitCode=0 Sep 09 23:15:18.088673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.088605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" event={"ID":"914cb885-6f37-429d-9ac6-1e6fc4787be3","Type":"ContainerDied","Data":"9124c09fcf2b8caad6c8d12e4e980b4f22ffb8519bfe65d0b924e4229dd1189a"} Sep 09 23:15:18.088673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.088661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" event={"ID":"914cb885-6f37-429d-9ac6-1e6fc4787be3","Type":"ContainerStarted","Data":"2c6f2d55f6b35cb16d1ef23de732484b7485c32bbae07ee52a3e6c5c96c2ec3f"} Sep 09 23:15:18.089752 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.089731 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:15:18.090355 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.090303 2581 generic.go:356] "Generic (PLEG): container finished" podID="f19b4051-259b-4634-a414-b4c18db69486" containerID="927c4cc0a27f6369e22a10319e91edcfb373c1a44d02efc3312339e28931ccf0" exitCode=0 Sep 09 23:15:18.090455 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.090348 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" event={"ID":"f19b4051-259b-4634-a414-b4c18db69486","Type":"ContainerDied","Data":"927c4cc0a27f6369e22a10319e91edcfb373c1a44d02efc3312339e28931ccf0"} Sep 09 23:15:18.090455 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.090393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" event={"ID":"f19b4051-259b-4634-a414-b4c18db69486","Type":"ContainerStarted","Data":"f37788695010bee9b712048df259472c07eed2c7e24ca522848e1e95abc121fb"} Sep 09 23:15:18.092093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.092073 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerID="285e6bd1ca024448265ec6e14135dad86b9ec58371dc15e0a1579794dd95a5e6" exitCode=0 Sep 09 23:15:18.092200 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.092140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" event={"ID":"3d1e3227-0094-44e2-8b95-5884d66d2c84","Type":"ContainerDied","Data":"285e6bd1ca024448265ec6e14135dad86b9ec58371dc15e0a1579794dd95a5e6"} Sep 09 23:15:18.092200 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:18.092186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" event={"ID":"3d1e3227-0094-44e2-8b95-5884d66d2c84","Type":"ContainerStarted","Data":"ad859303b7f8df5405a638e1988d011329c5808ed44eb353cf799162d8452abe"} Sep 09 23:15:18.108406 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:15:18.108383 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2293d9_5150_43f1_88c0_bd23670ae4d5.slice/crio-2ca01298f2c125939cf5f38736a15a15e221958a1d71e74a755857f27f1a5805 WatchSource:0}: Error finding container 2ca01298f2c125939cf5f38736a15a15e221958a1d71e74a755857f27f1a5805: Status 404 returned error can't find the container with id 2ca01298f2c125939cf5f38736a15a15e221958a1d71e74a755857f27f1a5805 Sep 09 23:15:19.098902 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.098877 2581 generic.go:356] "Generic (PLEG): container finished" podID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerID="269c638f50f9e6b6ac1d6a4fdaea24888e846f5c61c26e9685e1aa7dd9c59de3" exitCode=0 Sep 09 23:15:19.099208 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.098947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" event={"ID":"914cb885-6f37-429d-9ac6-1e6fc4787be3","Type":"ContainerDied","Data":"269c638f50f9e6b6ac1d6a4fdaea24888e846f5c61c26e9685e1aa7dd9c59de3"} Sep 09 23:15:19.100991 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.100973 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" event={"ID":"f19b4051-259b-4634-a414-b4c18db69486","Type":"ContainerDied","Data":"cd30ee89a31021a722a6df3df188abcfbb1cc1b7b704dcd53f59aaa284a43022"} Sep 09 23:15:19.102187 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.100955 2581 generic.go:356] "Generic (PLEG): container finished" podID="f19b4051-259b-4634-a414-b4c18db69486" containerID="cd30ee89a31021a722a6df3df188abcfbb1cc1b7b704dcd53f59aaa284a43022" exitCode=0 Sep 09 23:15:19.109929 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.109897 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerID="4d64819aee09f42818f98b1c7538f182340022e83985ae63b9ea26d99202b781" exitCode=0 Sep 09 23:15:19.110021 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.109977 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" event={"ID":"3d1e3227-0094-44e2-8b95-5884d66d2c84","Type":"ContainerDied","Data":"4d64819aee09f42818f98b1c7538f182340022e83985ae63b9ea26d99202b781"} Sep 09 23:15:19.111952 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.111930 2581 generic.go:356] "Generic (PLEG): container finished" podID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerID="a096ef0619f1a4316f4d4877898d25240088d829bcc2c74bbfd59699c603fd10" exitCode=0 Sep 09 23:15:19.112039 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.111969 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" event={"ID":"af2293d9-5150-43f1-88c0-bd23670ae4d5","Type":"ContainerDied","Data":"a096ef0619f1a4316f4d4877898d25240088d829bcc2c74bbfd59699c603fd10"} Sep 09 23:15:19.112039 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:19.112004 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" event={"ID":"af2293d9-5150-43f1-88c0-bd23670ae4d5","Type":"ContainerStarted","Data":"2ca01298f2c125939cf5f38736a15a15e221958a1d71e74a755857f27f1a5805"} Sep 09 23:15:20.119414 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:20.119382 2581 generic.go:356] "Generic (PLEG): container finished" podID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerID="8901d492964e7d8cab95361fe2d97e9fe7baef989eb732608ffe436c3f3dc9f1" exitCode=0 Sep 09 23:15:20.119796 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:20.119469 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" event={"ID":"af2293d9-5150-43f1-88c0-bd23670ae4d5","Type":"ContainerDied","Data":"8901d492964e7d8cab95361fe2d97e9fe7baef989eb732608ffe436c3f3dc9f1"} Sep 09 23:15:20.122158 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:20.122123 2581 generic.go:356] "Generic (PLEG): container finished" podID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerID="9ed8bfff67b8b45fde3e2bbd9e85f1387c655a50119a2986d81d58816e3d636d" exitCode=0 Sep 09 23:15:20.122271 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:20.122174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" event={"ID":"914cb885-6f37-429d-9ac6-1e6fc4787be3","Type":"ContainerDied","Data":"9ed8bfff67b8b45fde3e2bbd9e85f1387c655a50119a2986d81d58816e3d636d"} Sep 09 23:15:20.124698 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:20.124676 2581 generic.go:356] "Generic (PLEG): container finished" podID="f19b4051-259b-4634-a414-b4c18db69486" containerID="b7853dc5afb05af2a2b8df8abf0988dff801802df047fef98b5e68dd331e3c5c" exitCode=0 Sep 09 23:15:20.124862 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:20.124768 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" event={"ID":"f19b4051-259b-4634-a414-b4c18db69486","Type":"ContainerDied","Data":"b7853dc5afb05af2a2b8df8abf0988dff801802df047fef98b5e68dd331e3c5c"} Sep 09 23:15:20.127137 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:20.127111 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerID="08cddd44260d12a9407fd2acd7c9623530388c9d5f7c372c5e49ce3f9d47be1e" exitCode=0 Sep 09 23:15:20.127238 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:20.127193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" event={"ID":"3d1e3227-0094-44e2-8b95-5884d66d2c84","Type":"ContainerDied","Data":"08cddd44260d12a9407fd2acd7c9623530388c9d5f7c372c5e49ce3f9d47be1e"} Sep 09 23:15:21.137503 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.137457 2581 generic.go:356] "Generic (PLEG): container finished" podID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerID="8ddd371ab5487b51364dffeb494b4ccc74ef11eec8c69d5db49a4b6e997d341e" exitCode=0 Sep 09 23:15:21.137957 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.137560 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" event={"ID":"af2293d9-5150-43f1-88c0-bd23670ae4d5","Type":"ContainerDied","Data":"8ddd371ab5487b51364dffeb494b4ccc74ef11eec8c69d5db49a4b6e997d341e"} Sep 09 23:15:21.285585 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.285561 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:21.340894 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.340873 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:21.343975 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.343955 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:21.453147 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453064 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-bundle\") pod \"f19b4051-259b-4634-a414-b4c18db69486\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " Sep 09 23:15:21.453147 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453105 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-bundle\") pod \"914cb885-6f37-429d-9ac6-1e6fc4787be3\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " Sep 09 23:15:21.453147 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453126 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nmzv\" (UniqueName: \"kubernetes.io/projected/914cb885-6f37-429d-9ac6-1e6fc4787be3-kube-api-access-4nmzv\") pod \"914cb885-6f37-429d-9ac6-1e6fc4787be3\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " Sep 09 23:15:21.453465 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453161 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-util\") pod \"f19b4051-259b-4634-a414-b4c18db69486\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " Sep 09 23:15:21.453465 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453176 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r99w9\" (UniqueName: \"kubernetes.io/projected/3d1e3227-0094-44e2-8b95-5884d66d2c84-kube-api-access-r99w9\") pod \"3d1e3227-0094-44e2-8b95-5884d66d2c84\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " Sep 09 23:15:21.453465 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453197 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-util\") pod \"3d1e3227-0094-44e2-8b95-5884d66d2c84\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " Sep 09 23:15:21.453465 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453215 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g67j5\" (UniqueName: \"kubernetes.io/projected/f19b4051-259b-4634-a414-b4c18db69486-kube-api-access-g67j5\") pod \"f19b4051-259b-4634-a414-b4c18db69486\" (UID: \"f19b4051-259b-4634-a414-b4c18db69486\") " Sep 09 23:15:21.453465 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453228 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-util\") pod \"914cb885-6f37-429d-9ac6-1e6fc4787be3\" (UID: \"914cb885-6f37-429d-9ac6-1e6fc4787be3\") " Sep 09 23:15:21.453465 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453259 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-bundle\") pod \"3d1e3227-0094-44e2-8b95-5884d66d2c84\" (UID: \"3d1e3227-0094-44e2-8b95-5884d66d2c84\") " Sep 09 23:15:21.454046 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.453999 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-bundle" (OuterVolumeSpecName: "bundle") pod "914cb885-6f37-429d-9ac6-1e6fc4787be3" (UID: "914cb885-6f37-429d-9ac6-1e6fc4787be3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:21.454124 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.454085 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-bundle" (OuterVolumeSpecName: "bundle") pod "f19b4051-259b-4634-a414-b4c18db69486" (UID: "f19b4051-259b-4634-a414-b4c18db69486"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:21.454124 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.454075 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-bundle" (OuterVolumeSpecName: "bundle") pod "3d1e3227-0094-44e2-8b95-5884d66d2c84" (UID: "3d1e3227-0094-44e2-8b95-5884d66d2c84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:21.455993 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.455960 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914cb885-6f37-429d-9ac6-1e6fc4787be3-kube-api-access-4nmzv" (OuterVolumeSpecName: "kube-api-access-4nmzv") pod "914cb885-6f37-429d-9ac6-1e6fc4787be3" (UID: "914cb885-6f37-429d-9ac6-1e6fc4787be3"). InnerVolumeSpecName "kube-api-access-4nmzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:21.455993 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.455979 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19b4051-259b-4634-a414-b4c18db69486-kube-api-access-g67j5" (OuterVolumeSpecName: "kube-api-access-g67j5") pod "f19b4051-259b-4634-a414-b4c18db69486" (UID: "f19b4051-259b-4634-a414-b4c18db69486"). InnerVolumeSpecName "kube-api-access-g67j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:21.456121 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.456022 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1e3227-0094-44e2-8b95-5884d66d2c84-kube-api-access-r99w9" (OuterVolumeSpecName: "kube-api-access-r99w9") pod "3d1e3227-0094-44e2-8b95-5884d66d2c84" (UID: "3d1e3227-0094-44e2-8b95-5884d66d2c84"). InnerVolumeSpecName "kube-api-access-r99w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:21.459172 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.459140 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-util" (OuterVolumeSpecName: "util") pod "f19b4051-259b-4634-a414-b4c18db69486" (UID: "f19b4051-259b-4634-a414-b4c18db69486"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:21.461360 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.461337 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-util" (OuterVolumeSpecName: "util") pod "3d1e3227-0094-44e2-8b95-5884d66d2c84" (UID: "3d1e3227-0094-44e2-8b95-5884d66d2c84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:21.462367 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.462347 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-util" (OuterVolumeSpecName: "util") pod "914cb885-6f37-429d-9ac6-1e6fc4787be3" (UID: "914cb885-6f37-429d-9ac6-1e6fc4787be3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:21.554082 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554056 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-util\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:21.554167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554085 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r99w9\" (UniqueName: \"kubernetes.io/projected/3d1e3227-0094-44e2-8b95-5884d66d2c84-kube-api-access-r99w9\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:21.554167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554100 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-util\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:21.554167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554108 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g67j5\" (UniqueName: \"kubernetes.io/projected/f19b4051-259b-4634-a414-b4c18db69486-kube-api-access-g67j5\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:21.554167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554116 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-util\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:21.554167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554124 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d1e3227-0094-44e2-8b95-5884d66d2c84-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:21.554167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554134 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f19b4051-259b-4634-a414-b4c18db69486-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:21.554167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554141 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914cb885-6f37-429d-9ac6-1e6fc4787be3-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:21.554167 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:21.554148 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nmzv\" (UniqueName: \"kubernetes.io/projected/914cb885-6f37-429d-9ac6-1e6fc4787be3-kube-api-access-4nmzv\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:22.146437 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.146399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" event={"ID":"914cb885-6f37-429d-9ac6-1e6fc4787be3","Type":"ContainerDied","Data":"2c6f2d55f6b35cb16d1ef23de732484b7485c32bbae07ee52a3e6c5c96c2ec3f"} Sep 09 23:15:22.146820 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.146409 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7k86sm" Sep 09 23:15:22.146820 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.146490 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c6f2d55f6b35cb16d1ef23de732484b7485c32bbae07ee52a3e6c5c96c2ec3f" Sep 09 23:15:22.148623 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.148592 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" Sep 09 23:15:22.148623 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.148612 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a9nl6j" event={"ID":"f19b4051-259b-4634-a414-b4c18db69486","Type":"ContainerDied","Data":"f37788695010bee9b712048df259472c07eed2c7e24ca522848e1e95abc121fb"} Sep 09 23:15:22.148825 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.148649 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f37788695010bee9b712048df259472c07eed2c7e24ca522848e1e95abc121fb" Sep 09 23:15:22.151128 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.151104 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" Sep 09 23:15:22.151128 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.151114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxjl87" event={"ID":"3d1e3227-0094-44e2-8b95-5884d66d2c84","Type":"ContainerDied","Data":"ad859303b7f8df5405a638e1988d011329c5808ed44eb353cf799162d8452abe"} Sep 09 23:15:22.151303 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.151163 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad859303b7f8df5405a638e1988d011329c5808ed44eb353cf799162d8452abe" Sep 09 23:15:22.284435 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.284411 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:22.359156 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.359129 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-bundle\") pod \"af2293d9-5150-43f1-88c0-bd23670ae4d5\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " Sep 09 23:15:22.359270 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.359169 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd5xg\" (UniqueName: \"kubernetes.io/projected/af2293d9-5150-43f1-88c0-bd23670ae4d5-kube-api-access-rd5xg\") pod \"af2293d9-5150-43f1-88c0-bd23670ae4d5\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " Sep 09 23:15:22.359270 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.359212 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-util\") pod \"af2293d9-5150-43f1-88c0-bd23670ae4d5\" (UID: \"af2293d9-5150-43f1-88c0-bd23670ae4d5\") " Sep 09 23:15:22.359620 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.359597 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-bundle" (OuterVolumeSpecName: "bundle") pod "af2293d9-5150-43f1-88c0-bd23670ae4d5" (UID: "af2293d9-5150-43f1-88c0-bd23670ae4d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:22.361274 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.361256 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2293d9-5150-43f1-88c0-bd23670ae4d5-kube-api-access-rd5xg" (OuterVolumeSpecName: "kube-api-access-rd5xg") pod "af2293d9-5150-43f1-88c0-bd23670ae4d5" (UID: "af2293d9-5150-43f1-88c0-bd23670ae4d5"). InnerVolumeSpecName "kube-api-access-rd5xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:22.364499 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.364479 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-util" (OuterVolumeSpecName: "util") pod "af2293d9-5150-43f1-88c0-bd23670ae4d5" (UID: "af2293d9-5150-43f1-88c0-bd23670ae4d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:22.460201 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.460152 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:22.460201 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.460173 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd5xg\" (UniqueName: \"kubernetes.io/projected/af2293d9-5150-43f1-88c0-bd23670ae4d5-kube-api-access-rd5xg\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:22.460201 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:22.460183 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af2293d9-5150-43f1-88c0-bd23670ae4d5-util\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:23.159510 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:23.159480 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" Sep 09 23:15:23.159510 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:23.159493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zsf5h" event={"ID":"af2293d9-5150-43f1-88c0-bd23670ae4d5","Type":"ContainerDied","Data":"2ca01298f2c125939cf5f38736a15a15e221958a1d71e74a755857f27f1a5805"} Sep 09 23:15:23.159909 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:23.159547 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ca01298f2c125939cf5f38736a15a15e221958a1d71e74a755857f27f1a5805" Sep 09 23:15:53.399659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.399628 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj"] Sep 09 23:15:53.400113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400063 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19b4051-259b-4634-a414-b4c18db69486" containerName="pull" Sep 09 23:15:53.400113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400083 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19b4051-259b-4634-a414-b4c18db69486" containerName="pull" Sep 09 23:15:53.400113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400100 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerName="pull" Sep 09 23:15:53.400113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400109 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerName="pull" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400118 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19b4051-259b-4634-a414-b4c18db69486" containerName="extract" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400135 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19b4051-259b-4634-a414-b4c18db69486" containerName="extract" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400143 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerName="extract" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400148 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerName="extract" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400155 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerName="extract" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400160 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerName="extract" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400169 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerName="util" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400174 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerName="util" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400182 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerName="pull" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400186 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerName="pull" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400192 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerName="pull" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400197 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerName="pull" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400205 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19b4051-259b-4634-a414-b4c18db69486" containerName="util" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400210 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19b4051-259b-4634-a414-b4c18db69486" containerName="util" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400214 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerName="util" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400218 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerName="util" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400225 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerName="util" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400229 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerName="util" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400238 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerName="extract" Sep 09 23:15:53.400260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400242 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerName="extract" Sep 09 23:15:53.400848 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400326 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f19b4051-259b-4634-a414-b4c18db69486" containerName="extract" Sep 09 23:15:53.400848 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400338 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="914cb885-6f37-429d-9ac6-1e6fc4787be3" containerName="extract" Sep 09 23:15:53.400848 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400345 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2293d9-5150-43f1-88c0-bd23670ae4d5" containerName="extract" Sep 09 23:15:53.400848 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.400350 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d1e3227-0094-44e2-8b95-5884d66d2c84" containerName="extract" Sep 09 23:15:53.403170 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.403155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:53.405726 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.405699 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:15:53.405852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.405776 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:15:53.406095 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.406076 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsgxv\"" Sep 09 23:15:53.418708 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.418688 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj"] Sep 09 23:15:53.499955 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.499931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6mvf\" (UniqueName: \"kubernetes.io/projected/d72cb130-ebb1-4376-a44d-9934444be5c6-kube-api-access-t6mvf\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" (UID: \"d72cb130-ebb1-4376-a44d-9934444be5c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:53.500085 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.499976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72cb130-ebb1-4376-a44d-9934444be5c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" (UID: \"d72cb130-ebb1-4376-a44d-9934444be5c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:53.600802 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.600776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6mvf\" (UniqueName: \"kubernetes.io/projected/d72cb130-ebb1-4376-a44d-9934444be5c6-kube-api-access-t6mvf\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" (UID: \"d72cb130-ebb1-4376-a44d-9934444be5c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:53.600906 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.600824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72cb130-ebb1-4376-a44d-9934444be5c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" (UID: \"d72cb130-ebb1-4376-a44d-9934444be5c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:53.601109 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.601094 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72cb130-ebb1-4376-a44d-9934444be5c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" (UID: \"d72cb130-ebb1-4376-a44d-9934444be5c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:53.619503 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.619483 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6mvf\" (UniqueName: \"kubernetes.io/projected/d72cb130-ebb1-4376-a44d-9934444be5c6-kube-api-access-t6mvf\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" (UID: \"d72cb130-ebb1-4376-a44d-9934444be5c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:53.718995 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:53.718966 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:54.014418 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.014387 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj"] Sep 09 23:15:54.015954 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:15:54.015930 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72cb130_ebb1_4376_a44d_9934444be5c6.slice/crio-010268d1dcee6a3888b2b64fe2e14b612c195a482f965098cbff3952b4477747 WatchSource:0}: Error finding container 010268d1dcee6a3888b2b64fe2e14b612c195a482f965098cbff3952b4477747: Status 404 returned error can't find the container with id 010268d1dcee6a3888b2b64fe2e14b612c195a482f965098cbff3952b4477747 Sep 09 23:15:54.325940 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.325870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" event={"ID":"d72cb130-ebb1-4376-a44d-9934444be5c6","Type":"ContainerStarted","Data":"010268d1dcee6a3888b2b64fe2e14b612c195a482f965098cbff3952b4477747"} Sep 09 23:15:54.458398 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.458371 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj"] Sep 09 23:15:54.468936 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.468914 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj"] Sep 09 23:15:54.484691 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.484665 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq"] Sep 09 23:15:54.489598 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.489569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:54.501834 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.501814 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq"] Sep 09 23:15:54.507946 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.507925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5hbb\" (UniqueName: \"kubernetes.io/projected/1b0291d2-627c-4c43-9e9b-37e5ff05391b-kube-api-access-c5hbb\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lhjjq\" (UID: \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:54.508064 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.507978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0291d2-627c-4c43-9e9b-37e5ff05391b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lhjjq\" (UID: \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:54.609539 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.609138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5hbb\" (UniqueName: \"kubernetes.io/projected/1b0291d2-627c-4c43-9e9b-37e5ff05391b-kube-api-access-c5hbb\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lhjjq\" (UID: \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:54.609539 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.609237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0291d2-627c-4c43-9e9b-37e5ff05391b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lhjjq\" (UID: \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:54.609753 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.609683 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0291d2-627c-4c43-9e9b-37e5ff05391b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lhjjq\" (UID: \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:54.617892 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.617859 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5hbb\" (UniqueName: \"kubernetes.io/projected/1b0291d2-627c-4c43-9e9b-37e5ff05391b-kube-api-access-c5hbb\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lhjjq\" (UID: \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:54.801262 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:54.801227 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:55.107737 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:55.107610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq"] Sep 09 23:15:55.111147 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:15:55.111112 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0291d2_627c_4c43_9e9b_37e5ff05391b.slice/crio-a957839c5939864359b26fd39a1a4a68b6b372df46ae1c719da37b39d771b2ba WatchSource:0}: Error finding container a957839c5939864359b26fd39a1a4a68b6b372df46ae1c719da37b39d771b2ba: Status 404 returned error can't find the container with id a957839c5939864359b26fd39a1a4a68b6b372df46ae1c719da37b39d771b2ba Sep 09 23:15:55.335141 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:55.335100 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" event={"ID":"1b0291d2-627c-4c43-9e9b-37e5ff05391b","Type":"ContainerStarted","Data":"a957839c5939864359b26fd39a1a4a68b6b372df46ae1c719da37b39d771b2ba"} Sep 09 23:15:59.366839 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.366803 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" containerName="manager" containerID="cri-o://82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9" gracePeriod=2 Sep 09 23:15:59.368773 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.368744 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" event={"ID":"1b0291d2-627c-4c43-9e9b-37e5ff05391b","Type":"ContainerStarted","Data":"d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599"} Sep 09 23:15:59.368905 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.368807 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:15:59.368954 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:15:59.368898 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" is forbidden: User \"system:node:ip-10-0-137-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-106.ec2.internal' and this object" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:59.370653 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:15:59.370625 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" is forbidden: User \"system:node:ip-10-0-137-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-106.ec2.internal' and this object" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:59.391946 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.391901 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" podStartSLOduration=2.011013405 podStartE2EDuration="5.391888277s" totalImagesPullingTime="3.380874872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:59.390452591 +0000 UTC m=+392.722527920" watchObservedRunningTime="2026-09-09 23:15:59.391888277 +0000 UTC m=+392.723963568" Sep 09 23:15:59.578774 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.578747 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:59.581000 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:15:59.580975 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" is forbidden: User \"system:node:ip-10-0-137-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-106.ec2.internal' and this object" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:15:59.655854 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.655792 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6mvf\" (UniqueName: \"kubernetes.io/projected/d72cb130-ebb1-4376-a44d-9934444be5c6-kube-api-access-t6mvf\") pod \"d72cb130-ebb1-4376-a44d-9934444be5c6\" (UID: \"d72cb130-ebb1-4376-a44d-9934444be5c6\") " Sep 09 23:15:59.655964 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.655896 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72cb130-ebb1-4376-a44d-9934444be5c6-extensions-socket-volume\") pod \"d72cb130-ebb1-4376-a44d-9934444be5c6\" (UID: \"d72cb130-ebb1-4376-a44d-9934444be5c6\") " Sep 09 23:15:59.656138 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.656103 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d72cb130-ebb1-4376-a44d-9934444be5c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d72cb130-ebb1-4376-a44d-9934444be5c6" (UID: "d72cb130-ebb1-4376-a44d-9934444be5c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:59.657879 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.657862 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d72cb130-ebb1-4376-a44d-9934444be5c6-kube-api-access-t6mvf" (OuterVolumeSpecName: "kube-api-access-t6mvf") pod "d72cb130-ebb1-4376-a44d-9934444be5c6" (UID: "d72cb130-ebb1-4376-a44d-9934444be5c6"). InnerVolumeSpecName "kube-api-access-t6mvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:59.756886 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.756864 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6mvf\" (UniqueName: \"kubernetes.io/projected/d72cb130-ebb1-4376-a44d-9934444be5c6-kube-api-access-t6mvf\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:15:59.756886 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:15:59.756883 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d72cb130-ebb1-4376-a44d-9934444be5c6-extensions-socket-volume\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:00.375774 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:00.375743 2581 generic.go:356] "Generic (PLEG): container finished" podID="d72cb130-ebb1-4376-a44d-9934444be5c6" containerID="82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9" exitCode=2 Sep 09 23:16:00.376122 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:00.375797 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:16:00.376122 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:00.375850 2581 scope.go:117] "RemoveContainer" containerID="82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9" Sep 09 23:16:00.377670 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:16:00.377642 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" is forbidden: User \"system:node:ip-10-0-137-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-106.ec2.internal' and this object" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:16:00.385520 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:00.385504 2581 scope.go:117] "RemoveContainer" containerID="82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9" Sep 09 23:16:00.385804 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:16:00.385785 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9\": container with ID starting with 82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9 not found: ID does not exist" containerID="82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9" Sep 09 23:16:00.385804 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:00.385812 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9"} err="failed to get container status \"82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9\": rpc error: code = NotFound desc = could not find container \"82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9\": container with ID starting with 82a33df971aa820c9596ce8d7fc269b98c534a37230ada9e855af08228542ac9 not found: ID does not exist" Sep 09 23:16:00.385944 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:16:00.385928 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-vghbj\" is forbidden: User \"system:node:ip-10-0-137-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-106.ec2.internal' and this object" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-vghbj" Sep 09 23:16:01.192326 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:01.192287 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" path="/var/lib/kubelet/pods/d72cb130-ebb1-4376-a44d-9934444be5c6/volumes" Sep 09 23:16:02.417081 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.417047 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78554754ff-grdgj"] Sep 09 23:16:02.417491 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.417477 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" containerName="manager" Sep 09 23:16:02.417545 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.417493 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" containerName="manager" Sep 09 23:16:02.417584 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.417552 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d72cb130-ebb1-4376-a44d-9934444be5c6" containerName="manager" Sep 09 23:16:02.422080 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.422059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.433189 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.433166 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78554754ff-grdgj"] Sep 09 23:16:02.477464 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.477437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7903efb-fdd4-44e5-813a-414e877c4577-console-serving-cert\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.477577 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.477478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-service-ca\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.477577 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.477497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-oauth-serving-cert\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.477688 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.477661 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-console-config\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.477746 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.477704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7903efb-fdd4-44e5-813a-414e877c4577-console-oauth-config\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.477784 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.477743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwkmb\" (UniqueName: \"kubernetes.io/projected/a7903efb-fdd4-44e5-813a-414e877c4577-kube-api-access-cwkmb\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.477784 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.477777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-trusted-ca-bundle\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579058 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7903efb-fdd4-44e5-813a-414e877c4577-console-oauth-config\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579154 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwkmb\" (UniqueName: \"kubernetes.io/projected/a7903efb-fdd4-44e5-813a-414e877c4577-kube-api-access-cwkmb\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579154 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-trusted-ca-bundle\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579154 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7903efb-fdd4-44e5-813a-414e877c4577-console-serving-cert\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579154 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-service-ca\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579154 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-oauth-serving-cert\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579436 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-console-config\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579866 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579844 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-service-ca\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.579980 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.579962 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-trusted-ca-bundle\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.580073 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.580053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-console-config\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.580111 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.580061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7903efb-fdd4-44e5-813a-414e877c4577-oauth-serving-cert\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.581765 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.581748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7903efb-fdd4-44e5-813a-414e877c4577-console-serving-cert\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.581819 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.581773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7903efb-fdd4-44e5-813a-414e877c4577-console-oauth-config\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.587811 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.587793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwkmb\" (UniqueName: \"kubernetes.io/projected/a7903efb-fdd4-44e5-813a-414e877c4577-kube-api-access-cwkmb\") pod \"console-78554754ff-grdgj\" (UID: \"a7903efb-fdd4-44e5-813a-414e877c4577\") " pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:02.730938 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:02.730912 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:03.003391 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:03.003360 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78554754ff-grdgj"] Sep 09 23:16:03.004736 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:16:03.004711 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7903efb_fdd4_44e5_813a_414e877c4577.slice/crio-b71acd98c6aac1695bfd029996cd44cda7db6af6fbcf782b18cdd73407aa9e10 WatchSource:0}: Error finding container b71acd98c6aac1695bfd029996cd44cda7db6af6fbcf782b18cdd73407aa9e10: Status 404 returned error can't find the container with id b71acd98c6aac1695bfd029996cd44cda7db6af6fbcf782b18cdd73407aa9e10 Sep 09 23:16:03.396011 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:03.395928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78554754ff-grdgj" event={"ID":"a7903efb-fdd4-44e5-813a-414e877c4577","Type":"ContainerStarted","Data":"d7b0d6d9f7a25a9ddb52506b364f66b02fce59876ef52c4c1ce25dcb762d2ed8"} Sep 09 23:16:03.396011 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:03.395981 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78554754ff-grdgj" event={"ID":"a7903efb-fdd4-44e5-813a-414e877c4577","Type":"ContainerStarted","Data":"b71acd98c6aac1695bfd029996cd44cda7db6af6fbcf782b18cdd73407aa9e10"} Sep 09 23:16:03.413433 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:03.413386 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78554754ff-grdgj" podStartSLOduration=1.413370793 podStartE2EDuration="1.413370793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:03.412416429 +0000 UTC m=+396.744491723" watchObservedRunningTime="2026-09-09 23:16:03.413370793 +0000 UTC m=+396.745446084" Sep 09 23:16:10.379083 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:10.379048 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:16:12.731013 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:12.730975 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:12.731407 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:12.731032 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:12.735565 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:12.735542 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:13.457247 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:13.457214 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78554754ff-grdgj" Sep 09 23:16:13.502610 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:13.502577 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d54bd574b-kxjcp"] Sep 09 23:16:22.579562 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:22.579522 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq"] Sep 09 23:16:22.580006 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:22.579750 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" podUID="1b0291d2-627c-4c43-9e9b-37e5ff05391b" containerName="manager" containerID="cri-o://d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599" gracePeriod=10 Sep 09 23:16:22.823465 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:22.823442 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:16:22.942350 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:22.942286 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5hbb\" (UniqueName: \"kubernetes.io/projected/1b0291d2-627c-4c43-9e9b-37e5ff05391b-kube-api-access-c5hbb\") pod \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\" (UID: \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\") " Sep 09 23:16:22.942486 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:22.942371 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0291d2-627c-4c43-9e9b-37e5ff05391b-extensions-socket-volume\") pod \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\" (UID: \"1b0291d2-627c-4c43-9e9b-37e5ff05391b\") " Sep 09 23:16:22.942819 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:22.942795 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0291d2-627c-4c43-9e9b-37e5ff05391b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1b0291d2-627c-4c43-9e9b-37e5ff05391b" (UID: "1b0291d2-627c-4c43-9e9b-37e5ff05391b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:16:22.944265 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:22.944243 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0291d2-627c-4c43-9e9b-37e5ff05391b-kube-api-access-c5hbb" (OuterVolumeSpecName: "kube-api-access-c5hbb") pod "1b0291d2-627c-4c43-9e9b-37e5ff05391b" (UID: "1b0291d2-627c-4c43-9e9b-37e5ff05391b"). InnerVolumeSpecName "kube-api-access-c5hbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:16:23.043347 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.043304 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5hbb\" (UniqueName: \"kubernetes.io/projected/1b0291d2-627c-4c43-9e9b-37e5ff05391b-kube-api-access-c5hbb\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:23.043347 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.043345 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b0291d2-627c-4c43-9e9b-37e5ff05391b-extensions-socket-volume\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:23.517073 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.517038 2581 generic.go:356] "Generic (PLEG): container finished" podID="1b0291d2-627c-4c43-9e9b-37e5ff05391b" containerID="d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599" exitCode=0 Sep 09 23:16:23.517260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.517090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" event={"ID":"1b0291d2-627c-4c43-9e9b-37e5ff05391b","Type":"ContainerDied","Data":"d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599"} Sep 09 23:16:23.517260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.517094 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" Sep 09 23:16:23.517260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.517133 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq" event={"ID":"1b0291d2-627c-4c43-9e9b-37e5ff05391b","Type":"ContainerDied","Data":"a957839c5939864359b26fd39a1a4a68b6b372df46ae1c719da37b39d771b2ba"} Sep 09 23:16:23.517260 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.517157 2581 scope.go:117] "RemoveContainer" containerID="d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599" Sep 09 23:16:23.527188 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.527166 2581 scope.go:117] "RemoveContainer" containerID="d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599" Sep 09 23:16:23.527512 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:16:23.527489 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599\": container with ID starting with d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599 not found: ID does not exist" containerID="d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599" Sep 09 23:16:23.527581 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.527520 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599"} err="failed to get container status \"d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599\": rpc error: code = NotFound desc = could not find container \"d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599\": container with ID starting with d6c0bd0fe2e5c5625102b9bd6aedef14c9aea3ce9a8bd006428f56fa454f6599 not found: ID does not exist" Sep 09 23:16:23.535046 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.535020 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq"] Sep 09 23:16:23.550249 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:23.550228 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lhjjq"] Sep 09 23:16:25.192104 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:25.192068 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b0291d2-627c-4c43-9e9b-37e5ff05391b" path="/var/lib/kubelet/pods/1b0291d2-627c-4c43-9e9b-37e5ff05391b/volumes" Sep 09 23:16:26.754268 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.754231 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl"] Sep 09 23:16:26.754659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.754644 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0291d2-627c-4c43-9e9b-37e5ff05391b" containerName="manager" Sep 09 23:16:26.754659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.754660 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0291d2-627c-4c43-9e9b-37e5ff05391b" containerName="manager" Sep 09 23:16:26.754740 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.754730 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b0291d2-627c-4c43-9e9b-37e5ff05391b" containerName="manager" Sep 09 23:16:26.759132 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.759115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.761162 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.761141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rw2fq\"" Sep 09 23:16:26.770864 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.770841 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl"] Sep 09 23:16:26.870850 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.870821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.870956 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.870865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.870956 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.870918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.871038 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.871006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.871072 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.871055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.871105 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.871076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.871105 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.871091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.871183 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.871108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d78hz\" (UniqueName: \"kubernetes.io/projected/c9e35571-dc07-4edd-b81e-9f702fa2be4e-kube-api-access-d78hz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.871183 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.871128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972097 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972209 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972209 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972209 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972571 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972571 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972571 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972571 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d78hz\" (UniqueName: \"kubernetes.io/projected/c9e35571-dc07-4edd-b81e-9f702fa2be4e-kube-api-access-d78hz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972571 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972571 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972571 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972556 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972893 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972893 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.972992 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.972972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.974615 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.974591 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.974709 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.974696 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.979355 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.979336 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9e35571-dc07-4edd-b81e-9f702fa2be4e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:26.979355 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:26.979343 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d78hz\" (UniqueName: \"kubernetes.io/projected/c9e35571-dc07-4edd-b81e-9f702fa2be4e-kube-api-access-d78hz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-852vl\" (UID: \"c9e35571-dc07-4edd-b81e-9f702fa2be4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:27.072073 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.072051 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rw2fq\"" Sep 09 23:16:27.080020 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.080001 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:27.359909 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.359886 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl"] Sep 09 23:16:27.361675 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:16:27.361647 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e35571_dc07_4edd_b81e_9f702fa2be4e.slice/crio-4a67582305fb9273fa5122cb98ecd0b27a5c6e96f96aa976f827e94a965e08cb WatchSource:0}: Error finding container 4a67582305fb9273fa5122cb98ecd0b27a5c6e96f96aa976f827e94a965e08cb: Status 404 returned error can't find the container with id 4a67582305fb9273fa5122cb98ecd0b27a5c6e96f96aa976f827e94a965e08cb Sep 09 23:16:27.363651 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.363616 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:16:27.363727 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.363682 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:16:27.363727 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.363713 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:16:27.542604 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.542565 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" event={"ID":"c9e35571-dc07-4edd-b81e-9f702fa2be4e","Type":"ContainerStarted","Data":"4942224641e24624936d8c2d9e2e984c718f26b1bf30e7d4bbde6d4542e49717"} Sep 09 23:16:27.542784 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.542618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" event={"ID":"c9e35571-dc07-4edd-b81e-9f702fa2be4e","Type":"ContainerStarted","Data":"4a67582305fb9273fa5122cb98ecd0b27a5c6e96f96aa976f827e94a965e08cb"} Sep 09 23:16:27.562393 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:27.562349 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" podStartSLOduration=1.5623344449999998 podStartE2EDuration="1.562334445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:27.560594908 +0000 UTC m=+420.892670198" watchObservedRunningTime="2026-09-09 23:16:27.562334445 +0000 UTC m=+420.894409737" Sep 09 23:16:28.080236 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:28.080203 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:28.084735 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:28.084710 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:28.548347 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:28.548297 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:28.549272 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:28.549250 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:16:38.522940 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.522880 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d54bd574b-kxjcp" podUID="43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" containerName="console" containerID="cri-o://afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039" gracePeriod=15 Sep 09 23:16:38.762024 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.761998 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:16:38.864784 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.864729 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-service-ca\") pod \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " Sep 09 23:16:38.864784 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.864778 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-trusted-ca-bundle\") pod \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " Sep 09 23:16:38.864962 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.864827 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-oauth-config\") pod \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " Sep 09 23:16:38.864962 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.864844 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-oauth-serving-cert\") pod \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " Sep 09 23:16:38.864962 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.864862 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-serving-cert\") pod \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " Sep 09 23:16:38.864962 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.864896 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wckgx\" (UniqueName: \"kubernetes.io/projected/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-kube-api-access-wckgx\") pod \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " Sep 09 23:16:38.864962 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.864920 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-config\") pod \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\" (UID: \"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc\") " Sep 09 23:16:38.865215 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.865165 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-service-ca" (OuterVolumeSpecName: "service-ca") pod "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" (UID: "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:16:38.865264 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.865220 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" (UID: "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:16:38.865387 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.865361 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" (UID: "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:16:38.865466 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.865448 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-config" (OuterVolumeSpecName: "console-config") pod "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" (UID: "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:16:38.867113 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.867086 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-kube-api-access-wckgx" (OuterVolumeSpecName: "kube-api-access-wckgx") pod "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" (UID: "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc"). InnerVolumeSpecName "kube-api-access-wckgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:16:38.867398 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.867376 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" (UID: "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:16:38.867492 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.867399 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" (UID: "43346e9f-6fdf-459d-8ed2-b7e10ae28dcc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:16:38.965653 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.965634 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-service-ca\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:38.965653 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.965654 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-trusted-ca-bundle\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:38.965780 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.965663 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-oauth-config\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:38.965780 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.965673 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-oauth-serving-cert\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:38.965780 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.965681 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-serving-cert\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:38.965780 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.965689 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wckgx\" (UniqueName: \"kubernetes.io/projected/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-kube-api-access-wckgx\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:38.965780 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:38.965698 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc-console-config\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:16:39.606670 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.606631 2581 generic.go:356] "Generic (PLEG): container finished" podID="43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" containerID="afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039" exitCode=0 Sep 09 23:16:39.607084 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.606737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d54bd574b-kxjcp" event={"ID":"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc","Type":"ContainerDied","Data":"afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039"} Sep 09 23:16:39.607084 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.606810 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d54bd574b-kxjcp" event={"ID":"43346e9f-6fdf-459d-8ed2-b7e10ae28dcc","Type":"ContainerDied","Data":"0b23b2b36077182b5c97c3f4af2fb8c789ad1e18f990cb5e78b70db42a5115bb"} Sep 09 23:16:39.607084 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.606838 2581 scope.go:117] "RemoveContainer" containerID="afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039" Sep 09 23:16:39.607084 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.606996 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d54bd574b-kxjcp" Sep 09 23:16:39.619857 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.619831 2581 scope.go:117] "RemoveContainer" containerID="afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039" Sep 09 23:16:39.620150 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:16:39.620113 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039\": container with ID starting with afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039 not found: ID does not exist" containerID="afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039" Sep 09 23:16:39.620216 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.620159 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039"} err="failed to get container status \"afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039\": rpc error: code = NotFound desc = could not find container \"afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039\": container with ID starting with afd6516cdba375ee4d6fefa6310bf026d60b44279caaa44841830c80bb52a039 not found: ID does not exist" Sep 09 23:16:39.628828 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.628806 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d54bd574b-kxjcp"] Sep 09 23:16:39.634502 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.634483 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d54bd574b-kxjcp"] Sep 09 23:16:39.788962 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.788931 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:16:39.789334 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.789321 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" containerName="console" Sep 09 23:16:39.789386 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.789336 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" containerName="console" Sep 09 23:16:39.789432 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.789394 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" containerName="console" Sep 09 23:16:39.792274 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.792253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:39.794361 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.794340 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l4b6r\"" Sep 09 23:16:39.794472 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.794340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 09 23:16:39.794472 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.794378 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:16:39.794472 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.794399 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:16:39.806576 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.806548 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:16:39.833111 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.833086 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:16:39.973281 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.973257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqrrb\" (UniqueName: \"kubernetes.io/projected/6dd379b7-de8f-4063-9407-01dea958d760-kube-api-access-rqrrb\") pod \"limitador-limitador-84994f7ffc-6z2nj\" (UID: \"6dd379b7-de8f-4063-9407-01dea958d760\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:39.973379 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:39.973291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6dd379b7-de8f-4063-9407-01dea958d760-config-file\") pod \"limitador-limitador-84994f7ffc-6z2nj\" (UID: \"6dd379b7-de8f-4063-9407-01dea958d760\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:40.074554 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:40.074530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqrrb\" (UniqueName: \"kubernetes.io/projected/6dd379b7-de8f-4063-9407-01dea958d760-kube-api-access-rqrrb\") pod \"limitador-limitador-84994f7ffc-6z2nj\" (UID: \"6dd379b7-de8f-4063-9407-01dea958d760\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:40.074637 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:40.074564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6dd379b7-de8f-4063-9407-01dea958d760-config-file\") pod \"limitador-limitador-84994f7ffc-6z2nj\" (UID: \"6dd379b7-de8f-4063-9407-01dea958d760\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:40.075076 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:40.075059 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6dd379b7-de8f-4063-9407-01dea958d760-config-file\") pod \"limitador-limitador-84994f7ffc-6z2nj\" (UID: \"6dd379b7-de8f-4063-9407-01dea958d760\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:40.081825 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:40.081802 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqrrb\" (UniqueName: \"kubernetes.io/projected/6dd379b7-de8f-4063-9407-01dea958d760-kube-api-access-rqrrb\") pod \"limitador-limitador-84994f7ffc-6z2nj\" (UID: \"6dd379b7-de8f-4063-9407-01dea958d760\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:40.102877 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:40.102856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:40.374294 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:40.374271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:16:40.375806 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:16:40.375779 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd379b7_de8f_4063_9407_01dea958d760.slice/crio-d479839e9cb9a347dbb29fd3a727dd5b084942f72e88f9c0bcd26ce8212f2e5b WatchSource:0}: Error finding container d479839e9cb9a347dbb29fd3a727dd5b084942f72e88f9c0bcd26ce8212f2e5b: Status 404 returned error can't find the container with id d479839e9cb9a347dbb29fd3a727dd5b084942f72e88f9c0bcd26ce8212f2e5b Sep 09 23:16:40.614093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:40.614063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" event={"ID":"6dd379b7-de8f-4063-9407-01dea958d760","Type":"ContainerStarted","Data":"d479839e9cb9a347dbb29fd3a727dd5b084942f72e88f9c0bcd26ce8212f2e5b"} Sep 09 23:16:41.191587 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:41.191555 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43346e9f-6fdf-459d-8ed2-b7e10ae28dcc" path="/var/lib/kubelet/pods/43346e9f-6fdf-459d-8ed2-b7e10ae28dcc/volumes" Sep 09 23:16:41.621044 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:41.621018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" event={"ID":"6dd379b7-de8f-4063-9407-01dea958d760","Type":"ContainerStarted","Data":"02b36466152343c70b1fcbd347fbff542c96ea979510b0402342a3d9496aaeca"} Sep 09 23:16:41.621365 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:41.621090 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:16:41.640990 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:41.640949 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" podStartSLOduration=1.809457175 podStartE2EDuration="2.640936635s" totalImagesPullingTime="831.47946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:41.638786247 +0000 UTC m=+434.970861550" watchObservedRunningTime="2026-09-09 23:16:41.640936635 +0000 UTC m=+434.973011925" Sep 09 23:16:52.628701 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:16:52.628629 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6z2nj" Sep 09 23:17:05.496254 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.496221 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-46c97"] Sep 09 23:17:05.498673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.498657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.501744 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.501722 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vrxlr\"" Sep 09 23:17:05.508914 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.508896 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 09 23:17:05.516349 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.516299 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-46c97"] Sep 09 23:17:05.564215 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.564196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdf683f1-0e86-47c7-b91c-6ebde15894f0-tls-cert\") pod \"authorino-6d4dfc649f-46c97\" (UID: \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\") " pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.564319 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.564222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsdqf\" (UniqueName: \"kubernetes.io/projected/cdf683f1-0e86-47c7-b91c-6ebde15894f0-kube-api-access-qsdqf\") pod \"authorino-6d4dfc649f-46c97\" (UID: \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\") " pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.602566 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.602543 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-46c97"] Sep 09 23:17:05.602770 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:17:05.602753 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qsdqf tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-46c97" podUID="cdf683f1-0e86-47c7-b91c-6ebde15894f0" Sep 09 23:17:05.664756 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.664735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdf683f1-0e86-47c7-b91c-6ebde15894f0-tls-cert\") pod \"authorino-6d4dfc649f-46c97\" (UID: \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\") " pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.664835 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.664764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsdqf\" (UniqueName: \"kubernetes.io/projected/cdf683f1-0e86-47c7-b91c-6ebde15894f0-kube-api-access-qsdqf\") pod \"authorino-6d4dfc649f-46c97\" (UID: \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\") " pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.666930 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.666905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdf683f1-0e86-47c7-b91c-6ebde15894f0-tls-cert\") pod \"authorino-6d4dfc649f-46c97\" (UID: \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\") " pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.672149 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.672119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsdqf\" (UniqueName: \"kubernetes.io/projected/cdf683f1-0e86-47c7-b91c-6ebde15894f0-kube-api-access-qsdqf\") pod \"authorino-6d4dfc649f-46c97\" (UID: \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\") " pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.751462 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.751443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.757222 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.757205 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:05.866523 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.866503 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsdqf\" (UniqueName: \"kubernetes.io/projected/cdf683f1-0e86-47c7-b91c-6ebde15894f0-kube-api-access-qsdqf\") pod \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\" (UID: \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\") " Sep 09 23:17:05.866608 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.866534 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdf683f1-0e86-47c7-b91c-6ebde15894f0-tls-cert\") pod \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\" (UID: \"cdf683f1-0e86-47c7-b91c-6ebde15894f0\") " Sep 09 23:17:05.868281 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.868247 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf683f1-0e86-47c7-b91c-6ebde15894f0-kube-api-access-qsdqf" (OuterVolumeSpecName: "kube-api-access-qsdqf") pod "cdf683f1-0e86-47c7-b91c-6ebde15894f0" (UID: "cdf683f1-0e86-47c7-b91c-6ebde15894f0"). InnerVolumeSpecName "kube-api-access-qsdqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:17:05.868384 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.868286 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdf683f1-0e86-47c7-b91c-6ebde15894f0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cdf683f1-0e86-47c7-b91c-6ebde15894f0" (UID: "cdf683f1-0e86-47c7-b91c-6ebde15894f0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:17:05.967756 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.967720 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsdqf\" (UniqueName: \"kubernetes.io/projected/cdf683f1-0e86-47c7-b91c-6ebde15894f0-kube-api-access-qsdqf\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:17:05.967756 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:05.967755 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cdf683f1-0e86-47c7-b91c-6ebde15894f0-tls-cert\") on node \"ip-10-0-137-106.ec2.internal\" DevicePath \"\"" Sep 09 23:17:06.757457 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:06.757432 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-46c97" Sep 09 23:17:06.797150 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:06.797124 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-46c97"] Sep 09 23:17:06.803490 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:06.803468 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-46c97"] Sep 09 23:17:07.191740 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:07.191679 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf683f1-0e86-47c7-b91c-6ebde15894f0" path="/var/lib/kubelet/pods/cdf683f1-0e86-47c7-b91c-6ebde15894f0/volumes" Sep 09 23:17:50.874117 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:50.874086 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:17:50.905680 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:50.905653 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6"] Sep 09 23:17:50.910477 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:50.910457 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:50.916224 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:50.916202 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vgzdb\"" Sep 09 23:17:50.916530 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:50.916510 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 09 23:17:50.933286 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:50.933248 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6"] Sep 09 23:17:51.002011 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:51.001977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cprhv\" (UniqueName: \"kubernetes.io/projected/5a978e4f-3488-477d-ac95-8e9ba8adba18-kube-api-access-cprhv\") pod \"payload-pre-processing-59fbc47bf8-ncwk6\" (UID: \"5a978e4f-3488-477d-ac95-8e9ba8adba18\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:51.002193 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:51.002081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a978e4f-3488-477d-ac95-8e9ba8adba18-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ncwk6\" (UID: \"5a978e4f-3488-477d-ac95-8e9ba8adba18\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:51.103433 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:51.103398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cprhv\" (UniqueName: \"kubernetes.io/projected/5a978e4f-3488-477d-ac95-8e9ba8adba18-kube-api-access-cprhv\") pod \"payload-pre-processing-59fbc47bf8-ncwk6\" (UID: \"5a978e4f-3488-477d-ac95-8e9ba8adba18\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:51.103588 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:51.103496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a978e4f-3488-477d-ac95-8e9ba8adba18-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ncwk6\" (UID: \"5a978e4f-3488-477d-ac95-8e9ba8adba18\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:51.104187 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:51.104169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a978e4f-3488-477d-ac95-8e9ba8adba18-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-ncwk6\" (UID: \"5a978e4f-3488-477d-ac95-8e9ba8adba18\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:51.112028 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:51.111998 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cprhv\" (UniqueName: \"kubernetes.io/projected/5a978e4f-3488-477d-ac95-8e9ba8adba18-kube-api-access-cprhv\") pod \"payload-pre-processing-59fbc47bf8-ncwk6\" (UID: \"5a978e4f-3488-477d-ac95-8e9ba8adba18\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:51.219803 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:51.219782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:51.488792 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:51.488765 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6"] Sep 09 23:17:51.490245 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:17:51.490221 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a978e4f_3488_477d_ac95_8e9ba8adba18.slice/crio-18c34d7d449b4a4f3212edef99c63bd8a89f266e2876cdc2d8717c6a1216ec5b WatchSource:0}: Error finding container 18c34d7d449b4a4f3212edef99c63bd8a89f266e2876cdc2d8717c6a1216ec5b: Status 404 returned error can't find the container with id 18c34d7d449b4a4f3212edef99c63bd8a89f266e2876cdc2d8717c6a1216ec5b Sep 09 23:17:52.000171 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:52.000134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" event={"ID":"5a978e4f-3488-477d-ac95-8e9ba8adba18","Type":"ContainerStarted","Data":"18c34d7d449b4a4f3212edef99c63bd8a89f266e2876cdc2d8717c6a1216ec5b"} Sep 09 23:17:54.036680 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:54.036639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" event={"ID":"5a978e4f-3488-477d-ac95-8e9ba8adba18","Type":"ContainerStarted","Data":"a93e5f1313005afb414595f8f4c0b1acbaaf9a6194073649e1e1aa4e775e74da"} Sep 09 23:17:54.037122 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:54.036797 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:17:54.055297 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:54.055250 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" podStartSLOduration=2.30779552 podStartE2EDuration="4.055237908s" totalImagesPullingTime="1.747442388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:54.052798805 +0000 UTC m=+507.384874095" watchObservedRunningTime="2026-09-09 23:17:54.055237908 +0000 UTC m=+507.387313198" Sep 09 23:17:59.590479 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:59.590425 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-852vl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 09 23:17:59.590903 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:17:59.590537 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" podUID="c9e35571-dc07-4edd-b81e-9f702fa2be4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 09 23:18:00.074365 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:00.074327 2581 generic.go:356] "Generic (PLEG): container finished" podID="c9e35571-dc07-4edd-b81e-9f702fa2be4e" containerID="4942224641e24624936d8c2d9e2e984c718f26b1bf30e7d4bbde6d4542e49717" exitCode=0 Sep 09 23:18:00.074534 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:00.074388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" event={"ID":"c9e35571-dc07-4edd-b81e-9f702fa2be4e","Type":"ContainerDied","Data":"4942224641e24624936d8c2d9e2e984c718f26b1bf30e7d4bbde6d4542e49717"} Sep 09 23:18:00.074818 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:00.074801 2581 scope.go:117] "RemoveContainer" containerID="4942224641e24624936d8c2d9e2e984c718f26b1bf30e7d4bbde6d4542e49717" Sep 09 23:18:00.075833 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:00.075802 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:18:00.075925 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:00.075891 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:18:00.075984 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:00.075939 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:18:01.081733 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:01.081697 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" event={"ID":"c9e35571-dc07-4edd-b81e-9f702fa2be4e","Type":"ContainerStarted","Data":"26528ad50773f70008dde75be1314a5372d1c2ebcdb06aa50e811e1360ec7d31"} Sep 09 23:18:02.080658 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:02.080623 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:18:02.080821 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:02.080802 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-852vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Sep 09 23:18:02.080870 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:02.080849 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" podUID="c9e35571-dc07-4edd-b81e-9f702fa2be4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Sep 09 23:18:03.080872 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:03.080839 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-852vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Sep 09 23:18:03.081228 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:03.080892 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" podUID="c9e35571-dc07-4edd-b81e-9f702fa2be4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Sep 09 23:18:04.081363 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:04.081326 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-852vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Sep 09 23:18:04.081736 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:04.081383 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" podUID="c9e35571-dc07-4edd-b81e-9f702fa2be4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Sep 09 23:18:05.044804 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:05.044776 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-ncwk6" Sep 09 23:18:05.080927 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:05.080898 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-852vl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Sep 09 23:18:05.081076 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:05.080972 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" podUID="c9e35571-dc07-4edd-b81e-9f702fa2be4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Sep 09 23:18:06.001641 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:06.001606 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:18:06.084319 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:06.084276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:18:06.084550 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:06.084525 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:18:06.085086 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:06.085071 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-852vl" Sep 09 23:18:25.601622 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.601549 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-m42bx"] Sep 09 23:18:25.605659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.605642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.607869 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.607848 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fhsgd\"" Sep 09 23:18:25.608003 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.607888 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:18:25.608619 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.608596 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:18:25.608783 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.608768 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 09 23:18:25.615163 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.615140 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-m42bx"] Sep 09 23:18:25.696935 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.696909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4fgw\" (UniqueName: \"kubernetes.io/projected/bdf15a30-d27a-408c-9cef-e901ebd02300-kube-api-access-f4fgw\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.697035 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.696940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.697035 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.696959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.697119 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.697047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.697168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.697120 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf15a30-d27a-408c-9cef-e901ebd02300-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.697221 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.697174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798343 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf15a30-d27a-408c-9cef-e901ebd02300-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798472 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798472 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4fgw\" (UniqueName: \"kubernetes.io/projected/bdf15a30-d27a-408c-9cef-e901ebd02300-kube-api-access-f4fgw\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798472 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798472 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798661 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798833 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798814 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798901 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.798901 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.798873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.800572 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.800553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdf15a30-d27a-408c-9cef-e901ebd02300-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.800695 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.800678 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdf15a30-d27a-408c-9cef-e901ebd02300-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.806898 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.806877 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4fgw\" (UniqueName: \"kubernetes.io/projected/bdf15a30-d27a-408c-9cef-e901ebd02300-kube-api-access-f4fgw\") pod \"e2e-distinct-simulated-kserve-6685d86975-m42bx\" (UID: \"bdf15a30-d27a-408c-9cef-e901ebd02300\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:25.918098 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:25.918049 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:26.190275 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:26.190249 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-m42bx"] Sep 09 23:18:26.191804 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:18:26.191779 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf15a30_d27a_408c_9cef_e901ebd02300.slice/crio-59bf608ddb482455d909250df731dad1386a3d82f18ef0518277df1534391209 WatchSource:0}: Error finding container 59bf608ddb482455d909250df731dad1386a3d82f18ef0518277df1534391209: Status 404 returned error can't find the container with id 59bf608ddb482455d909250df731dad1386a3d82f18ef0518277df1534391209 Sep 09 23:18:26.229921 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:26.229893 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" event={"ID":"bdf15a30-d27a-408c-9cef-e901ebd02300","Type":"ContainerStarted","Data":"59bf608ddb482455d909250df731dad1386a3d82f18ef0518277df1534391209"} Sep 09 23:18:26.310514 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:26.310486 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:18:28.246529 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:28.246492 2581 generic.go:356] "Generic (PLEG): container finished" podID="bdf15a30-d27a-408c-9cef-e901ebd02300" containerID="5d5d69a4cd0b31030898982af3b82ed4963a8b4d365370d3433b46b35f3e6199" exitCode=0 Sep 09 23:18:28.246960 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:28.246568 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" event={"ID":"bdf15a30-d27a-408c-9cef-e901ebd02300","Type":"ContainerDied","Data":"5d5d69a4cd0b31030898982af3b82ed4963a8b4d365370d3433b46b35f3e6199"} Sep 09 23:18:28.246960 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:28.246736 2581 scope.go:117] "RemoveContainer" containerID="5d5d69a4cd0b31030898982af3b82ed4963a8b4d365370d3433b46b35f3e6199" Sep 09 23:18:29.253434 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:29.253406 2581 generic.go:356] "Generic (PLEG): container finished" podID="bdf15a30-d27a-408c-9cef-e901ebd02300" containerID="8cbae1ea23a2d27bf0d6146eb443a12c9d1a1b7f1487c0c418cfd52aac7be6a5" exitCode=0 Sep 09 23:18:29.253790 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:29.253456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" event={"ID":"bdf15a30-d27a-408c-9cef-e901ebd02300","Type":"ContainerDied","Data":"8cbae1ea23a2d27bf0d6146eb443a12c9d1a1b7f1487c0c418cfd52aac7be6a5"} Sep 09 23:18:29.253790 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:29.253496 2581 scope.go:117] "RemoveContainer" containerID="5d5d69a4cd0b31030898982af3b82ed4963a8b4d365370d3433b46b35f3e6199" Sep 09 23:18:29.253790 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:29.253681 2581 scope.go:117] "RemoveContainer" containerID="8cbae1ea23a2d27bf0d6146eb443a12c9d1a1b7f1487c0c418cfd52aac7be6a5" Sep 09 23:18:29.253970 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:18:29.253878 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:18:30.260670 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:30.260647 2581 scope.go:117] "RemoveContainer" containerID="8cbae1ea23a2d27bf0d6146eb443a12c9d1a1b7f1487c0c418cfd52aac7be6a5" Sep 09 23:18:30.261002 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:18:30.260804 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:18:35.906090 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:35.906054 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:18:35.918481 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:35.918449 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:35.918583 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:35.918503 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:35.918583 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:35.918520 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:35.918583 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:35.918534 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:35.918844 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:35.918832 2581 scope.go:117] "RemoveContainer" containerID="8cbae1ea23a2d27bf0d6146eb443a12c9d1a1b7f1487c0c418cfd52aac7be6a5" Sep 09 23:18:35.918998 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:18:35.918981 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:18:47.189508 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:47.189473 2581 scope.go:117] "RemoveContainer" containerID="8cbae1ea23a2d27bf0d6146eb443a12c9d1a1b7f1487c0c418cfd52aac7be6a5" Sep 09 23:18:48.357230 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:48.357199 2581 generic.go:356] "Generic (PLEG): container finished" podID="bdf15a30-d27a-408c-9cef-e901ebd02300" containerID="ca0854d59e4a227290c1a6e07d1471ea39f502e6029254716937fc041f5a72c8" exitCode=0 Sep 09 23:18:48.357611 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:48.357267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" event={"ID":"bdf15a30-d27a-408c-9cef-e901ebd02300","Type":"ContainerDied","Data":"ca0854d59e4a227290c1a6e07d1471ea39f502e6029254716937fc041f5a72c8"} Sep 09 23:18:48.357611 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:48.357332 2581 scope.go:117] "RemoveContainer" containerID="8cbae1ea23a2d27bf0d6146eb443a12c9d1a1b7f1487c0c418cfd52aac7be6a5" Sep 09 23:18:48.357758 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:48.357636 2581 scope.go:117] "RemoveContainer" containerID="ca0854d59e4a227290c1a6e07d1471ea39f502e6029254716937fc041f5a72c8" Sep 09 23:18:48.357812 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:18:48.357793 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:18:50.998295 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:50.998262 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t548q"] Sep 09 23:18:51.002994 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.002971 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.004946 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.004927 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 09 23:18:51.012633 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.012612 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t548q"] Sep 09 23:18:51.098214 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.098193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.098325 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.098237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.098325 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.098267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lht8t\" (UniqueName: \"kubernetes.io/projected/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-kube-api-access-lht8t\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.098325 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.098291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.098325 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.098318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.098458 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.098390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.199573 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.199536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lht8t\" (UniqueName: \"kubernetes.io/projected/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-kube-api-access-lht8t\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.199573 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.199578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.199775 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.199598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.199775 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.199706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.199878 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.199795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.199878 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.199852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.199993 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.199912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.199993 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.199976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.200130 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.200104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.201697 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.201677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.201978 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.201962 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.207300 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.207278 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lht8t\" (UniqueName: \"kubernetes.io/projected/5b3e6b91-f173-49f7-a6e2-5875b4a7f08b-kube-api-access-lht8t\") pod \"e2e-trlp-test-simulated-kserve-598466548d-t548q\" (UID: \"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.313378 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.313329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:18:51.585873 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:51.583790 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-t548q"] Sep 09 23:18:52.207103 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:52.207071 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:18:52.387077 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:52.387049 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" event={"ID":"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b","Type":"ContainerStarted","Data":"b12292c9a73c2624db79ecab217a3332d09d5d9f7e9f85e62decbae7aed448a1"} Sep 09 23:18:52.387218 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:52.387096 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" event={"ID":"5b3e6b91-f173-49f7-a6e2-5875b4a7f08b","Type":"ContainerStarted","Data":"e700c9bdd3bc56c0109391cf9ca504662fbd336ec72b36b5502bc132937c3852"} Sep 09 23:18:52.413656 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:52.413612 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" podStartSLOduration=2.23786828 podStartE2EDuration="2.413598571s" totalImagesPullingTime="175.730291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:52.411330587 +0000 UTC m=+565.743405871" watchObservedRunningTime="2026-09-09 23:18:52.413598571 +0000 UTC m=+565.745673859" Sep 09 23:18:55.919066 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:55.919032 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:55.919539 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:55.919093 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:55.919539 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:55.919112 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:55.919539 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:55.919126 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:18:55.919539 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:18:55.919496 2581 scope.go:117] "RemoveContainer" containerID="ca0854d59e4a227290c1a6e07d1471ea39f502e6029254716937fc041f5a72c8" Sep 09 23:18:55.919706 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:18:55.919684 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:19:01.313742 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:01.313708 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:19:01.314255 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:01.313764 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:19:01.326761 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:01.326734 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:19:01.453323 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:01.453281 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-t548q" Sep 09 23:19:03.698737 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.698700 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr"] Sep 09 23:19:03.702250 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.702230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.704419 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.704394 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 09 23:19:03.712423 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.712398 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr"] Sep 09 23:19:03.810047 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.810016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.810206 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.810055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.810206 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.810142 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.810206 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.810174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.810206 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.810202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.810373 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.810302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw89l\" (UniqueName: \"kubernetes.io/projected/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-kube-api-access-dw89l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.911371 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.911525 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.911525 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911462 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.911525 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.911628 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw89l\" (UniqueName: \"kubernetes.io/projected/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-kube-api-access-dw89l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.911628 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.911883 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911861 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.911945 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911893 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.912004 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.911937 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.913726 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.913700 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.913952 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.913933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:03.919151 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:03.919133 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw89l\" (UniqueName: \"kubernetes.io/projected/4a73fce6-61fe-4cba-a9e2-035c734ef4e7-kube-api-access-dw89l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr\" (UID: \"4a73fce6-61fe-4cba-a9e2-035c734ef4e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:04.015427 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:04.015380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:04.285939 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:04.285911 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr"] Sep 09 23:19:04.287507 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:19:04.287476 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a73fce6_61fe_4cba_a9e2_035c734ef4e7.slice/crio-9883d1ced996984458da00256171f32b789e4a04589b01d7c7ee2283ece7c36b WatchSource:0}: Error finding container 9883d1ced996984458da00256171f32b789e4a04589b01d7c7ee2283ece7c36b: Status 404 returned error can't find the container with id 9883d1ced996984458da00256171f32b789e4a04589b01d7c7ee2283ece7c36b Sep 09 23:19:04.463097 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:04.463074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" event={"ID":"4a73fce6-61fe-4cba-a9e2-035c734ef4e7","Type":"ContainerStarted","Data":"9883d1ced996984458da00256171f32b789e4a04589b01d7c7ee2283ece7c36b"} Sep 09 23:19:05.307499 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:05.307462 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:19:05.470028 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:05.469987 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" event={"ID":"4a73fce6-61fe-4cba-a9e2-035c734ef4e7","Type":"ContainerStarted","Data":"bd265508275aa8effb95d8c6db7c8b6d99c5bbb130837abf4a1ea2bdf7d873f3"} Sep 09 23:19:05.487743 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:05.487693 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" podStartSLOduration=2.333999068 podStartE2EDuration="2.487677094s" totalImagesPullingTime="153.678026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:05.485381512 +0000 UTC m=+578.817456805" watchObservedRunningTime="2026-09-09 23:19:05.487677094 +0000 UTC m=+578.819752384" Sep 09 23:19:09.186323 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:09.186287 2581 scope.go:117] "RemoveContainer" containerID="ca0854d59e4a227290c1a6e07d1471ea39f502e6029254716937fc041f5a72c8" Sep 09 23:19:09.493437 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:09.493402 2581 generic.go:356] "Generic (PLEG): container finished" podID="bdf15a30-d27a-408c-9cef-e901ebd02300" containerID="4881ca8adea0c48fe7fcb1eca4beb358ced36fd37dd2c4d88fbab62b7dcb7ca8" exitCode=0 Sep 09 23:19:09.493618 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:09.493475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" event={"ID":"bdf15a30-d27a-408c-9cef-e901ebd02300","Type":"ContainerDied","Data":"4881ca8adea0c48fe7fcb1eca4beb358ced36fd37dd2c4d88fbab62b7dcb7ca8"} Sep 09 23:19:09.493618 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:09.493547 2581 scope.go:117] "RemoveContainer" containerID="ca0854d59e4a227290c1a6e07d1471ea39f502e6029254716937fc041f5a72c8" Sep 09 23:19:09.493921 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:09.493903 2581 scope.go:117] "RemoveContainer" containerID="4881ca8adea0c48fe7fcb1eca4beb358ced36fd37dd2c4d88fbab62b7dcb7ca8" Sep 09 23:19:09.494141 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:19:09.494122 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:19:14.015651 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:14.015615 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:14.016042 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:14.015680 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:14.028222 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:14.028198 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:14.534784 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:14.534752 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr" Sep 09 23:19:15.918229 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:15.918198 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:19:15.918677 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:15.918257 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:19:15.918677 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:15.918274 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:19:15.918677 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:15.918289 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:19:15.918788 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:15.918678 2581 scope.go:117] "RemoveContainer" containerID="4881ca8adea0c48fe7fcb1eca4beb358ced36fd37dd2c4d88fbab62b7dcb7ca8" Sep 09 23:19:15.918921 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:19:15.918899 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:19:31.191639 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:31.191610 2581 scope.go:117] "RemoveContainer" containerID="4881ca8adea0c48fe7fcb1eca4beb358ced36fd37dd2c4d88fbab62b7dcb7ca8" Sep 09 23:19:31.192109 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:19:31.191788 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:19:35.210860 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:35.210825 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:19:42.185985 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:42.185950 2581 scope.go:117] "RemoveContainer" containerID="4881ca8adea0c48fe7fcb1eca4beb358ced36fd37dd2c4d88fbab62b7dcb7ca8" Sep 09 23:19:42.186465 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:19:42.186130 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:19:46.763616 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:46.763564 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6z2nj"] Sep 09 23:19:55.186238 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.186151 2581 scope.go:117] "RemoveContainer" containerID="4881ca8adea0c48fe7fcb1eca4beb358ced36fd37dd2c4d88fbab62b7dcb7ca8" Sep 09 23:19:55.761900 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.761864 2581 generic.go:356] "Generic (PLEG): container finished" podID="bdf15a30-d27a-408c-9cef-e901ebd02300" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" exitCode=0 Sep 09 23:19:55.762074 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.761927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" event={"ID":"bdf15a30-d27a-408c-9cef-e901ebd02300","Type":"ContainerDied","Data":"8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1"} Sep 09 23:19:55.762074 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.762001 2581 scope.go:117] "RemoveContainer" containerID="4881ca8adea0c48fe7fcb1eca4beb358ced36fd37dd2c4d88fbab62b7dcb7ca8" Sep 09 23:19:55.762415 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.762388 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:19:55.762640 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:19:55.762615 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:19:55.918961 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.918920 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:19:55.919100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.918985 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:19:55.919100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.919003 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:19:55.919100 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:55.919018 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:19:56.777789 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:19:56.777757 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:19:56.778155 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:19:56.777936 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:20:08.186441 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:20:08.186410 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:20:08.186804 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:20:08.186588 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:20:23.186124 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:20:23.186093 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:20:23.186529 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:20:23.186281 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:20:38.185738 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:20:38.185709 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:20:38.186191 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:20:38.185877 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:20:52.186432 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:20:52.186398 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:20:52.186878 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:20:52.186599 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:21:04.186545 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:04.186511 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:21:04.186993 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:21:04.186686 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:21:19.192659 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:19.192627 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:21:19.193210 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:19.192950 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:21:20.266899 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:20.266818 2581 generic.go:356] "Generic (PLEG): container finished" podID="bdf15a30-d27a-408c-9cef-e901ebd02300" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" exitCode=0 Sep 09 23:21:20.267344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:20.266897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" event={"ID":"bdf15a30-d27a-408c-9cef-e901ebd02300","Type":"ContainerDied","Data":"f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09"} Sep 09 23:21:20.267344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:20.267012 2581 scope.go:117] "RemoveContainer" containerID="8b1dc4aec5675073152a87d241780dc104f7104f933c53aa8edf1a58fe22a5b1" Sep 09 23:21:20.267471 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:20.267396 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:21:20.267626 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:21:20.267600 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:21:25.918764 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:25.918722 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:21:25.919344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:25.918789 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:21:25.919344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:25.918805 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:21:25.919344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:25.918821 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" Sep 09 23:21:25.919344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:25.919200 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:21:25.919539 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:21:25.919409 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:21:38.185978 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:38.185946 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:21:38.186459 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:21:38.186124 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:21:49.185654 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:21:49.185615 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:21:49.186158 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:21:49.185855 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:22:04.185877 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:22:04.185839 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:22:04.186396 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:22:04.186039 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:22:16.186086 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:22:16.186049 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:22:16.186609 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:22:16.186245 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:22:27.189389 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:22:27.189346 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:22:27.189867 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:22:27.189563 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:22:40.185746 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:22:40.185704 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:22:40.186265 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:22:40.185971 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:22:55.186409 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:22:55.186336 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:22:55.186834 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:22:55.186496 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:23:06.186200 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:06.186171 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:23:06.188633 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:23:06.186346 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:23:10.915561 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:10.915528 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xz4l5_17fb0ec4-89b3-41cb-b592-020b25cba975/manager/0.log" Sep 09 23:23:11.405451 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:11.405423 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f4786_8f09cc5b-73fb-4ae7-b65c-5078dc925c96/manager/0.log" Sep 09 23:23:11.764019 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:11.763994 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d7ccb4-mhr58_f59580ac-a555-4cfc-b47b-1cc5582f4e07/copy-manifests/0.log" Sep 09 23:23:11.771017 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:11.770992 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d7ccb4-mhr58_f59580ac-a555-4cfc-b47b-1cc5582f4e07/manager/0.log" Sep 09 23:23:13.548413 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:13.548383 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6z2nj_6dd379b7-de8f-4063-9407-01dea958d760/limitador/0.log" Sep 09 23:23:14.015107 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:14.015078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7_5f149fdc-f02b-493d-8435-4ceb6102416e/istio-proxy/0.log" Sep 09 23:23:14.478952 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:14.478930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-852vl_c9e35571-dc07-4edd-b81e-9f702fa2be4e/istio-proxy/1.log" Sep 09 23:23:14.592189 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:14.592165 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-ncwk6_5a978e4f-3488-477d-ac95-8e9ba8adba18/payload-pre-processing/0.log" Sep 09 23:23:15.264971 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:15.264948 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-m42bx_bdf15a30-d27a-408c-9cef-e901ebd02300/main/5.log" Sep 09 23:23:15.482981 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:15.482962 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-t548q_5b3e6b91-f173-49f7-a6e2-5875b4a7f08b/main/0.log" Sep 09 23:23:15.595656 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:15.595601 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft9jrr_4a73fce6-61fe-4cba-a9e2-035c734ef4e7/main/0.log" Sep 09 23:23:19.186180 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:19.186148 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:23:19.186643 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:23:19.186395 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:23:21.203426 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.203389 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b8sjk/must-gather-rfgvr"] Sep 09 23:23:21.207115 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.207099 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8sjk/must-gather-rfgvr" Sep 09 23:23:21.210804 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.210781 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b8sjk\"/\"openshift-service-ca.crt\"" Sep 09 23:23:21.210804 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.210793 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b8sjk\"/\"default-dockercfg-8p95c\"" Sep 09 23:23:21.210959 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.210781 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b8sjk\"/\"kube-root-ca.crt\"" Sep 09 23:23:21.215774 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.215752 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8sjk/must-gather-rfgvr"] Sep 09 23:23:21.250286 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.250261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdl7t\" (UniqueName: \"kubernetes.io/projected/2f7f1ef2-45fe-4da7-a5a7-3503578d897f-kube-api-access-fdl7t\") pod \"must-gather-rfgvr\" (UID: \"2f7f1ef2-45fe-4da7-a5a7-3503578d897f\") " pod="openshift-must-gather-b8sjk/must-gather-rfgvr" Sep 09 23:23:21.250406 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.250296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2f7f1ef2-45fe-4da7-a5a7-3503578d897f-must-gather-output\") pod \"must-gather-rfgvr\" (UID: \"2f7f1ef2-45fe-4da7-a5a7-3503578d897f\") " pod="openshift-must-gather-b8sjk/must-gather-rfgvr" Sep 09 23:23:21.350852 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.350826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdl7t\" (UniqueName: \"kubernetes.io/projected/2f7f1ef2-45fe-4da7-a5a7-3503578d897f-kube-api-access-fdl7t\") pod \"must-gather-rfgvr\" (UID: \"2f7f1ef2-45fe-4da7-a5a7-3503578d897f\") " pod="openshift-must-gather-b8sjk/must-gather-rfgvr" Sep 09 23:23:21.350974 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.350862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2f7f1ef2-45fe-4da7-a5a7-3503578d897f-must-gather-output\") pod \"must-gather-rfgvr\" (UID: \"2f7f1ef2-45fe-4da7-a5a7-3503578d897f\") " pod="openshift-must-gather-b8sjk/must-gather-rfgvr" Sep 09 23:23:21.351154 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.351139 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2f7f1ef2-45fe-4da7-a5a7-3503578d897f-must-gather-output\") pod \"must-gather-rfgvr\" (UID: \"2f7f1ef2-45fe-4da7-a5a7-3503578d897f\") " pod="openshift-must-gather-b8sjk/must-gather-rfgvr" Sep 09 23:23:21.359028 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.359007 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdl7t\" (UniqueName: \"kubernetes.io/projected/2f7f1ef2-45fe-4da7-a5a7-3503578d897f-kube-api-access-fdl7t\") pod \"must-gather-rfgvr\" (UID: \"2f7f1ef2-45fe-4da7-a5a7-3503578d897f\") " pod="openshift-must-gather-b8sjk/must-gather-rfgvr" Sep 09 23:23:21.517330 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.517291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8sjk/must-gather-rfgvr" Sep 09 23:23:21.792084 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.792054 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8sjk/must-gather-rfgvr"] Sep 09 23:23:21.793337 ip-10-0-137-106 kubenswrapper[2581]: W0909 23:23:21.793283 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f7f1ef2_45fe_4da7_a5a7_3503578d897f.slice/crio-cb83d0a094a441a55e5e7a2b5153a73f057a53604617664a0ac32ee29cad3a0b WatchSource:0}: Error finding container cb83d0a094a441a55e5e7a2b5153a73f057a53604617664a0ac32ee29cad3a0b: Status 404 returned error can't find the container with id cb83d0a094a441a55e5e7a2b5153a73f057a53604617664a0ac32ee29cad3a0b Sep 09 23:23:21.962512 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:21.962482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8sjk/must-gather-rfgvr" event={"ID":"2f7f1ef2-45fe-4da7-a5a7-3503578d897f","Type":"ContainerStarted","Data":"cb83d0a094a441a55e5e7a2b5153a73f057a53604617664a0ac32ee29cad3a0b"} Sep 09 23:23:22.973941 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:22.973905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8sjk/must-gather-rfgvr" event={"ID":"2f7f1ef2-45fe-4da7-a5a7-3503578d897f","Type":"ContainerStarted","Data":"0a938461fd55b010fd43af506eb33cf80dd7942408705fdf9f797584089904a1"} Sep 09 23:23:22.973941 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:22.973955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8sjk/must-gather-rfgvr" event={"ID":"2f7f1ef2-45fe-4da7-a5a7-3503578d897f","Type":"ContainerStarted","Data":"ad7b0775cc9dbfb1c4b898d3d294fc4f02521efb35d408462fd94d43acd621f9"} Sep 09 23:23:22.990765 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:22.990716 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b8sjk/must-gather-rfgvr" podStartSLOduration=1.287932595 podStartE2EDuration="1.990701136s" totalImagesPullingTime="702.768541ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:22.988165074 +0000 UTC m=+836.320240364" watchObservedRunningTime="2026-09-09 23:23:22.990701136 +0000 UTC m=+836.322776425" Sep 09 23:23:24.025138 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:24.025106 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-72rtw_d4d06d57-79a6-4bb2-8d2f-250f618ebb80/global-pull-secret-syncer/0.log" Sep 09 23:23:24.204179 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:24.204149 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vfzlw_1c5c89a8-c85f-40ba-8165-b9b7e9cfea46/konnectivity-agent/0.log" Sep 09 23:23:24.225349 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:24.225303 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-106.ec2.internal_9e14240b2136a476f867f93a084571a5/haproxy/0.log" Sep 09 23:23:28.415782 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:28.415748 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6z2nj_6dd379b7-de8f-4063-9407-01dea958d760/limitador/0.log" Sep 09 23:23:30.061826 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.061797 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce1442b3-e8ec-4d36-ba36-4fe14e0414e8/alertmanager/0.log" Sep 09 23:23:30.088925 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.088858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce1442b3-e8ec-4d36-ba36-4fe14e0414e8/config-reloader/0.log" Sep 09 23:23:30.111204 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.111162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce1442b3-e8ec-4d36-ba36-4fe14e0414e8/kube-rbac-proxy-web/0.log" Sep 09 23:23:30.140025 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.139995 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce1442b3-e8ec-4d36-ba36-4fe14e0414e8/kube-rbac-proxy/0.log" Sep 09 23:23:30.159391 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.159351 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce1442b3-e8ec-4d36-ba36-4fe14e0414e8/kube-rbac-proxy-metric/0.log" Sep 09 23:23:30.184625 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.184601 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce1442b3-e8ec-4d36-ba36-4fe14e0414e8/prom-label-proxy/0.log" Sep 09 23:23:30.212783 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.212754 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ce1442b3-e8ec-4d36-ba36-4fe14e0414e8/init-config-reloader/0.log" Sep 09 23:23:30.354839 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.354756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56d7bcfcf8-9mnlk_88026525-de91-4288-b5fa-663370e634e2/metrics-server/0.log" Sep 09 23:23:30.418367 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.418279 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-8q5hd_15123462-5864-4a1b-898b-fbe1bc22fb18/monitoring-plugin/0.log" Sep 09 23:23:30.478757 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.478727 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64c7x_e1709014-06ad-4db8-9847-5371b785bac2/node-exporter/0.log" Sep 09 23:23:30.508368 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.508340 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64c7x_e1709014-06ad-4db8-9847-5371b785bac2/kube-rbac-proxy/0.log" Sep 09 23:23:30.534287 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.534254 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64c7x_e1709014-06ad-4db8-9847-5371b785bac2/init-textfile/0.log" Sep 09 23:23:30.726963 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.726930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-wbhjb_c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96/kube-rbac-proxy-main/0.log" Sep 09 23:23:30.761425 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.761397 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-wbhjb_c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96/kube-rbac-proxy-self/0.log" Sep 09 23:23:30.790667 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:30.789563 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-wbhjb_c5b6b22f-0af5-4f88-98a4-d1fd7ec8cb96/openshift-state-metrics/0.log" Sep 09 23:23:31.073842 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.073759 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-wbzrg_58fc35e7-b32a-440b-9e3f-8e3dd754a161/prometheus-operator/0.log" Sep 09 23:23:31.095079 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.095049 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-wbzrg_58fc35e7-b32a-440b-9e3f-8e3dd754a161/kube-rbac-proxy/0.log" Sep 09 23:23:31.121886 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.121858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-rx62s_1fd49c71-0e6b-4c88-8cd4-77adb0d083b4/prometheus-operator-admission-webhook/0.log" Sep 09 23:23:31.168693 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.168616 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bf5d6565-wvgm8_0e4095a1-b63b-43b3-bcc2-112fb7976c07/telemeter-client/0.log" Sep 09 23:23:31.193746 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.193717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bf5d6565-wvgm8_0e4095a1-b63b-43b3-bcc2-112fb7976c07/reload/0.log" Sep 09 23:23:31.222938 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.222642 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68bf5d6565-wvgm8_0e4095a1-b63b-43b3-bcc2-112fb7976c07/kube-rbac-proxy/0.log" Sep 09 23:23:31.277673 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.277591 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4bc6d59-k66hb_58bfdd96-8989-44c7-8af4-4e54a3531185/thanos-query/0.log" Sep 09 23:23:31.306523 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.306497 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4bc6d59-k66hb_58bfdd96-8989-44c7-8af4-4e54a3531185/kube-rbac-proxy-web/0.log" Sep 09 23:23:31.328730 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.328654 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4bc6d59-k66hb_58bfdd96-8989-44c7-8af4-4e54a3531185/kube-rbac-proxy/0.log" Sep 09 23:23:31.357402 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.357368 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4bc6d59-k66hb_58bfdd96-8989-44c7-8af4-4e54a3531185/prom-label-proxy/0.log" Sep 09 23:23:31.387246 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.387218 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4bc6d59-k66hb_58bfdd96-8989-44c7-8af4-4e54a3531185/kube-rbac-proxy-rules/0.log" Sep 09 23:23:31.412761 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:31.412736 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bc4bc6d59-k66hb_58bfdd96-8989-44c7-8af4-4e54a3531185/kube-rbac-proxy-metrics/0.log" Sep 09 23:23:32.186302 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:32.186231 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:23:32.186802 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:23:32.186559 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:23:33.937687 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:33.937656 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-78554754ff-grdgj_a7903efb-fdd4-44e5-813a-414e877c4577/console/0.log" Sep 09 23:23:33.976512 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:33.976480 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-p6946_5c80e9d0-b4e3-4a42-8bbf-5025da78e0ce/download-server/0.log" Sep 09 23:23:33.990376 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:33.985589 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx"] Sep 09 23:23:33.995748 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:33.995720 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:33.996948 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:33.996924 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx"] Sep 09 23:23:34.091505 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.090900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-proc\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.091505 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.090961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-podres\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.091505 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.090988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-sys\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.091505 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.091055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qtq\" (UniqueName: \"kubernetes.io/projected/caa165ec-04c5-4701-9474-7123df12359e-kube-api-access-z9qtq\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.091505 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.091125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-lib-modules\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192161 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-lib-modules\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-proc\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-podres\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-lib-modules\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-sys\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192344 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192335 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-proc\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192635 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192375 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-sys\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192635 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caa165ec-04c5-4701-9474-7123df12359e-podres\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.192635 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.192423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qtq\" (UniqueName: \"kubernetes.io/projected/caa165ec-04c5-4701-9474-7123df12359e-kube-api-access-z9qtq\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.200324 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.200285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qtq\" (UniqueName: \"kubernetes.io/projected/caa165ec-04c5-4701-9474-7123df12359e-kube-api-access-z9qtq\") pod \"perf-node-gather-daemonset-7cxvx\" (UID: \"caa165ec-04c5-4701-9474-7123df12359e\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.310006 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.309974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:34.605799 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:34.605660 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx"] Sep 09 23:23:35.101561 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:35.101519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" event={"ID":"caa165ec-04c5-4701-9474-7123df12359e","Type":"ContainerStarted","Data":"42a8bddbfe723aad1c3d9385f621a018f35fb1ac960b5517b302183fb2a2efd6"} Sep 09 23:23:35.102030 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:35.101591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" event={"ID":"caa165ec-04c5-4701-9474-7123df12359e","Type":"ContainerStarted","Data":"d1f474838a2c3125184f2724aa93d9d4e243264ca8165422fca72daa73f1ad96"} Sep 09 23:23:35.102030 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:35.101638 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:35.119328 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:35.119230 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" podStartSLOduration=2.119212294 podStartE2EDuration="2.119212294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:35.117552044 +0000 UTC m=+848.449627335" watchObservedRunningTime="2026-09-09 23:23:35.119212294 +0000 UTC m=+848.451287584" Sep 09 23:23:35.796874 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:35.796840 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jt4tm_a1406c57-5f7a-4603-bfb1-274f3a956de2/dns/0.log" Sep 09 23:23:35.818323 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:35.818286 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jt4tm_a1406c57-5f7a-4603-bfb1-274f3a956de2/kube-rbac-proxy/0.log" Sep 09 23:23:35.935877 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:35.935853 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tbnwj_f20db8a4-fabf-4205-bdef-8436a727be22/dns-node-resolver/0.log" Sep 09 23:23:36.454245 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:36.454210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-859f49dc7c-bkhhr_1007abb4-3ef5-4ff3-9099-b48ce334cc1a/registry/0.log" Sep 09 23:23:36.475334 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:36.475292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5sztf_887791de-ee8b-4a35-9682-2a2c112b28cd/node-ca/0.log" Sep 09 23:23:37.458489 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:37.458453 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7_5f149fdc-f02b-493d-8435-4ceb6102416e/istio-proxy/0.log" Sep 09 23:23:37.577461 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:37.577415 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-852vl_c9e35571-dc07-4edd-b81e-9f702fa2be4e/istio-proxy/1.log" Sep 09 23:23:37.577908 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:37.577883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-852vl_c9e35571-dc07-4edd-b81e-9f702fa2be4e/istio-proxy/0.log" Sep 09 23:23:37.600023 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:37.599996 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-ncwk6_5a978e4f-3488-477d-ac95-8e9ba8adba18/payload-pre-processing/0.log" Sep 09 23:23:38.284555 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:38.284523 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x8w9q_754321de-157e-4b69-8b09-acf6af60bd40/serve-healthcheck-canary/0.log" Sep 09 23:23:38.826008 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:38.825976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjmfv_abb64122-db22-40f5-834b-03a0d4cdfe79/kube-rbac-proxy/0.log" Sep 09 23:23:38.847377 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:38.847350 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjmfv_abb64122-db22-40f5-834b-03a0d4cdfe79/exporter/0.log" Sep 09 23:23:38.869850 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:38.869819 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjmfv_abb64122-db22-40f5-834b-03a0d4cdfe79/extractor/0.log" Sep 09 23:23:40.962013 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:40.961979 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xz4l5_17fb0ec4-89b3-41cb-b592-020b25cba975/manager/0.log" Sep 09 23:23:41.122084 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:41.121146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-7cxvx" Sep 09 23:23:41.144239 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:41.144173 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f4786_8f09cc5b-73fb-4ae7-b65c-5078dc925c96/manager/0.log" Sep 09 23:23:41.282013 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:41.281969 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d7ccb4-mhr58_f59580ac-a555-4cfc-b47b-1cc5582f4e07/manager/0.log" Sep 09 23:23:41.306924 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:41.306893 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d7ccb4-mhr58_f59580ac-a555-4cfc-b47b-1cc5582f4e07/copy-manifests/0.log" Sep 09 23:23:42.439400 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:42.439366 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6996bb7bf7-qqj4f_ab8a8c92-5d46-4e8d-8ba9-f6d78a030335/manager/0.log" Sep 09 23:23:42.466003 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:42.465977 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dxq7g_57d52a45-aa83-46f4-bc1b-745503c0315d/openshift-lws-operator/0.log" Sep 09 23:23:43.926596 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:43.926566 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7_5f149fdc-f02b-493d-8435-4ceb6102416e/istio-proxy/0.log" Sep 09 23:23:44.006975 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:44.006938 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-852vl_c9e35571-dc07-4edd-b81e-9f702fa2be4e/istio-proxy/1.log" Sep 09 23:23:44.007160 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:44.007151 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-852vl_c9e35571-dc07-4edd-b81e-9f702fa2be4e/istio-proxy/0.log" Sep 09 23:23:44.017048 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:44.017019 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-ncwk6_5a978e4f-3488-477d-ac95-8e9ba8adba18/payload-pre-processing/0.log" Sep 09 23:23:45.133720 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:45.133691 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-rzgc7_5f149fdc-f02b-493d-8435-4ceb6102416e/istio-proxy/0.log" Sep 09 23:23:45.228925 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:45.228893 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-852vl_c9e35571-dc07-4edd-b81e-9f702fa2be4e/istio-proxy/1.log" Sep 09 23:23:45.229406 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:45.229382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-852vl_c9e35571-dc07-4edd-b81e-9f702fa2be4e/istio-proxy/0.log" Sep 09 23:23:45.243093 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:45.243041 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-ncwk6_5a978e4f-3488-477d-ac95-8e9ba8adba18/payload-pre-processing/0.log" Sep 09 23:23:46.185900 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:46.185873 2581 scope.go:117] "RemoveContainer" containerID="f7aa8b4945dadcf5b490049b5b3a0abb1601052b5df79087a8a1507e2a579b09" Sep 09 23:23:46.186290 ip-10-0-137-106 kubenswrapper[2581]: E0909 23:23:46.186147 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-m42bx_llm(bdf15a30-d27a-408c-9cef-e901ebd02300)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-m42bx" podUID="bdf15a30-d27a-408c-9cef-e901ebd02300" Sep 09 23:23:47.711729 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:47.711703 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-ttbvx_83e6c88c-6c45-4b42-97e2-03ac80e00f74/migrator/0.log" Sep 09 23:23:47.731719 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:47.731694 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-ttbvx_83e6c88c-6c45-4b42-97e2-03ac80e00f74/graceful-termination/0.log" Sep 09 23:23:49.050765 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.050738 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzpt_dea9777e-85c2-45d5-a758-8fe5e5b69901/kube-multus-additional-cni-plugins/0.log" Sep 09 23:23:49.073091 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.073060 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzpt_dea9777e-85c2-45d5-a758-8fe5e5b69901/egress-router-binary-copy/0.log" Sep 09 23:23:49.095266 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.095245 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzpt_dea9777e-85c2-45d5-a758-8fe5e5b69901/cni-plugins/0.log" Sep 09 23:23:49.119473 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.119451 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzpt_dea9777e-85c2-45d5-a758-8fe5e5b69901/bond-cni-plugin/0.log" Sep 09 23:23:49.147235 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.147214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzpt_dea9777e-85c2-45d5-a758-8fe5e5b69901/routeoverride-cni/0.log" Sep 09 23:23:49.168907 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.168883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzpt_dea9777e-85c2-45d5-a758-8fe5e5b69901/whereabouts-cni-bincopy/0.log" Sep 09 23:23:49.189739 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.189716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzpt_dea9777e-85c2-45d5-a758-8fe5e5b69901/whereabouts-cni/0.log" Sep 09 23:23:49.533071 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.533042 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bg4h8_1b59474e-cb01-47ba-9694-b91ec28f3bda/kube-multus/0.log" Sep 09 23:23:49.629884 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.629857 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nb2kz_a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd/network-metrics-daemon/0.log" Sep 09 23:23:49.651168 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:49.651140 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nb2kz_a64d71a3-b97d-4e4f-aa4b-706d27e1c5cd/kube-rbac-proxy/0.log" Sep 09 23:23:50.680827 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:50.680799 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9lpg_561207ac-633f-450e-8947-c300a6dc4233/ovn-controller/0.log" Sep 09 23:23:50.698293 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:50.698258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9lpg_561207ac-633f-450e-8947-c300a6dc4233/ovn-acl-logging/0.log" Sep 09 23:23:50.722358 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:50.722334 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9lpg_561207ac-633f-450e-8947-c300a6dc4233/kube-rbac-proxy-node/0.log" Sep 09 23:23:50.745665 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:50.745639 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9lpg_561207ac-633f-450e-8947-c300a6dc4233/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 23:23:50.768859 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:50.768839 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9lpg_561207ac-633f-450e-8947-c300a6dc4233/northd/0.log" Sep 09 23:23:50.789615 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:50.789592 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9lpg_561207ac-633f-450e-8947-c300a6dc4233/nbdb/0.log" Sep 09 23:23:50.811444 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:50.811425 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9lpg_561207ac-633f-450e-8947-c300a6dc4233/sbdb/0.log" Sep 09 23:23:50.870691 ip-10-0-137-106 kubenswrapper[2581]: I0909 23:23:50.870653 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9lpg_561207ac-633f-450e-8947-c300a6dc4233/ovnkube-controller/0.log"