Sep 16 15:48:07.634188 ip-10-0-129-216 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 16 15:48:07.634208 ip-10-0-129-216 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 16 15:48:07.634219 ip-10-0-129-216 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 16 15:48:07.634471 ip-10-0-129-216 systemd[1]: Failed to start Kubernetes Kubelet. Sep 16 15:48:17.708327 ip-10-0-129-216 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 16 15:48:17.708345 ip-10-0-129-216 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 39ccd791005944df82370158d97c6709 -- Sep 16 15:49:57.704965 ip-10-0-129-216 systemd[1]: Starting Kubernetes Kubelet... Sep 16 15:49:58.093143 ip-10-0-129-216 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 15:49:58.093143 ip-10-0-129-216 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 16 15:49:58.093143 ip-10-0-129-216 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 15:49:58.093143 ip-10-0-129-216 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 16 15:49:58.093143 ip-10-0-129-216 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 15:49:58.093893 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.093203 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 16 15:49:58.096948 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096928 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 15:49:58.096948 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096947 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096951 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096956 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096962 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096966 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096970 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096973 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096976 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096979 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096981 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096984 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096988 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096990 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096993 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096996 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.096998 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097001 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097003 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097006 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 15:49:58.097019 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097009 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097012 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097014 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097017 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097020 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097022 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097025 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097028 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097031 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097034 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097036 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097039 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097042 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097044 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097048 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097051 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097054 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097056 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097060 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097064 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 15:49:58.097513 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097068 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097070 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097073 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097075 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097078 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097080 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097083 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097085 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097089 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097091 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097094 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097097 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097100 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097103 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097106 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097108 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097111 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097114 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097116 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 15:49:58.098393 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097121 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097123 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097126 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097129 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097131 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097134 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097138 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097142 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097145 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097148 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097152 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097154 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097158 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097161 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097164 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097167 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097170 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097173 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097175 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097178 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 15:49:58.099041 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097181 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097184 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097186 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097189 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097191 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097194 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097196 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097199 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097202 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097204 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097207 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097209 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097212 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097214 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097217 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097219 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097222 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097224 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097227 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 15:49:58.099524 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.097229 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099541 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099578 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099594 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099598 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099601 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099604 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099607 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099611 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099615 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099619 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099622 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099625 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099628 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099630 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099633 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099635 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099638 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099641 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 15:49:58.100008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099643 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099646 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099649 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099651 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099654 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099656 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099659 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099661 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099664 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099667 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099670 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099673 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099676 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099678 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099681 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099684 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099689 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099692 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099694 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099697 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 15:49:58.100491 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099700 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099702 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099705 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099707 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099710 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099713 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099715 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099718 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099720 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099723 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099725 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099728 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099731 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099734 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099737 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099739 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099743 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099747 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099750 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099752 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 15:49:58.101013 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099755 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099758 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099760 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099763 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099766 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099768 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099771 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099774 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099777 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099780 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099783 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099785 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099789 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099791 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099794 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099797 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099799 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099802 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099804 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099807 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 15:49:58.101498 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099810 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099812 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099814 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099817 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099821 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099826 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099829 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099832 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099835 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099838 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099840 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099843 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099846 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099849 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099852 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099854 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099857 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099860 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099863 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 15:49:58.102035 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099867 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.099870 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100282 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100287 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100289 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100299 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100303 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100306 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100309 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100312 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100315 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100318 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100321 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100323 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100326 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100329 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100332 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100334 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100337 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 15:49:58.102494 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100341 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100343 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100346 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100349 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100351 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100354 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100356 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100359 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100362 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100365 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100367 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100370 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100373 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100376 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100379 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100383 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100386 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100389 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100391 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 15:49:58.102978 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100393 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100396 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100398 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100401 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100404 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100406 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100408 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100411 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100413 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100416 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100420 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100423 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100426 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100429 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100432 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100435 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100438 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100440 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100443 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100446 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 15:49:58.103475 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100450 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100452 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100455 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100457 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100460 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100463 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100466 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100468 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100471 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100473 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100476 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100479 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100481 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100483 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100486 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100488 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100491 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100493 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100497 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100499 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 15:49:58.103983 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100502 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100504 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100507 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100509 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100512 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100514 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100518 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100520 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100523 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100525 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100528 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100531 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100533 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100536 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100538 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100540 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100543 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100546 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100549 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100552 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 15:49:58.104511 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100567 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100571 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.100573 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100653 2563 flags.go:64] FLAG: --address="0.0.0.0" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100704 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100713 2563 flags.go:64] FLAG: --anonymous-auth="true" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100731 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100738 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100742 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100747 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100751 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100755 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100758 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100761 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100765 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100768 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100771 2563 flags.go:64] FLAG: --cgroup-root="" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100774 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100777 2563 flags.go:64] FLAG: --client-ca-file="" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100781 2563 flags.go:64] FLAG: --cloud-provider="external" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100787 2563 flags.go:64] FLAG: --cluster-dns="[]" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100792 2563 flags.go:64] FLAG: --cluster-domain="" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100795 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 16 15:49:58.105008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100798 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100801 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100804 2563 flags.go:64] FLAG: --container-log-max-files="5" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100809 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100812 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100815 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100818 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100822 2563 flags.go:64] FLAG: --contention-profiling="false" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100825 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100828 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100832 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100834 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100839 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100842 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100845 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100848 2563 flags.go:64] FLAG: --enable-load-reader="false" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100851 2563 flags.go:64] FLAG: --enable-server="true" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100854 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100859 2563 flags.go:64] FLAG: --event-burst="100" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100862 2563 flags.go:64] FLAG: --event-qps="50" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100865 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100868 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100871 2563 flags.go:64] FLAG: --eviction-hard="" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100875 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 16 15:49:58.105590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100878 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100881 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100884 2563 flags.go:64] FLAG: --eviction-soft="" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100887 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100890 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100896 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100900 2563 flags.go:64] FLAG: --experimental-mounter-path="" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100902 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100905 2563 flags.go:64] FLAG: --fail-swap-on="true" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100908 2563 flags.go:64] FLAG: --feature-gates="" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100912 2563 flags.go:64] FLAG: --file-check-frequency="20s" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100915 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100918 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100922 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100925 2563 flags.go:64] FLAG: --healthz-port="10248" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100929 2563 flags.go:64] FLAG: --help="false" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100932 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100935 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100938 2563 flags.go:64] FLAG: --http-check-frequency="20s" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100941 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100945 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100949 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100952 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 16 15:49:58.106192 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100955 2563 flags.go:64] FLAG: --image-service-endpoint="" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100958 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100961 2563 flags.go:64] FLAG: --kube-api-burst="100" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100964 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100967 2563 flags.go:64] FLAG: --kube-api-qps="50" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100970 2563 flags.go:64] FLAG: --kube-reserved="" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100973 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100975 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100978 2563 flags.go:64] FLAG: --kubelet-cgroups="" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100981 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100984 2563 flags.go:64] FLAG: --lock-file="" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100986 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100989 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100992 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.100999 2563 flags.go:64] FLAG: --log-json-split-stream="false" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101003 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101006 2563 flags.go:64] FLAG: --log-text-split-stream="false" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101009 2563 flags.go:64] FLAG: --logging-format="text" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101012 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101015 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101018 2563 flags.go:64] FLAG: --manifest-url="" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101021 2563 flags.go:64] FLAG: --manifest-url-header="" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101027 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101030 2563 flags.go:64] FLAG: --max-open-files="1000000" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101034 2563 flags.go:64] FLAG: --max-pods="110" Sep 16 15:49:58.106801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101037 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101041 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101043 2563 flags.go:64] FLAG: --memory-manager-policy="None" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101047 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101050 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101053 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101056 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101064 2563 flags.go:64] FLAG: --node-status-max-images="50" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101067 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101070 2563 flags.go:64] FLAG: --oom-score-adj="-999" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101073 2563 flags.go:64] FLAG: --pod-cidr="" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101076 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101082 2563 flags.go:64] FLAG: --pod-manifest-path="" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101085 2563 flags.go:64] FLAG: --pod-max-pids="-1" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101088 2563 flags.go:64] FLAG: --pods-per-core="0" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101091 2563 flags.go:64] FLAG: --port="10250" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101094 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101097 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-035df4204581da468" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101100 2563 flags.go:64] FLAG: --qos-reserved="" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101103 2563 flags.go:64] FLAG: --read-only-port="10255" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101106 2563 flags.go:64] FLAG: --register-node="true" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101110 2563 flags.go:64] FLAG: --register-with-taints="" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101114 2563 flags.go:64] FLAG: --registry-burst="10" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101118 2563 flags.go:64] FLAG: --registry-qps="5" Sep 16 15:49:58.107407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101121 2563 flags.go:64] FLAG: --reserved-cpus="" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101124 2563 flags.go:64] FLAG: --reserved-memory="" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101127 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101131 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101134 2563 flags.go:64] FLAG: --rotate-certificates="false" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101137 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101139 2563 flags.go:64] FLAG: --runonce="false" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101142 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101145 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101148 2563 flags.go:64] FLAG: --seccomp-default="false" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101151 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101154 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101157 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101160 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101163 2563 flags.go:64] FLAG: --storage-driver-password="root" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101166 2563 flags.go:64] FLAG: --storage-driver-secure="false" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101169 2563 flags.go:64] FLAG: --storage-driver-table="stats" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101172 2563 flags.go:64] FLAG: --storage-driver-user="root" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101175 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101178 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101181 2563 flags.go:64] FLAG: --system-cgroups="" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101184 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101189 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101192 2563 flags.go:64] FLAG: --tls-cert-file="" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101196 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 16 15:49:58.108038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101200 2563 flags.go:64] FLAG: --tls-min-version="" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101203 2563 flags.go:64] FLAG: --tls-private-key-file="" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101206 2563 flags.go:64] FLAG: --topology-manager-policy="none" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101209 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101213 2563 flags.go:64] FLAG: --topology-manager-scope="container" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101216 2563 flags.go:64] FLAG: --v="2" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101220 2563 flags.go:64] FLAG: --version="false" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101225 2563 flags.go:64] FLAG: --vmodule="" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101229 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.101232 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101365 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101370 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101373 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101376 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101380 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101383 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101386 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101388 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101391 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101393 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101396 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101398 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 15:49:58.108722 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101401 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101404 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101406 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101409 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101411 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101414 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101417 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101420 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101422 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101426 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101429 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101432 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101434 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101437 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101441 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101445 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101449 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101451 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101455 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 15:49:58.109269 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101458 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101460 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101463 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101466 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101468 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101471 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101474 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101477 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101481 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101485 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101489 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101492 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101495 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101497 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101500 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101503 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101506 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101510 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101514 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101517 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 15:49:58.109779 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101520 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101523 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101529 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101532 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101535 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101538 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101541 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101545 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101548 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101551 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101566 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101569 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101572 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101575 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101578 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101581 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101584 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101586 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101589 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 15:49:58.110279 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101592 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101594 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101597 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101600 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101602 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101605 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101608 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101610 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101613 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101615 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101619 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101621 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101624 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101627 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101629 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101633 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101636 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101639 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101641 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101644 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 15:49:58.110812 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101648 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101651 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101654 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101656 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101659 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101661 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101665 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101667 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.101670 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.102140 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.109425 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.109447 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.109469 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.109475 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 16 15:49:58.111322 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109535 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109540 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109544 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109547 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109550 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109569 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109573 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109576 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109580 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109583 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109586 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109589 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109592 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109595 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109597 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109600 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109602 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109605 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109608 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 15:49:58.111734 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109613 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109617 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109621 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109623 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109626 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109632 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109635 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109638 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109641 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109644 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109648 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109650 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109653 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109656 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109659 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109662 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109665 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109667 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109670 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109680 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 15:49:58.112202 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109684 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109686 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109689 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109692 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109695 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109697 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109700 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109702 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109705 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109708 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109712 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109716 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109719 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109722 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109726 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109729 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109732 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109735 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109743 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 15:49:58.112749 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109746 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109749 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109752 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109755 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109757 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109760 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109763 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109766 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109769 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109771 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109774 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109777 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109780 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109783 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109786 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109788 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109791 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109794 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109797 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109799 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 15:49:58.113221 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109802 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109805 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109808 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109810 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109813 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109815 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109819 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109822 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109824 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109827 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109830 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109832 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109837 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109840 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109844 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109847 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109850 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109853 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109856 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 15:49:58.113756 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109859 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.109861 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.109867 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110009 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110014 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110017 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110020 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110023 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110026 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110029 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110032 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110035 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110037 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110040 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110043 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 15:49:58.114218 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110046 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110048 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110051 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110053 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110056 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110059 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110063 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110066 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110069 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110072 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110074 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110078 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110080 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110083 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110085 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110088 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110091 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110093 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110096 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110099 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 15:49:58.114630 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110101 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110105 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110109 2563 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110113 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110116 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110119 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110122 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110125 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110128 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110131 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110133 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110136 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110139 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110141 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110144 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110147 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110149 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110152 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110154 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 15:49:58.115116 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110157 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110160 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110162 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110165 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110168 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110171 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110175 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110177 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110180 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110183 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110185 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110188 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110190 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110193 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110195 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110198 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110200 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110203 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110206 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110208 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 15:49:58.115637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110211 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110213 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110216 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110218 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110221 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110224 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110226 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110229 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110232 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110235 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110237 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110240 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110243 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110246 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110248 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110251 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110253 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110256 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110259 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 15:49:58.116164 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110262 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110265 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110267 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110270 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110273 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110275 2563 feature_gate.go:328] unrecognized feature gate: Example Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110278 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110280 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:58.110283 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.110288 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.110421 2563 server.go:962] "Client rotation is on, will bootstrap in background" Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.112464 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.113588 2563 server.go:1019] "Starting client certificate rotation" Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.113691 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 15:49:58.116627 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.113726 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 15:49:58.117007 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.116017 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 15:49:58.118164 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.118135 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 15:49:58.126680 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.126639 2563 log.go:25] "Validated CRI v1 runtime API" Sep 16 15:49:58.129530 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.129510 2563 log.go:25] "Validated CRI v1 image API" Sep 16 15:49:58.130507 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.130486 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 16 15:49:58.134210 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.134186 2563 fs.go:135] Filesystem UUIDs: map[2e9396ac-15ca-4993-b55a-ab74b2e5e23a:/dev/nvme0n1p4 4c35631d-019f-47e5-bca7-31a5aab667d5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 16 15:49:58.134309 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.134205 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 16 15:49:58.140310 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.140196 2563 manager.go:216] Machine: {Timestamp:2026-09-16 15:49:58.138798322 +0000 UTC m=+0.319041053 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100666 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec236afe314abaa1db0cb1d1872ac229 SystemUUID:ec236afe-314a-baa1-db0c-b1d1872ac229 BootID:39ccd791-0059-44df-8237-0158d97c6709 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f8:75:07:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f8:75:07:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:7e:51:33:ba:ab Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 16 15:49:58.140310 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.140307 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 16 15:49:58.140454 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.140443 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 16 15:49:58.143743 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.143712 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 16 15:49:58.143892 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.143746 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 16 15:49:58.144451 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.144441 2563 topology_manager.go:138] "Creating topology manager with none policy" Sep 16 15:49:58.144485 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.144455 2563 container_manager_linux.go:309] "Creating device plugin manager" Sep 16 15:49:58.144485 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.144462 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 15:49:58.145125 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.145113 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 15:49:58.145956 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.145944 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 16 15:49:58.148851 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.148832 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 15:49:58.149811 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.149798 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 16 15:49:58.149940 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.149931 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 16 15:49:58.150478 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.150469 2563 kubelet.go:486] "Attempting to sync node with API server" Sep 16 15:49:58.150513 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.150482 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 16 15:49:58.150513 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.150498 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 16 15:49:58.150513 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.150507 2563 kubelet.go:398] "Adding apiserver pod source" Sep 16 15:49:58.150645 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.150517 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 16 15:49:58.150932 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.150920 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 15:49:58.150975 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.150938 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 15:49:58.152994 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.152977 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 16 15:49:58.155015 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.155001 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 16 15:49:58.155075 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.155032 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 16 15:49:58.156677 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156666 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 16 15:49:58.156710 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156681 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 16 15:49:58.156710 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156687 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 16 15:49:58.156710 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156693 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 16 15:49:58.156710 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156703 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 16 15:49:58.156710 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156709 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 16 15:49:58.156842 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156724 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 16 15:49:58.156842 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156733 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 16 15:49:58.156842 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156743 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 16 15:49:58.156842 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156752 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 16 15:49:58.156842 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156775 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 16 15:49:58.156842 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.156783 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 16 15:49:58.157626 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.157614 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 16 15:49:58.157657 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.157627 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 16 15:49:58.161018 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.160998 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 16 15:49:58.161096 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.161065 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 16 15:49:58.161147 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.161116 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 16 15:49:58.161794 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.161778 2563 server.go:1268] "Started kubelet" Sep 16 15:49:58.161894 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.161863 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 16 15:49:58.161964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.161877 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 16 15:49:58.162059 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.162045 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 16 15:49:58.163106 ip-10-0-129-216 systemd[1]: Started Kubernetes Kubelet. Sep 16 15:49:58.163332 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.163111 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 16 15:49:58.167384 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.166181 2563 server.go:310] "Adding debug handlers to kubelet server" Sep 16 15:49:58.169157 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.169118 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 16 15:49:58.170766 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.169871 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-216.ec2.internal.18d5d7e34ac718f4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-216.ec2.internal,UID:ip-10-0-129-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-216.ec2.internal,},FirstTimestamp:2026-09-16 15:49:58.16175026 +0000 UTC m=+0.341993160,LastTimestamp:2026-09-16 15:49:58.16175026 +0000 UTC m=+0.341993160,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-216.ec2.internal,}" Sep 16 15:49:58.172084 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.172066 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 16 15:49:58.172709 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.172693 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 16 15:49:58.172848 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.172832 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:58.173188 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173168 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 16 15:49:58.173188 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173170 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 16 15:49:58.173327 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173206 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 16 15:49:58.173327 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173275 2563 reconstruct.go:97] "Volume reconstruction finished" Sep 16 15:49:58.173327 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173285 2563 reconciler.go:29] "Reconciler: start to sync state" Sep 16 15:49:58.173911 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173896 2563 factory.go:153] Registering CRI-O factory Sep 16 15:49:58.173911 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173913 2563 factory.go:223] Registration of the crio container factory successfully Sep 16 15:49:58.174070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173967 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 16 15:49:58.174070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173976 2563 factory.go:55] Registering systemd factory Sep 16 15:49:58.174070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.173984 2563 factory.go:223] Registration of the systemd container factory successfully Sep 16 15:49:58.174070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.174000 2563 factory.go:103] Registering Raw factory Sep 16 15:49:58.174070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.174016 2563 manager.go:1196] Started watching for new ooms in manager Sep 16 15:49:58.174976 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.174956 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 16 15:49:58.175076 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.175053 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 16 15:49:58.175143 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.175130 2563 manager.go:349] Starting recovery of all containers Sep 16 15:49:58.187757 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.187730 2563 manager.go:354] Recovery completed Sep 16 15:49:58.190668 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.190606 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r2kmk" Sep 16 15:49:58.192050 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.192039 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 15:49:58.194035 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.194020 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientMemory" Sep 16 15:49:58.194112 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.194051 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 15:49:58.194112 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.194063 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientPID" Sep 16 15:49:58.194722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.194701 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 16 15:49:58.194722 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.194718 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 16 15:49:58.194842 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.194727 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 15:49:58.194842 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.194735 2563 state_mem.go:36] "Initialized new in-memory state store" Sep 16 15:49:58.195457 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.195439 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientMemory" Sep 16 15:49:58.195540 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.195467 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 15:49:58.195540 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.195483 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientPID" Sep 16 15:49:58.196714 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.196698 2563 policy_none.go:49] "None policy: Start" Sep 16 15:49:58.196714 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.196716 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 16 15:49:58.196821 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.196726 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 16 15:49:58.198417 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.198400 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r2kmk" Sep 16 15:49:58.199176 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.199164 2563 policy_none.go:47] "Start" Sep 16 15:49:58.273938 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.273907 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:58.306545 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.306500 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 16 15:49:58.307815 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.307794 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 16 15:49:58.307933 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.307849 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 16 15:49:58.307933 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.307874 2563 kubelet.go:2448] "Starting kubelet main sync loop" Sep 16 15:49:58.307933 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.307913 2563 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 16 15:49:58.310651 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.310629 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 15:49:58.364240 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.364221 2563 manager.go:337] "Starting Device Plugin manager" Sep 16 15:49:58.364383 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.364317 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 16 15:49:58.364383 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.364331 2563 server.go:87] "Starting device plugin registration server" Sep 16 15:49:58.364628 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.364617 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 16 15:49:58.364677 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.364631 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 16 15:49:58.364798 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.364753 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 16 15:49:58.364906 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.364848 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 16 15:49:58.364906 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.364859 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 16 15:49:58.365488 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.365468 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 16 15:49:58.365581 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.365524 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:58.381365 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.381338 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-216.ec2.internal\" not found" node="ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.408473 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.408433 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal"] Sep 16 15:49:58.408591 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.408537 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 15:49:58.410173 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.410156 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientMemory" Sep 16 15:49:58.410279 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.410192 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 15:49:58.410279 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.410207 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientPID" Sep 16 15:49:58.412538 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.412522 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 15:49:58.412665 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.412649 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.412771 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.412683 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 15:49:58.414239 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.413722 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientMemory" Sep 16 15:49:58.414239 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.413753 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 15:49:58.414239 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.413767 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientPID" Sep 16 15:49:58.414511 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.414319 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientMemory" Sep 16 15:49:58.414511 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.414349 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 15:49:58.414511 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.414363 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientPID" Sep 16 15:49:58.417747 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.417732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.417821 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.417759 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 15:49:58.418516 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.418500 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientMemory" Sep 16 15:49:58.418585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.418534 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 15:49:58.418585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.418550 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientPID" Sep 16 15:49:58.439468 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.439440 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-216.ec2.internal\" not found" node="ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.444001 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.443980 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-216.ec2.internal\" not found" node="ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.464960 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.464930 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 15:49:58.466094 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.466075 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientMemory" Sep 16 15:49:58.466199 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.466103 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 15:49:58.466199 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.466113 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeHasSufficientPID" Sep 16 15:49:58.466199 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.466137 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.474292 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.474266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63ad1e6b9e811b72ceb5b25bb5b9b667-config\") pod \"kube-apiserver-proxy-ip-10-0-129-216.ec2.internal\" (UID: \"63ad1e6b9e811b72ceb5b25bb5b9b667\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.474337 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.474295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/592edec6e670c8ee694a336739d0a330-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal\" (UID: \"592edec6e670c8ee694a336739d0a330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.474337 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.474317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/592edec6e670c8ee694a336739d0a330-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal\" (UID: \"592edec6e670c8ee694a336739d0a330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.475129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.475113 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.475169 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.475135 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-216.ec2.internal\": node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:58.499326 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.499298 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:58.575326 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.575288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/592edec6e670c8ee694a336739d0a330-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal\" (UID: \"592edec6e670c8ee694a336739d0a330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.575449 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.575333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/592edec6e670c8ee694a336739d0a330-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal\" (UID: \"592edec6e670c8ee694a336739d0a330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.575449 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.575352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63ad1e6b9e811b72ceb5b25bb5b9b667-config\") pod \"kube-apiserver-proxy-ip-10-0-129-216.ec2.internal\" (UID: \"63ad1e6b9e811b72ceb5b25bb5b9b667\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.575449 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.575417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/592edec6e670c8ee694a336739d0a330-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal\" (UID: \"592edec6e670c8ee694a336739d0a330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.575545 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.575417 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/592edec6e670c8ee694a336739d0a330-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal\" (UID: \"592edec6e670c8ee694a336739d0a330\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.575545 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.575421 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63ad1e6b9e811b72ceb5b25bb5b9b667-config\") pod \"kube-apiserver-proxy-ip-10-0-129-216.ec2.internal\" (UID: \"63ad1e6b9e811b72ceb5b25bb5b9b667\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.600454 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.600373 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:58.701214 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.701172 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:58.741378 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.741335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.747240 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:58.747220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" Sep 16 15:49:58.801637 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.801595 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:58.902169 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:58.902091 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:59.002645 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:59.002606 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:59.103287 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:59.103246 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:59.113432 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.113407 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 16 15:49:59.113612 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.113595 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 15:49:59.202802 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.202698 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 15:44:59 +0000 UTC" deadline="2028-04-20 09:41:34.14141407 +0000 UTC" Sep 16 15:49:59.202802 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.202737 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13961h51m34.938680778s" Sep 16 15:49:59.203793 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:59.203775 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:59.304533 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:59.304353 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:59.404605 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:59.404573 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:59.406015 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.405994 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 15:49:59.443344 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:59.443302 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592edec6e670c8ee694a336739d0a330.slice/crio-8ba30689d1ec7b5531110b5ad88e687e03f86beb5b04ceb6ee61e180ed8e77aa WatchSource:0}: Error finding container 8ba30689d1ec7b5531110b5ad88e687e03f86beb5b04ceb6ee61e180ed8e77aa: Status 404 returned error can't find the container with id 8ba30689d1ec7b5531110b5ad88e687e03f86beb5b04ceb6ee61e180ed8e77aa Sep 16 15:49:59.443659 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:49:59.443632 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ad1e6b9e811b72ceb5b25bb5b9b667.slice/crio-04ead4235817a7e804d801d5b6fb72fcbe8829bccce9b66981f9e22f0358b4f0 WatchSource:0}: Error finding container 04ead4235817a7e804d801d5b6fb72fcbe8829bccce9b66981f9e22f0358b4f0: Status 404 returned error can't find the container with id 04ead4235817a7e804d801d5b6fb72fcbe8829bccce9b66981f9e22f0358b4f0 Sep 16 15:49:59.450898 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.450880 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 15:49:59.505188 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:49:59.505127 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-216.ec2.internal\" not found" Sep 16 15:49:59.510208 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.510192 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 15:49:59.573423 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.573390 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" Sep 16 15:49:59.587046 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.587024 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 15:49:59.588859 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.588844 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" Sep 16 15:49:59.597333 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.597309 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 15:49:59.655320 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:49:59.655286 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 15:50:00.151137 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.151107 2563 apiserver.go:52] "Watching apiserver" Sep 16 15:50:00.160622 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.160581 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 16 15:50:00.161645 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.161623 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-dttjc","kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal","openshift-image-registry/node-ca-vn6lj","openshift-multus/multus-mr5sk","openshift-multus/network-metrics-daemon-6gqtz","openshift-ovn-kubernetes/ovnkube-node-fg5cd","kube-system/global-pull-secret-syncer-4vltk","kube-system/konnectivity-agent-wm9c6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc","openshift-cluster-node-tuning-operator/tuned-qwhhp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal","openshift-multus/multus-additional-cni-plugins-jqtcs","openshift-network-diagnostics/network-check-target-7g8v9"] Sep 16 15:50:00.164081 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.164057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.166410 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.166386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.167435 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.167418 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bnnxd\"" Sep 16 15:50:00.167859 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.167838 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 16 15:50:00.167986 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.167969 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 16 15:50:00.169329 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.168787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.169329 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.168806 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 16 15:50:00.169329 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.168925 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 16 15:50:00.169329 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.169014 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 16 15:50:00.169329 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.169110 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bw778\"" Sep 16 15:50:00.171259 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.171226 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 16 15:50:00.171393 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.171355 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 16 15:50:00.171499 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.171479 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 16 15:50:00.171592 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.171572 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r42z7\"" Sep 16 15:50:00.171655 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.171481 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 16 15:50:00.171867 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.171851 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:00.171963 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.171932 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:00.172280 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.172263 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 16 15:50:00.174405 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.174386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.176725 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.176703 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8pm9v\"" Sep 16 15:50:00.176816 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.176742 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 16 15:50:00.176914 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.176897 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 16 15:50:00.176979 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.176897 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 16 15:50:00.177124 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.177109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:00.177495 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.177477 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 16 15:50:00.177966 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.177946 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 16 15:50:00.178069 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.177996 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 16 15:50:00.179450 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.179429 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 16 15:50:00.179533 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.179507 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sjjqv\"" Sep 16 15:50:00.179797 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.179779 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.180281 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.180261 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 16 15:50:00.182265 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.182233 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.182962 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.182939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-systemd-units\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.183070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.182970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-var-lib-kubelet\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.183070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.182988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-system-cni-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.183070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183007 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/416d8a9f-5cca-4b46-85eb-4a33707770ee-cni-binary-copy\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.183070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-slash\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.183070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-serviceca\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.183325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-etc-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.183325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-ovn\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.183325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysctl-conf\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.183325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-etc-kubernetes\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.183325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-kubelet\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.183325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-kubernetes\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-host\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-cni-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr945\" (UniqueName: \"kubernetes.io/projected/416d8a9f-5cca-4b46-85eb-4a33707770ee-kube-api-access-wr945\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183447 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5kpw4\"" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-cni-netd\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06466182-beca-4abd-b37e-c6e64b8a669a-ovn-node-metrics-cert\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-sys\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183532 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-cnibin\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183584 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 16 15:50:00.183615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-kubelet\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-node-log\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-lib-modules\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183688 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-host\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183733 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-cni-bin\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysconfig\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysctl-d\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/216367c7-40a1-4701-a863-d3e5ff510b26-etc-tuned\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-run-netns\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-cni-bin\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-var-lib-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183874 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnt6q\" (UniqueName: \"kubernetes.io/projected/06466182-beca-4abd-b37e-c6e64b8a669a-kube-api-access-nnt6q\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-modprobe-d\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-run\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-daemon-config\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-multus-certs\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.183969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-ovnkube-config\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-env-overrides\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-log-socket\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rr69\" (UniqueName: \"kubernetes.io/projected/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-kube-api-access-8rr69\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-k8s-cni-cncf-io\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-cni-multus\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrcfd\" (UniqueName: \"kubernetes.io/projected/b1294103-6ccc-4614-b660-9e52f39240ed-kube-api-access-wrcfd\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-ovnkube-script-lib\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-systemd\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-netns\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-hostroot\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/216367c7-40a1-4701-a863-d3e5ff510b26-tmp\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-socket-dir-parent\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk9h5\" (UniqueName: \"kubernetes.io/projected/216367c7-40a1-4701-a863-d3e5ff510b26-kube-api-access-vk9h5\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.184924 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-systemd\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.185527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-run-ovn-kubernetes\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.185527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-conf-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.185527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.184951 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fw8jq\"" Sep 16 15:50:00.185527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.185157 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 16 15:50:00.185527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.185223 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:00.185527 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.185285 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:00.186054 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.186029 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 15:50:00.186054 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.186045 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 16 15:50:00.189353 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.189160 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.189353 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.189269 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:00.191811 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.191790 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.194451 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.194426 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 16 15:50:00.195865 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.195845 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 16 15:50:00.195953 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.195941 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ggnwk\"" Sep 16 15:50:00.196006 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.195966 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 16 15:50:00.205410 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.205390 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s8cq7" Sep 16 15:50:00.215334 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.215306 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s8cq7" Sep 16 15:50:00.274368 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.274338 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 16 15:50:00.285490 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-cnibin\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.285490 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-kubelet\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.285490 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-node-log\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-lib-modules\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-host\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285546 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-cnibin\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-node-log\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285620 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-host\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-cni-bin\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysconfig\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285664 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-kubelet\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysctl-d\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285697 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-lib-modules\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285713 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-cni-bin\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/216367c7-40a1-4701-a863-d3e5ff510b26-etc-tuned\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-run-netns\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285769 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysconfig\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.285772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-cni-bin\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285806 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysctl-d\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-sys-fs\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285826 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-run-netns\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-host-slash\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285870 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-cni-bin\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-var-lib-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnt6q\" (UniqueName: \"kubernetes.io/projected/06466182-beca-4abd-b37e-c6e64b8a669a-kube-api-access-nnt6q\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-modprobe-d\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.285961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-var-lib-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286006 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-modprobe-d\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-run\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286062 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-iptables-alerter-script\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-daemon-config\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-multus-certs\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.286585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286179 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-run\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286248 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-multus-certs\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-ovnkube-config\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.286285 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-env-overrides\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.286446 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:50:00.78642238 +0000 UTC m=+2.966665100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-log-socket\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-socket-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-daemon-config\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/639c65c1-532e-4ebb-b896-8a5a33158004-kubelet-config\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286809 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-env-overrides\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286826 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-log-socket\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rr69\" (UniqueName: \"kubernetes.io/projected/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-kube-api-access-8rr69\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-k8s-cni-cncf-io\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.287359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286887 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-ovnkube-config\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-k8s-cni-cncf-io\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.286973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/639c65c1-532e-4ebb-b896-8a5a33158004-dbus\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-cni-multus\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrcfd\" (UniqueName: \"kubernetes.io/projected/b1294103-6ccc-4614-b660-9e52f39240ed-kube-api-access-wrcfd\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287055 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-ovnkube-script-lib\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287064 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-var-lib-cni-multus\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-systemd\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-etc-selinux\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-netns\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287309 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-systemd\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287319 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-hostroot\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/216367c7-40a1-4701-a863-d3e5ff510b26-tmp\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287359 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-hostroot\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287387 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-host-run-netns\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287420 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06466182-beca-4abd-b37e-c6e64b8a669a-ovnkube-script-lib\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.288202 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91bf516f-486b-4d8d-885a-7a102f9bd961-agent-certs\") pod \"konnectivity-agent-wm9c6\" (UID: \"91bf516f-486b-4d8d-885a-7a102f9bd961\") " pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287482 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91bf516f-486b-4d8d-885a-7a102f9bd961-konnectivity-ca\") pod \"konnectivity-agent-wm9c6\" (UID: \"91bf516f-486b-4d8d-885a-7a102f9bd961\") " pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cnibin\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-socket-dir-parent\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk9h5\" (UniqueName: \"kubernetes.io/projected/216367c7-40a1-4701-a863-d3e5ff510b26-kube-api-access-vk9h5\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287709 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-socket-dir-parent\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287739 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-system-cni-dir\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-systemd\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-run-ovn-kubernetes\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287864 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-systemd\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-conf-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287889 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-run-ovn-kubernetes\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289005 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-systemd-units\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-var-lib-kubelet\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287941 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-conf-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-registration-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287980 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-systemd-units\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-system-cni-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.287995 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-var-lib-kubelet\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/416d8a9f-5cca-4b46-85eb-4a33707770ee-cni-binary-copy\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-slash\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288072 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-system-cni-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288082 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-serviceca\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-etc-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-ovn\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysctl-conf\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288182 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-etc-openvswitch\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-etc-kubernetes\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-kubelet\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288244 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-slash\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.289828 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-kubernetes\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288290 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-run-ovn\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-host\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288318 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-sysctl-conf\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288327 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-kubelet\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288334 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-device-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj942\" (UniqueName: \"kubernetes.io/projected/9fed7df2-9d30-4bb7-b890-529b9ee797f1-kube-api-access-xj942\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288362 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-etc-kubernetes\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p79qq\" (UniqueName: \"kubernetes.io/projected/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-kube-api-access-p79qq\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288363 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-etc-kubernetes\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288393 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-cni-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288425 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-host\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr945\" (UniqueName: \"kubernetes.io/projected/416d8a9f-5cca-4b46-85eb-4a33707770ee-kube-api-access-wr945\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-cni-netd\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288483 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-serviceca\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.290673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288515 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06466182-beca-4abd-b37e-c6e64b8a669a-host-cni-netd\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.291497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288523 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/416d8a9f-5cca-4b46-85eb-4a33707770ee-cni-binary-copy\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.291497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288533 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/416d8a9f-5cca-4b46-85eb-4a33707770ee-multus-cni-dir\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.291497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06466182-beca-4abd-b37e-c6e64b8a669a-ovn-node-metrics-cert\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.291497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-sys\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.291497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgh2r\" (UniqueName: \"kubernetes.io/projected/9340fa2a-cec0-434b-87d6-cfea7b636a63-kube-api-access-hgh2r\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.291497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.288671 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/216367c7-40a1-4701-a863-d3e5ff510b26-sys\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.291497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.291210 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/216367c7-40a1-4701-a863-d3e5ff510b26-etc-tuned\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.291497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.291259 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/216367c7-40a1-4701-a863-d3e5ff510b26-tmp\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.291978 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.291924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06466182-beca-4abd-b37e-c6e64b8a669a-ovn-node-metrics-cert\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.296331 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.296309 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnt6q\" (UniqueName: \"kubernetes.io/projected/06466182-beca-4abd-b37e-c6e64b8a669a-kube-api-access-nnt6q\") pod \"ovnkube-node-fg5cd\" (UID: \"06466182-beca-4abd-b37e-c6e64b8a669a\") " pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.296697 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.296676 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr945\" (UniqueName: \"kubernetes.io/projected/416d8a9f-5cca-4b46-85eb-4a33707770ee-kube-api-access-wr945\") pod \"multus-mr5sk\" (UID: \"416d8a9f-5cca-4b46-85eb-4a33707770ee\") " pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.298016 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.297831 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 15:50:00.298112 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.298084 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rr69\" (UniqueName: \"kubernetes.io/projected/eb1c4416-dc01-4dd8-b0a0-fc2338c092b1-kube-api-access-8rr69\") pod \"node-ca-vn6lj\" (UID: \"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1\") " pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.298630 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.298604 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrcfd\" (UniqueName: \"kubernetes.io/projected/b1294103-6ccc-4614-b660-9e52f39240ed-kube-api-access-wrcfd\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:00.298850 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.298825 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk9h5\" (UniqueName: \"kubernetes.io/projected/216367c7-40a1-4701-a863-d3e5ff510b26-kube-api-access-vk9h5\") pod \"tuned-qwhhp\" (UID: \"216367c7-40a1-4701-a863-d3e5ff510b26\") " pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.315615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.315536 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" event={"ID":"592edec6e670c8ee694a336739d0a330","Type":"ContainerStarted","Data":"8ba30689d1ec7b5531110b5ad88e687e03f86beb5b04ceb6ee61e180ed8e77aa"} Sep 16 15:50:00.317302 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.317274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" event={"ID":"63ad1e6b9e811b72ceb5b25bb5b9b667","Type":"ContainerStarted","Data":"04ead4235817a7e804d801d5b6fb72fcbe8829bccce9b66981f9e22f0358b4f0"} Sep 16 15:50:00.389864 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.389829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-etc-selinux\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.389864 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.389873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91bf516f-486b-4d8d-885a-7a102f9bd961-agent-certs\") pod \"konnectivity-agent-wm9c6\" (UID: \"91bf516f-486b-4d8d-885a-7a102f9bd961\") " pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.389897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91bf516f-486b-4d8d-885a-7a102f9bd961-konnectivity-ca\") pod \"konnectivity-agent-wm9c6\" (UID: \"91bf516f-486b-4d8d-885a-7a102f9bd961\") " pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.389924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cnibin\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.389943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.389969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.389989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-system-cni-dir\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-registration-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-device-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj942\" (UniqueName: \"kubernetes.io/projected/9fed7df2-9d30-4bb7-b890-529b9ee797f1-kube-api-access-xj942\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.390095 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p79qq\" (UniqueName: \"kubernetes.io/projected/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-kube-api-access-p79qq\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgh2r\" (UniqueName: \"kubernetes.io/projected/9340fa2a-cec0-434b-87d6-cfea7b636a63-kube-api-access-hgh2r\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-sys-fs\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390149 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-host-slash\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390198 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-iptables-alerter-script\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-socket-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/639c65c1-532e-4ebb-b896-8a5a33158004-kubelet-config\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/639c65c1-532e-4ebb-b896-8a5a33158004-dbus\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390413 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/639c65c1-532e-4ebb-b896-8a5a33158004-dbus\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.390515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.390511 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-etc-selinux\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.391239 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391212 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.391310 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391278 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cnibin\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.391847 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.391847 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391668 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91bf516f-486b-4d8d-885a-7a102f9bd961-konnectivity-ca\") pod \"konnectivity-agent-wm9c6\" (UID: \"91bf516f-486b-4d8d-885a-7a102f9bd961\") " pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:00.391847 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391741 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/639c65c1-532e-4ebb-b896-8a5a33158004-kubelet-config\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:00.391847 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391748 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9fed7df2-9d30-4bb7-b890-529b9ee797f1-system-cni-dir\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.391847 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391789 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-registration-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.391847 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391808 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-device-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.392184 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391910 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-socket-dir\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.392184 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391938 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.392184 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391966 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9340fa2a-cec0-434b-87d6-cfea7b636a63-sys-fs\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.392184 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391997 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-host-slash\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.392184 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.391938 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-iptables-alerter-script\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.392184 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.392028 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:00.392184 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.392090 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret podName:639c65c1-532e-4ebb-b896-8a5a33158004 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:00.892074189 +0000 UTC m=+3.072316917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret") pod "global-pull-secret-syncer-4vltk" (UID: "639c65c1-532e-4ebb-b896-8a5a33158004") : object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:00.392527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.392411 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.392527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.392481 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9fed7df2-9d30-4bb7-b890-529b9ee797f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.393608 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.393308 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91bf516f-486b-4d8d-885a-7a102f9bd961-agent-certs\") pod \"konnectivity-agent-wm9c6\" (UID: \"91bf516f-486b-4d8d-885a-7a102f9bd961\") " pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:00.399338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.399310 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p79qq\" (UniqueName: \"kubernetes.io/projected/5d8908e3-940b-413e-b4c8-d90b1e57ecc6-kube-api-access-p79qq\") pod \"iptables-alerter-dttjc\" (UID: \"5d8908e3-940b-413e-b4c8-d90b1e57ecc6\") " pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:00.400909 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.400666 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 15:50:00.400909 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.400686 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 15:50:00.400909 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.400697 2563 projected.go:196] Error preparing data for projected volume kube-api-access-cdmjq for pod openshift-network-diagnostics/network-check-target-7g8v9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:00.400909 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:00.400742 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq podName:e9460ed2-7f64-4f4f-ba99-0f63b6a6d151 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:00.900729432 +0000 UTC m=+3.080972151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cdmjq" (UniqueName: "kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq") pod "network-check-target-7g8v9" (UID: "e9460ed2-7f64-4f4f-ba99-0f63b6a6d151") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:00.400909 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.400663 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj942\" (UniqueName: \"kubernetes.io/projected/9fed7df2-9d30-4bb7-b890-529b9ee797f1-kube-api-access-xj942\") pod \"multus-additional-cni-plugins-jqtcs\" (UID: \"9fed7df2-9d30-4bb7-b890-529b9ee797f1\") " pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:00.403209 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.403152 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgh2r\" (UniqueName: \"kubernetes.io/projected/9340fa2a-cec0-434b-87d6-cfea7b636a63-kube-api-access-hgh2r\") pod \"aws-ebs-csi-driver-node-ch6tc\" (UID: \"9340fa2a-cec0-434b-87d6-cfea7b636a63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:00.477212 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.477169 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" Sep 16 15:50:00.485619 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.485596 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr5sk" Sep 16 15:50:00.487986 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:00.487951 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216367c7_40a1_4701_a863_d3e5ff510b26.slice/crio-0d0a085598e57d4df34c5d8ce8359defcca4aa6551a455949953229aa85199f4 WatchSource:0}: Error finding container 0d0a085598e57d4df34c5d8ce8359defcca4aa6551a455949953229aa85199f4: Status 404 returned error can't find the container with id 0d0a085598e57d4df34c5d8ce8359defcca4aa6551a455949953229aa85199f4 Sep 16 15:50:00.494665 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.494641 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vn6lj" Sep 16 15:50:00.495885 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:00.495848 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416d8a9f_5cca_4b46_85eb_4a33707770ee.slice/crio-063bdb398ca174120fdaeaa791f9ad5f10f4a82702b992027d9e1597735f7750 WatchSource:0}: Error finding container 063bdb398ca174120fdaeaa791f9ad5f10f4a82702b992027d9e1597735f7750: Status 404 returned error can't find the container with id 063bdb398ca174120fdaeaa791f9ad5f10f4a82702b992027d9e1597735f7750 Sep 16 15:50:00.499595 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.499569 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:00.504239 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:00.504212 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1c4416_dc01_4dd8_b0a0_fc2338c092b1.slice/crio-f0fe0d05b2f00bb103d3f76da8e884f5ce3f7d0afbd11f7d13ea70c4910b1b09 WatchSource:0}: Error finding container f0fe0d05b2f00bb103d3f76da8e884f5ce3f7d0afbd11f7d13ea70c4910b1b09: Status 404 returned error can't find the container with id f0fe0d05b2f00bb103d3f76da8e884f5ce3f7d0afbd11f7d13ea70c4910b1b09 Sep 16 15:50:00.507213 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.507133 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:00.509972 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:00.509948 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06466182_beca_4abd_b37e_c6e64b8a669a.slice/crio-521a8393566b05a1a0c58126490e5d1aadcb8057ffdda98957fd6af364dddd98 WatchSource:0}: Error finding container 521a8393566b05a1a0c58126490e5d1aadcb8057ffdda98957fd6af364dddd98: Status 404 returned error can't find the container with id 521a8393566b05a1a0c58126490e5d1aadcb8057ffdda98957fd6af364dddd98 Sep 16 15:50:00.514985 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:00.514963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" Sep 16 15:50:01.780634 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:01.780598 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bf516f_486b_4d8d_885a_7a102f9bd961.slice/crio-6e47c287a6c7b9387c68e759d219af74ed6a182f27bcd410f7945043f5ef7b69 WatchSource:0}: Error finding container 6e47c287a6c7b9387c68e759d219af74ed6a182f27bcd410f7945043f5ef7b69: Status 404 returned error can't find the container with id 6e47c287a6c7b9387c68e759d219af74ed6a182f27bcd410f7945043f5ef7b69 Sep 16 15:50:01.783076 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:01.783053 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" Sep 16 15:50:01.786907 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:01.786876 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9340fa2a_cec0_434b_87d6_cfea7b636a63.slice/crio-cc6af1dc1a7ec0363724167e88a86a30e36c9725f55857553f105e5eec6aac95 WatchSource:0}: Error finding container cc6af1dc1a7ec0363724167e88a86a30e36c9725f55857553f105e5eec6aac95: Status 404 returned error can't find the container with id cc6af1dc1a7ec0363724167e88a86a30e36c9725f55857553f105e5eec6aac95 Sep 16 15:50:01.788451 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:01.788430 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dttjc" Sep 16 15:50:01.800340 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:01.800310 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8908e3_940b_413e_b4c8_d90b1e57ecc6.slice/crio-0aa101e8bf7f0acdd3af6cbb7ebda85305e25a3370e8844c937575d43e6251f5 WatchSource:0}: Error finding container 0aa101e8bf7f0acdd3af6cbb7ebda85305e25a3370e8844c937575d43e6251f5: Status 404 returned error can't find the container with id 0aa101e8bf7f0acdd3af6cbb7ebda85305e25a3370e8844c937575d43e6251f5 Sep 16 15:50:02.054590 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.054495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:02.054781 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:02.054650 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:02.054781 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:02.054729 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:50:03.054708844 +0000 UTC m=+3.973771606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:02.155352 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.155314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:02.155531 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:02.155494 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:02.155630 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:02.155564 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret podName:639c65c1-532e-4ebb-b896-8a5a33158004 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:03.155548977 +0000 UTC m=+4.074611758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret") pod "global-pull-secret-syncer-4vltk" (UID: "639c65c1-532e-4ebb-b896-8a5a33158004") : object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:02.256086 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.256044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:02.256280 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:02.256256 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 15:50:02.256330 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:02.256290 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 15:50:02.256330 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:02.256303 2563 projected.go:196] Error preparing data for projected volume kube-api-access-cdmjq for pod openshift-network-diagnostics/network-check-target-7g8v9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:02.256422 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:02.256368 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq podName:e9460ed2-7f64-4f4f-ba99-0f63b6a6d151 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:03.256349266 +0000 UTC m=+4.175412028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdmjq" (UniqueName: "kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq") pod "network-check-target-7g8v9" (UID: "e9460ed2-7f64-4f4f-ba99-0f63b6a6d151") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:02.479908 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.479804 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 15:45:01 +0000 UTC" deadline="2028-04-25 01:51:58.971707238 +0000 UTC" Sep 16 15:50:02.479908 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.479857 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14074h1m56.491854062s" Sep 16 15:50:02.581557 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.581527 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerStarted","Data":"a3b4ed135e47be8ab748a3920c1f4d908afd56d3f313064d5459796542975ba9"} Sep 16 15:50:02.582688 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.582659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" event={"ID":"9340fa2a-cec0-434b-87d6-cfea7b636a63","Type":"ContainerStarted","Data":"cc6af1dc1a7ec0363724167e88a86a30e36c9725f55857553f105e5eec6aac95"} Sep 16 15:50:02.583724 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.583694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wm9c6" event={"ID":"91bf516f-486b-4d8d-885a-7a102f9bd961","Type":"ContainerStarted","Data":"6e47c287a6c7b9387c68e759d219af74ed6a182f27bcd410f7945043f5ef7b69"} Sep 16 15:50:02.584623 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.584604 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" event={"ID":"216367c7-40a1-4701-a863-d3e5ff510b26","Type":"ContainerStarted","Data":"0d0a085598e57d4df34c5d8ce8359defcca4aa6551a455949953229aa85199f4"} Sep 16 15:50:02.585878 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.585853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dttjc" event={"ID":"5d8908e3-940b-413e-b4c8-d90b1e57ecc6","Type":"ContainerStarted","Data":"0aa101e8bf7f0acdd3af6cbb7ebda85305e25a3370e8844c937575d43e6251f5"} Sep 16 15:50:02.588839 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.588814 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"521a8393566b05a1a0c58126490e5d1aadcb8057ffdda98957fd6af364dddd98"} Sep 16 15:50:02.590058 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.590039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vn6lj" event={"ID":"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1","Type":"ContainerStarted","Data":"f0fe0d05b2f00bb103d3f76da8e884f5ce3f7d0afbd11f7d13ea70c4910b1b09"} Sep 16 15:50:02.591011 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:02.590993 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr5sk" event={"ID":"416d8a9f-5cca-4b46-85eb-4a33707770ee","Type":"ContainerStarted","Data":"063bdb398ca174120fdaeaa791f9ad5f10f4a82702b992027d9e1597735f7750"} Sep 16 15:50:03.061598 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.061563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:03.061809 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.061747 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:03.061874 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.061817 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:50:05.061797835 +0000 UTC m=+5.980860617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:03.162817 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.162775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:03.163020 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.163004 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:03.163099 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.163081 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret podName:639c65c1-532e-4ebb-b896-8a5a33158004 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:05.163063373 +0000 UTC m=+6.082126136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret") pod "global-pull-secret-syncer-4vltk" (UID: "639c65c1-532e-4ebb-b896-8a5a33158004") : object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:03.263690 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.263648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:03.263886 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.263865 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 15:50:03.263981 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.263897 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 15:50:03.263981 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.263912 2563 projected.go:196] Error preparing data for projected volume kube-api-access-cdmjq for pod openshift-network-diagnostics/network-check-target-7g8v9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:03.263981 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.263970 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq podName:e9460ed2-7f64-4f4f-ba99-0f63b6a6d151 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:05.263951791 +0000 UTC m=+6.183014562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdmjq" (UniqueName: "kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq") pod "network-check-target-7g8v9" (UID: "e9460ed2-7f64-4f4f-ba99-0f63b6a6d151") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:03.480471 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.480326 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 15:45:01 +0000 UTC" deadline="2028-06-05 16:14:10.817210068 +0000 UTC" Sep 16 15:50:03.480471 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.480390 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15072h24m7.336823874s" Sep 16 15:50:03.571597 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.569761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:03.571597 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.570123 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:03.571597 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.570569 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:03.571597 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.570698 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:03.571597 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.570813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:03.571597 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:03.570893 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:03.599322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.599089 2563 generic.go:356] "Generic (PLEG): container finished" podID="592edec6e670c8ee694a336739d0a330" containerID="4416123f8cde0895204201663ff2aa93e89289c2df3d0c5fa209dc3d4aa78e1e" exitCode=0 Sep 16 15:50:03.599322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.599172 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" event={"ID":"592edec6e670c8ee694a336739d0a330","Type":"ContainerDied","Data":"4416123f8cde0895204201663ff2aa93e89289c2df3d0c5fa209dc3d4aa78e1e"} Sep 16 15:50:03.610554 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.606184 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" event={"ID":"63ad1e6b9e811b72ceb5b25bb5b9b667","Type":"ContainerStarted","Data":"309f0cf6dac5bc030042ddb1c27aef8250febf4a771fe8df35fbd116eadfc394"} Sep 16 15:50:03.628932 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:03.628861 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-216.ec2.internal" podStartSLOduration=3.628837939 podStartE2EDuration="3.628837939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:03.628587737 +0000 UTC m=+4.547650518" watchObservedRunningTime="2026-09-16 15:50:03.628837939 +0000 UTC m=+4.547900719" Sep 16 15:50:04.614893 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:04.614791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" event={"ID":"592edec6e670c8ee694a336739d0a330","Type":"ContainerStarted","Data":"c14f67687d9588c97a56cc1221fb98f6f371c674bb7f28f963b2c653b66f4874"} Sep 16 15:50:05.080325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:05.079674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:05.080325 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.079869 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:05.080325 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.079934 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:50:09.079915523 +0000 UTC m=+9.998978284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:05.180907 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:05.180273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:05.180907 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.180483 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:05.180907 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.180547 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret podName:639c65c1-532e-4ebb-b896-8a5a33158004 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:09.180528864 +0000 UTC m=+10.099591624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret") pod "global-pull-secret-syncer-4vltk" (UID: "639c65c1-532e-4ebb-b896-8a5a33158004") : object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:05.281581 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:05.280969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:05.281581 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.281137 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 15:50:05.281581 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.281161 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 15:50:05.281581 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.281174 2563 projected.go:196] Error preparing data for projected volume kube-api-access-cdmjq for pod openshift-network-diagnostics/network-check-target-7g8v9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:05.281581 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.281244 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq podName:e9460ed2-7f64-4f4f-ba99-0f63b6a6d151 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:09.281226861 +0000 UTC m=+10.200289631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdmjq" (UniqueName: "kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq") pod "network-check-target-7g8v9" (UID: "e9460ed2-7f64-4f4f-ba99-0f63b6a6d151") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:05.569760 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:05.569653 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:05.569926 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.569799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:05.569926 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:05.569896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:05.570075 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.570043 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:05.570075 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:05.569653 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:05.570185 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:05.570166 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:07.569850 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:07.569813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:07.570291 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:07.569947 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:07.570409 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:07.570372 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:07.570521 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:07.570499 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:07.570571 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:07.570534 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:07.570625 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:07.570603 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:08.108019 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.107958 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-216.ec2.internal" podStartSLOduration=8.107936576 podStartE2EDuration="8.107936576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:04.633023945 +0000 UTC m=+5.552086725" watchObservedRunningTime="2026-09-16 15:50:08.107936576 +0000 UTC m=+9.026999357" Sep 16 15:50:08.108767 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.108730 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-tp625"] Sep 16 15:50:08.112943 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.112917 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.115639 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.115496 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6znhp\"" Sep 16 15:50:08.115639 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.115524 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 16 15:50:08.115907 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.115875 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 16 15:50:08.208585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.208539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb310b60-a1e1-4961-99a2-80ffefa53f86-tmp-dir\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.208774 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.208602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmm6f\" (UniqueName: \"kubernetes.io/projected/eb310b60-a1e1-4961-99a2-80ffefa53f86-kube-api-access-lmm6f\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.208774 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.208709 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb310b60-a1e1-4961-99a2-80ffefa53f86-hosts-file\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.309281 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.309241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmm6f\" (UniqueName: \"kubernetes.io/projected/eb310b60-a1e1-4961-99a2-80ffefa53f86-kube-api-access-lmm6f\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.309438 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.309307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb310b60-a1e1-4961-99a2-80ffefa53f86-hosts-file\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.309438 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.309377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb310b60-a1e1-4961-99a2-80ffefa53f86-tmp-dir\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.309557 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.309501 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb310b60-a1e1-4961-99a2-80ffefa53f86-hosts-file\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.309721 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.309698 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb310b60-a1e1-4961-99a2-80ffefa53f86-tmp-dir\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.319705 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.319667 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmm6f\" (UniqueName: \"kubernetes.io/projected/eb310b60-a1e1-4961-99a2-80ffefa53f86-kube-api-access-lmm6f\") pod \"node-resolver-tp625\" (UID: \"eb310b60-a1e1-4961-99a2-80ffefa53f86\") " pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:08.424690 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:08.424535 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tp625" Sep 16 15:50:09.117174 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:09.117120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:09.117705 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.117268 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:09.117705 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.117354 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:50:17.117331129 +0000 UTC m=+18.036393891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:09.218520 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:09.218412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:09.218707 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.218571 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:09.218707 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.218656 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret podName:639c65c1-532e-4ebb-b896-8a5a33158004 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:17.218633844 +0000 UTC m=+18.137696638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret") pod "global-pull-secret-syncer-4vltk" (UID: "639c65c1-532e-4ebb-b896-8a5a33158004") : object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:09.319375 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:09.319342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:09.319526 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.319471 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 15:50:09.319526 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.319493 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 15:50:09.319526 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.319507 2563 projected.go:196] Error preparing data for projected volume kube-api-access-cdmjq for pod openshift-network-diagnostics/network-check-target-7g8v9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:09.319658 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.319614 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq podName:e9460ed2-7f64-4f4f-ba99-0f63b6a6d151 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:17.319583167 +0000 UTC m=+18.238645935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdmjq" (UniqueName: "kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq") pod "network-check-target-7g8v9" (UID: "e9460ed2-7f64-4f4f-ba99-0f63b6a6d151") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:09.572018 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:09.571170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:09.572018 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.571300 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:09.572018 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:09.571677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:09.572018 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.571790 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:09.572018 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:09.571845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:09.572018 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:09.571931 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:11.570262 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:11.569683 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:11.570262 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:11.569731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:11.570262 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:11.569683 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:11.570262 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:11.569846 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:11.570262 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:11.569950 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:11.570262 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:11.570033 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:13.569888 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:13.569847 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:13.570400 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:13.569865 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:13.570400 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:13.569975 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:13.570400 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:13.569981 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:13.570400 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:13.570051 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:13.570400 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:13.570165 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:15.570366 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:15.570326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:15.570811 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:15.570337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:15.570811 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:15.570471 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:15.570811 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:15.570337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:15.570811 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:15.570538 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:15.570811 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:15.570626 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:17.176369 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:17.176322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:17.176915 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.176507 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:17.176915 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.176593 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:50:33.176571413 +0000 UTC m=+34.095634174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:17.277247 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:17.277211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:17.277425 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.277373 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:17.277482 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.277448 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret podName:639c65c1-532e-4ebb-b896-8a5a33158004 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:33.277431059 +0000 UTC m=+34.196493834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret") pod "global-pull-secret-syncer-4vltk" (UID: "639c65c1-532e-4ebb-b896-8a5a33158004") : object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:17.377921 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:17.377884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:17.378122 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.378032 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 15:50:17.378122 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.378051 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 15:50:17.378122 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.378060 2563 projected.go:196] Error preparing data for projected volume kube-api-access-cdmjq for pod openshift-network-diagnostics/network-check-target-7g8v9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:17.378122 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.378112 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq podName:e9460ed2-7f64-4f4f-ba99-0f63b6a6d151 nodeName:}" failed. No retries permitted until 2026-09-16 15:50:33.37809649 +0000 UTC m=+34.297159261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdmjq" (UniqueName: "kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq") pod "network-check-target-7g8v9" (UID: "e9460ed2-7f64-4f4f-ba99-0f63b6a6d151") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:17.569936 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:17.569841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:17.570105 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:17.569844 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:17.570105 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.569983 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:17.570105 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:17.569845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:17.570105 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.570072 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:17.570310 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:17.570112 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:19.570360 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:19.570275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:19.570856 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:19.570389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:19.570856 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:19.570403 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:19.570856 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:19.570500 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:19.570856 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:19.570535 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:19.570856 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:19.570567 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:20.195441 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:20.195400 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb310b60_a1e1_4961_99a2_80ffefa53f86.slice/crio-21529e680d282ae7455d790d415692c92ca490349c7bb7da620dd12ec6eaa1bb WatchSource:0}: Error finding container 21529e680d282ae7455d790d415692c92ca490349c7bb7da620dd12ec6eaa1bb: Status 404 returned error can't find the container with id 21529e680d282ae7455d790d415692c92ca490349c7bb7da620dd12ec6eaa1bb Sep 16 15:50:20.648201 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.648003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"80e0e010f5423439cb201bd9d5cd0ce51992b4b5f142a6905f0b797d56707751"} Sep 16 15:50:20.648968 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.648294 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"cfb01570e56f49abac05adf05ea50d1ac2bc5d9ec6b177587d9bcf773e285955"} Sep 16 15:50:20.648968 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.648337 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"dbbb4132db0b4f648fd719df7303194118e167650103aa5caca051fb6a06d8d1"} Sep 16 15:50:20.649540 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.649512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vn6lj" event={"ID":"eb1c4416-dc01-4dd8-b0a0-fc2338c092b1","Type":"ContainerStarted","Data":"dbcafb706733b58529792434e6e372c09818dbb0a3ba80b432a64d3fca0acc2e"} Sep 16 15:50:20.650922 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.650894 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr5sk" event={"ID":"416d8a9f-5cca-4b46-85eb-4a33707770ee","Type":"ContainerStarted","Data":"d1bc350948035fda535975f5694c747af5d7587a7fd238290251dabe0c08fa6b"} Sep 16 15:50:20.652297 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.652271 2563 generic.go:356] "Generic (PLEG): container finished" podID="9fed7df2-9d30-4bb7-b890-529b9ee797f1" containerID="fdf0a4e3b0a93b6218339d50ece35fae63d87a18e70e9d7535ef0fffe0c710de" exitCode=0 Sep 16 15:50:20.652398 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.652349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerDied","Data":"fdf0a4e3b0a93b6218339d50ece35fae63d87a18e70e9d7535ef0fffe0c710de"} Sep 16 15:50:20.653705 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.653686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" event={"ID":"9340fa2a-cec0-434b-87d6-cfea7b636a63","Type":"ContainerStarted","Data":"bff20b91a79d1d55adc79b14043a005c496262d602894ef5bc3ca9357bf30093"} Sep 16 15:50:20.655075 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.655052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wm9c6" event={"ID":"91bf516f-486b-4d8d-885a-7a102f9bd961","Type":"ContainerStarted","Data":"3f9eaad2bf8c2869aab07b86551ac820b611ecd6c04983ac48af5cc698a230b0"} Sep 16 15:50:20.656643 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.656622 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" event={"ID":"216367c7-40a1-4701-a863-d3e5ff510b26","Type":"ContainerStarted","Data":"ae05bf4a690d9e3b7f4f9f01f451ffc92e9594d4fa7723354b97be6879ecb518"} Sep 16 15:50:20.658444 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.658425 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tp625" event={"ID":"eb310b60-a1e1-4961-99a2-80ffefa53f86","Type":"ContainerStarted","Data":"ad3b435f15dae3e0f457c15e863214a3d961b161b8a485cd6cb72b9b40cb1bb6"} Sep 16 15:50:20.658536 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.658464 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tp625" event={"ID":"eb310b60-a1e1-4961-99a2-80ffefa53f86","Type":"ContainerStarted","Data":"21529e680d282ae7455d790d415692c92ca490349c7bb7da620dd12ec6eaa1bb"} Sep 16 15:50:20.664476 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.664428 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vn6lj" podStartSLOduration=3.221661128 podStartE2EDuration="21.664412554s" totalImagesPullingTime="18.442751426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:20.663980123 +0000 UTC m=+21.583042899" watchObservedRunningTime="2026-09-16 15:50:20.664412554 +0000 UTC m=+21.583475334" Sep 16 15:50:20.677129 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.677062 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tp625" podStartSLOduration=12.677032441 podStartE2EDuration="12.677032441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:20.676332976 +0000 UTC m=+21.595395758" watchObservedRunningTime="2026-09-16 15:50:20.677032441 +0000 UTC m=+21.596095245" Sep 16 15:50:20.690633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.690583 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qwhhp" podStartSLOduration=3.222482492 podStartE2EDuration="21.690566425s" totalImagesPullingTime="18.468083933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:20.690411781 +0000 UTC m=+21.609474561" watchObservedRunningTime="2026-09-16 15:50:20.690566425 +0000 UTC m=+21.609629205" Sep 16 15:50:20.704423 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.704375 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mr5sk" podStartSLOduration=3.2067729480000002 podStartE2EDuration="21.704361431s" totalImagesPullingTime="18.497588483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:20.704172664 +0000 UTC m=+21.623235445" watchObservedRunningTime="2026-09-16 15:50:20.704361431 +0000 UTC m=+21.623424210" Sep 16 15:50:20.721020 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:20.720962 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wm9c6" podStartSLOduration=10.775827353 podStartE2EDuration="21.720939066s" totalImagesPullingTime="10.945111713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:20.720377913 +0000 UTC m=+21.639440693" watchObservedRunningTime="2026-09-16 15:50:20.720939066 +0000 UTC m=+21.640001843" Sep 16 15:50:21.461580 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.461543 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:21.462588 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.462555 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:21.569386 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.569346 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:21.569386 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.569364 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:21.569633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.569377 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:21.569633 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:21.569490 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:21.569783 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:21.569650 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:21.569833 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:21.569811 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:21.662471 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.662431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dttjc" event={"ID":"5d8908e3-940b-413e-b4c8-d90b1e57ecc6","Type":"ContainerStarted","Data":"ac00e80b4a3f94a4bad2c59087fe00ff6244c223d0c6d75f1812e847e5b90aa7"} Sep 16 15:50:21.665631 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.665582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"15fdff3a0d24cb38de6b02bc4687edde79ca50aee3c1e506596a261a942cba43"} Sep 16 15:50:21.665820 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.665656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"bbc62c5bd6b4127e7cc006084778896a429dc08a9351e46a55225683eb91d12c"} Sep 16 15:50:21.665820 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.665704 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"b335bb034a4d45da4eb186d4aa8d8a24527a14f647b3a1b256da23f1cf124a7f"} Sep 16 15:50:21.666246 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.666227 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:21.666706 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.666690 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wm9c6" Sep 16 15:50:21.688084 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.688023 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dttjc" podStartSLOduration=3.271532589 podStartE2EDuration="21.688003416s" totalImagesPullingTime="18.416470827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:21.687850507 +0000 UTC m=+22.606913288" watchObservedRunningTime="2026-09-16 15:50:21.688003416 +0000 UTC m=+22.607066197" Sep 16 15:50:21.909060 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:21.909027 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 16 15:50:22.640343 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:22.640203 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T15:50:21.909050768Z","UUID":"2e9ef1e1-fc6d-4043-9521-67daf344403f","Handler":null,"Name":"","Endpoint":""} Sep 16 15:50:22.642931 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:22.642893 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 16 15:50:22.642931 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:22.642943 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 16 15:50:22.671319 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:22.671276 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" event={"ID":"9340fa2a-cec0-434b-87d6-cfea7b636a63","Type":"ContainerStarted","Data":"7bc29de01cea817caa134076fec9e849ba0d8489870d6b0d4cadf5deb587e9da"} Sep 16 15:50:23.570283 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:23.570242 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:23.570484 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:23.570242 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:23.570484 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:23.570361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:23.570484 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:23.570356 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:23.570484 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:23.570443 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:23.570659 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:23.570536 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:23.677700 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:23.677661 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"0218a7121b127d90679182a4c169e596e552a166a523798c21d0d6beaf7ea979"} Sep 16 15:50:25.570104 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:25.569901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:25.570572 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:25.569901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:25.570572 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:25.570207 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:25.570572 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:25.570303 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:25.570572 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:25.569942 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:25.570572 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:25.570407 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:26.687860 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:26.687821 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" event={"ID":"06466182-beca-4abd-b37e-c6e64b8a669a","Type":"ContainerStarted","Data":"4f4c24f8f650d8ba30abfa1569aa807eb66c1a756cff2e087cfcf462fd09e131"} Sep 16 15:50:26.688715 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:26.688078 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:26.689922 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:26.689896 2563 generic.go:356] "Generic (PLEG): container finished" podID="9fed7df2-9d30-4bb7-b890-529b9ee797f1" containerID="8354f68a18e9a64c4e4aa7d6e5f4accddb718389d80dc1080b1429f0113507ce" exitCode=0 Sep 16 15:50:26.690028 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:26.689966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerDied","Data":"8354f68a18e9a64c4e4aa7d6e5f4accddb718389d80dc1080b1429f0113507ce"} Sep 16 15:50:26.692446 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:26.692423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" event={"ID":"9340fa2a-cec0-434b-87d6-cfea7b636a63","Type":"ContainerStarted","Data":"bdea3c11eaf8e3ed4a26ad42f3a7717bc9b446b90905aa7ba35593b9aa113c8a"} Sep 16 15:50:26.705114 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:26.705081 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:26.716825 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:26.716775 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" podStartSLOduration=9.198368318 podStartE2EDuration="27.716724212s" totalImagesPullingTime="18.518355894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:26.715721984 +0000 UTC m=+27.634784764" watchObservedRunningTime="2026-09-16 15:50:26.716724212 +0000 UTC m=+27.635786969" Sep 16 15:50:26.788282 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:26.788225 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ch6tc" podStartSLOduration=4.083133163 podStartE2EDuration="27.788207116s" totalImagesPullingTime="23.705073953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:26.787970345 +0000 UTC m=+27.707033124" watchObservedRunningTime="2026-09-16 15:50:26.788207116 +0000 UTC m=+27.707269895" Sep 16 15:50:27.569547 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.569350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:27.569714 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.569366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:27.569714 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:27.569626 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:27.569856 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.569420 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:27.569856 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:27.569757 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:27.569960 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:27.569858 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:27.696732 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.696697 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerStarted","Data":"15cf9de52dc85f907d4bded551dd6572e88e6a615d4f441668c7d1b10073e604"} Sep 16 15:50:27.697099 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.696776 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 15:50:27.697527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.697495 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:27.713018 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.712994 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:27.875810 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.875675 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4vltk"] Sep 16 15:50:27.875937 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.875815 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:27.875977 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:27.875942 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:27.878581 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.878551 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6gqtz"] Sep 16 15:50:27.878721 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.878673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:27.878804 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:27.878787 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:27.881278 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.881246 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7g8v9"] Sep 16 15:50:27.881410 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:27.881350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:27.881464 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:27.881434 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:28.700642 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:28.700603 2563 generic.go:356] "Generic (PLEG): container finished" podID="9fed7df2-9d30-4bb7-b890-529b9ee797f1" containerID="15cf9de52dc85f907d4bded551dd6572e88e6a615d4f441668c7d1b10073e604" exitCode=0 Sep 16 15:50:28.701066 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:28.700678 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerDied","Data":"15cf9de52dc85f907d4bded551dd6572e88e6a615d4f441668c7d1b10073e604"} Sep 16 15:50:28.701066 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:28.700820 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 15:50:29.570670 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:29.570639 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:29.570862 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:29.570721 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:29.570862 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:29.570757 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:29.570974 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:29.570858 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:29.570974 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:29.570925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:29.571055 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:29.571011 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:29.705038 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:29.704948 2563 generic.go:356] "Generic (PLEG): container finished" podID="9fed7df2-9d30-4bb7-b890-529b9ee797f1" containerID="972a7a53a26b7d0769f4a19420c69ac079f96fcba52805e5e29472987352083d" exitCode=0 Sep 16 15:50:29.705540 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:29.705039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerDied","Data":"972a7a53a26b7d0769f4a19420c69ac079f96fcba52805e5e29472987352083d"} Sep 16 15:50:29.705540 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:29.705134 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 15:50:31.179707 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:31.179675 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:31.180139 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:31.179982 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 15:50:31.190511 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:31.190349 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fg5cd" Sep 16 15:50:31.570215 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:31.570136 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:31.570215 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:31.570137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:31.570497 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:31.570254 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vltk" podUID="639c65c1-532e-4ebb-b896-8a5a33158004" Sep 16 15:50:31.570497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:31.570137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:31.570497 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:31.570310 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:50:31.570497 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:31.570402 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7g8v9" podUID="e9460ed2-7f64-4f4f-ba99-0f63b6a6d151" Sep 16 15:50:32.870611 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.870580 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-216.ec2.internal" event="NodeReady" Sep 16 15:50:32.871143 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.870732 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 16 15:50:32.908004 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.907966 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67fb87fbfd-sljf7"] Sep 16 15:50:32.969629 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.969596 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zdvpg"] Sep 16 15:50:32.969823 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.969761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:32.972092 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.972053 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z5snx\"" Sep 16 15:50:32.972233 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.972164 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 16 15:50:32.972233 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.972204 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 16 15:50:32.972327 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.972278 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 16 15:50:32.979459 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.978799 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 16 15:50:32.982623 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.982588 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fb87fbfd-sljf7"] Sep 16 15:50:32.982780 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.982634 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hqwxt"] Sep 16 15:50:32.982860 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.982827 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:32.985384 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.985322 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 16 15:50:32.985612 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.985322 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 16 15:50:32.985692 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:32.985352 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpn5l\"" Sep 16 15:50:33.003456 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.003423 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zdvpg"] Sep 16 15:50:33.003650 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.003470 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hqwxt"] Sep 16 15:50:33.003650 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.003555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hqwxt" Sep 16 15:50:33.006810 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.006595 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 16 15:50:33.006810 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.006595 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 16 15:50:33.006810 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.006668 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 16 15:50:33.006810 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.006728 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6ng2g\"" Sep 16 15:50:33.095805 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.095775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhj6\" (UniqueName: \"kubernetes.io/projected/41934bfe-1e79-4bd8-a336-34526cf853ac-kube-api-access-fmhj6\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.095980 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.095812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpvpp\" (UniqueName: \"kubernetes.io/projected/e4fa5110-6b1f-4cbb-a228-3eef9fe6c420-kube-api-access-tpvpp\") pod \"ingress-canary-hqwxt\" (UID: \"e4fa5110-6b1f-4cbb-a228-3eef9fe6c420\") " pod="openshift-ingress-canary/ingress-canary-hqwxt" Sep 16 15:50:33.095980 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.095836 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41934bfe-1e79-4bd8-a336-34526cf853ac-config-volume\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.095980 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.095890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa6f44db-a2e5-46ff-a595-73484b61efcb-ca-trust-extracted\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.096112 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41934bfe-1e79-4bd8-a336-34526cf853ac-tmp-dir\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.096112 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.096112 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-installation-pull-secrets\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.096379 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-bound-sa-token\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.096379 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096197 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-certificates\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.096379 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.096379 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fa5110-6b1f-4cbb-a228-3eef9fe6c420-cert\") pod \"ingress-canary-hqwxt\" (UID: \"e4fa5110-6b1f-4cbb-a228-3eef9fe6c420\") " pod="openshift-ingress-canary/ingress-canary-hqwxt" Sep 16 15:50:33.096379 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8s8p\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-kube-api-access-f8s8p\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.096379 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096326 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-trusted-ca\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.096379 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.096355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-image-registry-private-configuration\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.197160 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197127 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-installation-pull-secrets\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.197338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-bound-sa-token\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.197338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-certificates\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.197338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.197338 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.197329 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:50:33.197535 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.197388 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:50:33.697368367 +0000 UTC m=+34.616431138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:50:33.197535 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fa5110-6b1f-4cbb-a228-3eef9fe6c420-cert\") pod \"ingress-canary-hqwxt\" (UID: \"e4fa5110-6b1f-4cbb-a228-3eef9fe6c420\") " pod="openshift-ingress-canary/ingress-canary-hqwxt" Sep 16 15:50:33.197535 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8s8p\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-kube-api-access-f8s8p\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.197535 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-trusted-ca\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-image-registry-private-configuration\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhj6\" (UniqueName: \"kubernetes.io/projected/41934bfe-1e79-4bd8-a336-34526cf853ac-kube-api-access-fmhj6\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197844 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpvpp\" (UniqueName: \"kubernetes.io/projected/e4fa5110-6b1f-4cbb-a228-3eef9fe6c420-kube-api-access-tpvpp\") pod \"ingress-canary-hqwxt\" (UID: \"e4fa5110-6b1f-4cbb-a228-3eef9fe6c420\") " pod="openshift-ingress-canary/ingress-canary-hqwxt" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41934bfe-1e79-4bd8-a336-34526cf853ac-config-volume\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa6f44db-a2e5-46ff-a595-73484b61efcb-ca-trust-extracted\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197936 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41934bfe-1e79-4bd8-a336-34526cf853ac-tmp-dir\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197961 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.197997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.198118 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.198130 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.198175 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:50:33.698160427 +0000 UTC m=+34.617223212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.198322 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-certificates\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.198412 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.198451 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:51:05.198437723 +0000 UTC m=+66.117500481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.198459 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41934bfe-1e79-4bd8-a336-34526cf853ac-tmp-dir\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.198570 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa6f44db-a2e5-46ff-a595-73484b61efcb-ca-trust-extracted\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.198964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.198624 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-trusted-ca\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.199845 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.198910 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41934bfe-1e79-4bd8-a336-34526cf853ac-config-volume\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.202318 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.202289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-image-registry-private-configuration\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.202448 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.202336 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4fa5110-6b1f-4cbb-a228-3eef9fe6c420-cert\") pod \"ingress-canary-hqwxt\" (UID: \"e4fa5110-6b1f-4cbb-a228-3eef9fe6c420\") " pod="openshift-ingress-canary/ingress-canary-hqwxt" Sep 16 15:50:33.202448 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.202379 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-installation-pull-secrets\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.207252 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.207222 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-bound-sa-token\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.207392 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.207301 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhj6\" (UniqueName: \"kubernetes.io/projected/41934bfe-1e79-4bd8-a336-34526cf853ac-kube-api-access-fmhj6\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.207465 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.207397 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8s8p\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-kube-api-access-f8s8p\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.208179 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.208155 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpvpp\" (UniqueName: \"kubernetes.io/projected/e4fa5110-6b1f-4cbb-a228-3eef9fe6c420-kube-api-access-tpvpp\") pod \"ingress-canary-hqwxt\" (UID: \"e4fa5110-6b1f-4cbb-a228-3eef9fe6c420\") " pod="openshift-ingress-canary/ingress-canary-hqwxt" Sep 16 15:50:33.298803 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.298697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:33.298998 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.298864 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:33.298998 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.298970 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret podName:639c65c1-532e-4ebb-b896-8a5a33158004 nodeName:}" failed. No retries permitted until 2026-09-16 15:51:05.298951567 +0000 UTC m=+66.218014325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret") pod "global-pull-secret-syncer-4vltk" (UID: "639c65c1-532e-4ebb-b896-8a5a33158004") : object "kube-system"/"original-pull-secret" not registered Sep 16 15:50:33.314284 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.314246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hqwxt" Sep 16 15:50:33.399800 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.399768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:33.399962 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.399930 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 15:50:33.399962 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.399950 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 15:50:33.400053 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.399963 2563 projected.go:196] Error preparing data for projected volume kube-api-access-cdmjq for pod openshift-network-diagnostics/network-check-target-7g8v9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:33.400053 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.400018 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq podName:e9460ed2-7f64-4f4f-ba99-0f63b6a6d151 nodeName:}" failed. No retries permitted until 2026-09-16 15:51:05.400000948 +0000 UTC m=+66.319063710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdmjq" (UniqueName: "kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq") pod "network-check-target-7g8v9" (UID: "e9460ed2-7f64-4f4f-ba99-0f63b6a6d151") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 15:50:33.569940 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.569856 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:50:33.569940 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.569897 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:50:33.570176 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.569860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:50:33.573305 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.573166 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 15:50:33.573441 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.573352 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 15:50:33.573441 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.573359 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 15:50:33.573561 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.573485 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-52dnn\"" Sep 16 15:50:33.573561 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.573534 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 15:50:33.573673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.573611 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2kt6p\"" Sep 16 15:50:33.644946 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.644912 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hqwxt"] Sep 16 15:50:33.650752 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:33.650701 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4fa5110_6b1f_4cbb_a228_3eef9fe6c420.slice/crio-b5014982f380eb555963bdeb30ee42bc6db1f0d52c014b50a35732b3ab6f54a2 WatchSource:0}: Error finding container b5014982f380eb555963bdeb30ee42bc6db1f0d52c014b50a35732b3ab6f54a2: Status 404 returned error can't find the container with id b5014982f380eb555963bdeb30ee42bc6db1f0d52c014b50a35732b3ab6f54a2 Sep 16 15:50:33.702794 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.702760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:33.702991 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.702830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:33.702991 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.702926 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:50:33.702991 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.702944 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:50:33.702991 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.702976 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:50:33.703199 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.703008 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:50:34.702990462 +0000 UTC m=+35.622053240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:50:33.703199 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:33.703024 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:50:34.703016525 +0000 UTC m=+35.622079283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:50:33.715458 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:33.715428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hqwxt" event={"ID":"e4fa5110-6b1f-4cbb-a228-3eef9fe6c420","Type":"ContainerStarted","Data":"b5014982f380eb555963bdeb30ee42bc6db1f0d52c014b50a35732b3ab6f54a2"} Sep 16 15:50:34.712832 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:34.712758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:34.712832 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:34.712826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:34.713832 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:34.712940 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:50:34.713832 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:34.712964 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:50:34.713832 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:34.713027 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:50:36.713010742 +0000 UTC m=+37.632073515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:50:34.713832 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:34.712964 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:50:34.713832 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:34.713112 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:50:36.713093298 +0000 UTC m=+37.632156057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:50:36.727708 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:36.727674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:36.728127 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:36.727789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:36.728127 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:36.727836 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:50:36.728127 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:36.727897 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:50:36.728127 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:36.727911 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:50:40.727890304 +0000 UTC m=+41.646953072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:50:36.728127 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:36.727912 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:50:36.728127 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:36.727945 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:50:40.727938293 +0000 UTC m=+41.647001051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:50:37.728183 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:37.727941 2563 generic.go:356] "Generic (PLEG): container finished" podID="9fed7df2-9d30-4bb7-b890-529b9ee797f1" containerID="85cdc05129ed12648d9545393bbf83c89efb66ecd333f6cbc0ec45ee71cd0a37" exitCode=0 Sep 16 15:50:37.728183 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:37.728014 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerDied","Data":"85cdc05129ed12648d9545393bbf83c89efb66ecd333f6cbc0ec45ee71cd0a37"} Sep 16 15:50:37.729803 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:37.729778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hqwxt" event={"ID":"e4fa5110-6b1f-4cbb-a228-3eef9fe6c420","Type":"ContainerStarted","Data":"a7b5f6d4571f017212eeb442406c0e661eda732bcba873e20956f5773a0fd0b8"} Sep 16 15:50:37.773085 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:37.773035 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hqwxt" podStartSLOduration=2.30349381 podStartE2EDuration="5.773016261s" totalImagesPullingTime="3.469522451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:37.772456711 +0000 UTC m=+38.691519491" watchObservedRunningTime="2026-09-16 15:50:37.773016261 +0000 UTC m=+38.692079041" Sep 16 15:50:38.735251 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:38.735215 2563 generic.go:356] "Generic (PLEG): container finished" podID="9fed7df2-9d30-4bb7-b890-529b9ee797f1" containerID="cdccb7326bb0b2c8e2a5f1ed888d621de269aeac5c06639ffa4abfa0b4a80ef7" exitCode=0 Sep 16 15:50:38.735754 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:38.735297 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerDied","Data":"cdccb7326bb0b2c8e2a5f1ed888d621de269aeac5c06639ffa4abfa0b4a80ef7"} Sep 16 15:50:39.029587 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.029492 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z"] Sep 16 15:50:39.055313 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.055276 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z"] Sep 16 15:50:39.055485 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.055386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.058026 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.058003 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 16 15:50:39.058156 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.058010 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 16 15:50:39.058156 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.058064 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 16 15:50:39.058156 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.058078 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 16 15:50:39.147492 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.147455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tktnb\" (UniqueName: \"kubernetes.io/projected/3bf7fc0d-b53d-437f-806a-3c5662156016-kube-api-access-tktnb\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.147661 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.147527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3bf7fc0d-b53d-437f-806a-3c5662156016-klusterlet-config\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.147661 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.147584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bf7fc0d-b53d-437f-806a-3c5662156016-tmp\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.248788 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.248727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tktnb\" (UniqueName: \"kubernetes.io/projected/3bf7fc0d-b53d-437f-806a-3c5662156016-kube-api-access-tktnb\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.248988 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.248809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3bf7fc0d-b53d-437f-806a-3c5662156016-klusterlet-config\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.248988 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.248854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bf7fc0d-b53d-437f-806a-3c5662156016-tmp\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.249284 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.249263 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bf7fc0d-b53d-437f-806a-3c5662156016-tmp\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.252477 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.252452 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3bf7fc0d-b53d-437f-806a-3c5662156016-klusterlet-config\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.258003 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.257981 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tktnb\" (UniqueName: \"kubernetes.io/projected/3bf7fc0d-b53d-437f-806a-3c5662156016-kube-api-access-tktnb\") pod \"klusterlet-addon-workmgr-85d644967-c2n2z\" (UID: \"3bf7fc0d-b53d-437f-806a-3c5662156016\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.364772 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.364717 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:39.647762 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.647666 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z"] Sep 16 15:50:39.655253 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:50:39.655223 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf7fc0d_b53d_437f_806a_3c5662156016.slice/crio-c24249537bbd88aa1f9e8886c402593c56d923a39ede39c53e11b7d74b2b3f14 WatchSource:0}: Error finding container c24249537bbd88aa1f9e8886c402593c56d923a39ede39c53e11b7d74b2b3f14: Status 404 returned error can't find the container with id c24249537bbd88aa1f9e8886c402593c56d923a39ede39c53e11b7d74b2b3f14 Sep 16 15:50:39.739298 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.739257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" event={"ID":"3bf7fc0d-b53d-437f-806a-3c5662156016","Type":"ContainerStarted","Data":"c24249537bbd88aa1f9e8886c402593c56d923a39ede39c53e11b7d74b2b3f14"} Sep 16 15:50:39.742876 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.742837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" event={"ID":"9fed7df2-9d30-4bb7-b890-529b9ee797f1","Type":"ContainerStarted","Data":"d5222f7f219a0c13bf987dab837a14655cb141cd897c3d36c39fa8d344b66cd3"} Sep 16 15:50:39.779939 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:39.778142 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jqtcs" podStartSLOduration=8.305947299 podStartE2EDuration="40.778120306s" totalImagesPullingTime="32.472173007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:39.775977674 +0000 UTC m=+40.695040453" watchObservedRunningTime="2026-09-16 15:50:39.778120306 +0000 UTC m=+40.697183097" Sep 16 15:50:40.759837 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:40.759797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:40.760311 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:40.759872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:40.760311 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:40.760058 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:50:40.760311 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:40.760148 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:50:48.760129438 +0000 UTC m=+49.679192218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:50:40.760311 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:40.760059 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:50:40.760311 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:40.760188 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:50:40.760311 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:40.760252 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:50:48.760234186 +0000 UTC m=+49.679296959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:50:43.756427 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:43.756388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" event={"ID":"3bf7fc0d-b53d-437f-806a-3c5662156016","Type":"ContainerStarted","Data":"6af029610f3aa508e309bb20277e13420cebbf86636da700970f4b00f9d3f5fd"} Sep 16 15:50:43.756862 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:43.756607 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:43.758257 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:43.758233 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:50:43.773293 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:43.773246 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" podStartSLOduration=0.850346195 podStartE2EDuration="4.77322962s" totalImagesPullingTime="3.922883425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:50:43.772711354 +0000 UTC m=+44.691774144" watchObservedRunningTime="2026-09-16 15:50:43.77322962 +0000 UTC m=+44.692292399" Sep 16 15:50:48.823703 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:48.823661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:50:48.823703 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:50:48.823717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:50:48.824156 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:48.823832 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:50:48.824156 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:48.823838 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:50:48.824156 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:48.823861 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:50:48.824156 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:48.823892 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:51:04.823879009 +0000 UTC m=+65.742941767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:50:48.824156 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:50:48.823907 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:51:04.823899947 +0000 UTC m=+65.742962705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:51:04.839050 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:04.839007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:51:04.839601 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:04.839059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:51:04.839601 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:04.839155 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:51:04.839601 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:04.839180 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:51:04.839601 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:04.839205 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:51:04.839601 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:04.839214 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:51:36.839200204 +0000 UTC m=+97.758262962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:51:04.839601 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:04.839268 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:51:36.839251191 +0000 UTC m=+97.758313968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:51:05.242496 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.242397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:51:05.245273 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.245251 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 15:51:05.253355 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:05.253323 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 15:51:05.253456 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:05.253409 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:52:09.253387897 +0000 UTC m=+130.172450675 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : secret "metrics-daemon-secret" not found Sep 16 15:51:05.343027 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.342982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:51:05.345601 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.345576 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 15:51:05.355798 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.355767 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/639c65c1-532e-4ebb-b896-8a5a33158004-original-pull-secret\") pod \"global-pull-secret-syncer-4vltk\" (UID: \"639c65c1-532e-4ebb-b896-8a5a33158004\") " pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:51:05.382028 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.381994 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vltk" Sep 16 15:51:05.444576 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.444532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:51:05.447537 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.447340 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 15:51:05.457824 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.457789 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 15:51:05.468025 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.467991 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdmjq\" (UniqueName: \"kubernetes.io/projected/e9460ed2-7f64-4f4f-ba99-0f63b6a6d151-kube-api-access-cdmjq\") pod \"network-check-target-7g8v9\" (UID: \"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151\") " pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:51:05.655486 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.655452 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4vltk"] Sep 16 15:51:05.658969 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:51:05.658940 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639c65c1_532e_4ebb_b896_8a5a33158004.slice/crio-1bd0773baf3d3fbf02fb8a51f2aa1e03aad6bb6cf00053fda08b3a95c3a4d7cc WatchSource:0}: Error finding container 1bd0773baf3d3fbf02fb8a51f2aa1e03aad6bb6cf00053fda08b3a95c3a4d7cc: Status 404 returned error can't find the container with id 1bd0773baf3d3fbf02fb8a51f2aa1e03aad6bb6cf00053fda08b3a95c3a4d7cc Sep 16 15:51:05.692471 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.692441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-52dnn\"" Sep 16 15:51:05.700795 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.700766 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:51:05.809803 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.809767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4vltk" event={"ID":"639c65c1-532e-4ebb-b896-8a5a33158004","Type":"ContainerStarted","Data":"1bd0773baf3d3fbf02fb8a51f2aa1e03aad6bb6cf00053fda08b3a95c3a4d7cc"} Sep 16 15:51:05.970371 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:05.970279 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7g8v9"] Sep 16 15:51:05.972853 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:51:05.972826 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9460ed2_7f64_4f4f_ba99_0f63b6a6d151.slice/crio-83b2ff60a99d45218f658c20bf4cdb8e3dfb3c8181831f461105e6a20d12b698 WatchSource:0}: Error finding container 83b2ff60a99d45218f658c20bf4cdb8e3dfb3c8181831f461105e6a20d12b698: Status 404 returned error can't find the container with id 83b2ff60a99d45218f658c20bf4cdb8e3dfb3c8181831f461105e6a20d12b698 Sep 16 15:51:06.813541 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:06.813499 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7g8v9" event={"ID":"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151","Type":"ContainerStarted","Data":"83b2ff60a99d45218f658c20bf4cdb8e3dfb3c8181831f461105e6a20d12b698"} Sep 16 15:51:12.832352 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:12.832305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4vltk" event={"ID":"639c65c1-532e-4ebb-b896-8a5a33158004","Type":"ContainerStarted","Data":"f8700abdc42f5c9b093dc4ee10243203020b0c897c8c6faab3cc14c77f6b4971"} Sep 16 15:51:12.833764 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:12.833725 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7g8v9" event={"ID":"e9460ed2-7f64-4f4f-ba99-0f63b6a6d151","Type":"ContainerStarted","Data":"7c50c584e2c104838fa968e3e9b9b7ee8a86f91387f2858ad91019caa1a8b52a"} Sep 16 15:51:12.833890 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:12.833876 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:51:12.850184 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:12.850135 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4vltk" podStartSLOduration=66.753305427 podStartE2EDuration="1m12.850119419s" totalImagesPullingTime="6.096813992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:51:12.849398042 +0000 UTC m=+73.768460823" watchObservedRunningTime="2026-09-16 15:51:12.850119419 +0000 UTC m=+73.769182231" Sep 16 15:51:12.864971 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:12.864924 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7g8v9" podStartSLOduration=68.096695263 podStartE2EDuration="1m13.864911171s" totalImagesPullingTime="5.768215908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:51:12.864335295 +0000 UTC m=+73.783398075" watchObservedRunningTime="2026-09-16 15:51:12.864911171 +0000 UTC m=+73.783973951" Sep 16 15:51:36.877656 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:36.877611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:51:36.878148 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:36.877685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:51:36.878148 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:36.877776 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:51:36.878148 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:36.877857 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:52:40.877842648 +0000 UTC m=+161.796905411 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:51:36.878148 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:36.877785 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:51:36.878148 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:36.877877 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:51:36.878148 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:51:36.877924 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:52:40.877913262 +0000 UTC m=+161.796976020 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:51:43.839100 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:51:43.839064 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7g8v9" Sep 16 15:52:09.314732 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:09.314668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:52:09.315167 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:09.314839 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 15:52:09.315167 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:09.314907 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs podName:b1294103-6ccc-4614-b660-9e52f39240ed nodeName:}" failed. No retries permitted until 2026-09-16 15:54:11.314891404 +0000 UTC m=+252.233954162 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs") pod "network-metrics-daemon-6gqtz" (UID: "b1294103-6ccc-4614-b660-9e52f39240ed") : secret "metrics-daemon-secret" not found Sep 16 15:52:31.245363 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.245329 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-6z2tt"] Sep 16 15:52:31.247343 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.247320 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55f5c59b94-th5kc"] Sep 16 15:52:31.247473 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.247450 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.250241 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.250203 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 16 15:52:31.250684 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.250660 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 16 15:52:31.250684 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.250681 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 16 15:52:31.251244 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.251215 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lxbb4\"" Sep 16 15:52:31.252319 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.251932 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 16 15:52:31.253944 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.253925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.256225 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.256192 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 16 15:52:31.256465 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.256440 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 16 15:52:31.256553 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.256501 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8ssfx\"" Sep 16 15:52:31.257642 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.256630 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 16 15:52:31.257642 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.256693 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 16 15:52:31.257642 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.256812 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 16 15:52:31.257642 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.256855 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 16 15:52:31.258272 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.258253 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 16 15:52:31.258447 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.258429 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-6z2tt"] Sep 16 15:52:31.259503 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-config\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.259634 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7wv\" (UniqueName: \"kubernetes.io/projected/397cc5b9-30c9-40d4-b9b3-fc59294522ce-kube-api-access-fr7wv\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.259697 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-default-certificate\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.259697 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.259851 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-stats-auth\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.259851 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.259851 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-trusted-ca\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.260001 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfgrz\" (UniqueName: \"kubernetes.io/projected/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-kube-api-access-mfgrz\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.260001 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.259899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-serving-cert\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.261396 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.261375 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55f5c59b94-th5kc"] Sep 16 15:52:31.360241 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-default-certificate\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.360241 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.360462 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-stats-auth\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.360462 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.360462 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-trusted-ca\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.360462 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfgrz\" (UniqueName: \"kubernetes.io/projected/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-kube-api-access-mfgrz\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.360462 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:31.360424 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 15:52:31.360708 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:31.360499 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:31.860478791 +0000 UTC m=+152.779541562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : configmap references non-existent config key: service-ca.crt Sep 16 15:52:31.360708 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-serving-cert\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.360708 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-config\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.360708 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.360593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7wv\" (UniqueName: \"kubernetes.io/projected/397cc5b9-30c9-40d4-b9b3-fc59294522ce-kube-api-access-fr7wv\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.361148 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:31.361131 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:31.861113829 +0000 UTC m=+152.780176610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : secret "router-metrics-certs-default" not found Sep 16 15:52:31.361295 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.361277 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-trusted-ca\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.361364 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.361340 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-config\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.363000 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.362962 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-default-certificate\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.363213 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.363192 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-serving-cert\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.363394 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.363375 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-stats-auth\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.370833 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.370723 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7wv\" (UniqueName: \"kubernetes.io/projected/397cc5b9-30c9-40d4-b9b3-fc59294522ce-kube-api-access-fr7wv\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.370944 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.370806 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfgrz\" (UniqueName: \"kubernetes.io/projected/9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb-kube-api-access-mfgrz\") pod \"console-operator-696884fb9c-6z2tt\" (UID: \"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb\") " pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.562027 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.561922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:31.835985 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.835948 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-6z2tt"] Sep 16 15:52:31.839913 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:52:31.839881 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b833dbd_33c5_42d4_8a83_7b12b2e7f5eb.slice/crio-fc5ddee25c26fefe2870ecdf370ac1150c09637dc4a88f2ae73d50c0f85dde75 WatchSource:0}: Error finding container fc5ddee25c26fefe2870ecdf370ac1150c09637dc4a88f2ae73d50c0f85dde75: Status 404 returned error can't find the container with id fc5ddee25c26fefe2870ecdf370ac1150c09637dc4a88f2ae73d50c0f85dde75 Sep 16 15:52:31.864496 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.864458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.864654 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:31.864513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:31.864654 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:31.864618 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 15:52:31.864728 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:31.864663 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:32.864646814 +0000 UTC m=+153.783709592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : configmap references non-existent config key: service-ca.crt Sep 16 15:52:31.864728 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:31.864678 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:32.864672553 +0000 UTC m=+153.783735310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : secret "router-metrics-certs-default" not found Sep 16 15:52:32.034282 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:32.034247 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" event={"ID":"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb","Type":"ContainerStarted","Data":"fc5ddee25c26fefe2870ecdf370ac1150c09637dc4a88f2ae73d50c0f85dde75"} Sep 16 15:52:32.871728 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:32.871684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:32.872172 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:32.871817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:32.872172 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:32.871933 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:34.87187253 +0000 UTC m=+155.790935292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : configmap references non-existent config key: service-ca.crt Sep 16 15:52:32.872172 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:32.871940 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 15:52:32.872172 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:32.871992 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:34.871979558 +0000 UTC m=+155.791042318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : secret "router-metrics-certs-default" not found Sep 16 15:52:33.055286 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.055251 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt"] Sep 16 15:52:33.057607 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.057580 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.060325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.060273 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8bgl6\"" Sep 16 15:52:33.060325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.060278 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 16 15:52:33.060653 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.060580 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 16 15:52:33.060653 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.060581 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 16 15:52:33.060820 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.060729 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 16 15:52:33.067539 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.067506 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt"] Sep 16 15:52:33.073431 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.073402 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-serving-cert\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.073587 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.073435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbqqz\" (UniqueName: \"kubernetes.io/projected/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-kube-api-access-jbqqz\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.073587 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.073563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-config\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.174833 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.174728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-config\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.175004 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.174960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-serving-cert\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.175056 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.175001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbqqz\" (UniqueName: \"kubernetes.io/projected/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-kube-api-access-jbqqz\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.175465 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.175435 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-config\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.177471 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.177446 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-serving-cert\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.185344 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.185312 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbqqz\" (UniqueName: \"kubernetes.io/projected/b797ce3b-7fd0-4579-bdd4-3425cdf185c6-kube-api-access-jbqqz\") pod \"service-ca-operator-cf7c776b7-mw9xt\" (UID: \"b797ce3b-7fd0-4579-bdd4-3425cdf185c6\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.370137 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.370099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" Sep 16 15:52:33.645145 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:33.645113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt"] Sep 16 15:52:34.017750 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:52:34.017697 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb797ce3b_7fd0_4579_bdd4_3425cdf185c6.slice/crio-304b5c21ad0a152f2032921cd2faf05e47ef8cec4e458b59a4f839603fbf2923 WatchSource:0}: Error finding container 304b5c21ad0a152f2032921cd2faf05e47ef8cec4e458b59a4f839603fbf2923: Status 404 returned error can't find the container with id 304b5c21ad0a152f2032921cd2faf05e47ef8cec4e458b59a4f839603fbf2923 Sep 16 15:52:34.040703 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:34.040660 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" event={"ID":"b797ce3b-7fd0-4579-bdd4-3425cdf185c6","Type":"ContainerStarted","Data":"304b5c21ad0a152f2032921cd2faf05e47ef8cec4e458b59a4f839603fbf2923"} Sep 16 15:52:34.888437 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:34.888398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:34.888598 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:34.888500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:34.888598 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:34.888550 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 15:52:34.888759 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:34.888617 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:38.888600064 +0000 UTC m=+159.807662826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : secret "router-metrics-certs-default" not found Sep 16 15:52:34.888759 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:34.888633 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:38.888627022 +0000 UTC m=+159.807689779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : configmap references non-existent config key: service-ca.crt Sep 16 15:52:35.045279 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.045242 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/0.log" Sep 16 15:52:35.045779 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.045290 2563 generic.go:356] "Generic (PLEG): container finished" podID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" containerID="63beb198ba8c8a9374f2c5ded8a90a9d4eae68f4b0cfa1c0953f60204a942dfd" exitCode=255 Sep 16 15:52:35.045779 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.045356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" event={"ID":"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb","Type":"ContainerDied","Data":"63beb198ba8c8a9374f2c5ded8a90a9d4eae68f4b0cfa1c0953f60204a942dfd"} Sep 16 15:52:35.045779 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.045651 2563 scope.go:117] "RemoveContainer" containerID="63beb198ba8c8a9374f2c5ded8a90a9d4eae68f4b0cfa1c0953f60204a942dfd" Sep 16 15:52:35.178357 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.178306 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wpngb"] Sep 16 15:52:35.180680 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.180654 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.183673 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.183642 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 16 15:52:35.183957 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.183934 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 16 15:52:35.184329 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.184309 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 16 15:52:35.184425 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.184410 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 16 15:52:35.184497 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.184474 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v8hqj\"" Sep 16 15:52:35.192051 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.192016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfe8c9c3-8a48-4786-90be-665c877f7db0-crio-socket\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.192242 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.192057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.192242 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.192125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe8c9c3-8a48-4786-90be-665c877f7db0-data-volume\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.192242 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.192155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.192414 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.192304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64bn8\" (UniqueName: \"kubernetes.io/projected/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-api-access-64bn8\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.203016 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.202972 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wpngb"] Sep 16 15:52:35.293224 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.293182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64bn8\" (UniqueName: \"kubernetes.io/projected/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-api-access-64bn8\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.293424 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.293295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfe8c9c3-8a48-4786-90be-665c877f7db0-crio-socket\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.293424 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.293324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.293538 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.293428 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 15:52:35.293538 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.293436 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfe8c9c3-8a48-4786-90be-665c877f7db0-crio-socket\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.293538 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.293488 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:35.793468205 +0000 UTC m=+156.712530977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : configmap "kube-rbac-proxy" not found Sep 16 15:52:35.293538 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.293507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe8c9c3-8a48-4786-90be-665c877f7db0-data-volume\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.293800 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.293541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.293800 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.293661 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 15:52:35.293800 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.293709 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:35.793695967 +0000 UTC m=+156.712758729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : secret "insights-runtime-extractor-tls" not found Sep 16 15:52:35.293957 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.293889 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe8c9c3-8a48-4786-90be-665c877f7db0-data-volume\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.302928 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.302902 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64bn8\" (UniqueName: \"kubernetes.io/projected/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-api-access-64bn8\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.798800 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.798757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.798964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:35.798856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:35.798964 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.798921 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 15:52:35.798964 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.798926 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 15:52:35.799085 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.798976 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:36.798961383 +0000 UTC m=+157.718024140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : configmap "kube-rbac-proxy" not found Sep 16 15:52:35.799085 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.798998 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:36.798984107 +0000 UTC m=+157.718046864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : secret "insights-runtime-extractor-tls" not found Sep 16 15:52:35.983334 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.983287 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" podUID="aa6f44db-a2e5-46ff-a595-73484b61efcb" Sep 16 15:52:35.992582 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:35.992538 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zdvpg" podUID="41934bfe-1e79-4bd8-a336-34526cf853ac" Sep 16 15:52:36.049798 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.049718 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/1.log" Sep 16 15:52:36.050162 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.050119 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/0.log" Sep 16 15:52:36.050162 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.050152 2563 generic.go:356] "Generic (PLEG): container finished" podID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" containerID="d2bcf3cb037c2e08d4a4839935b6e6a693205a0f663deea7097db39b845bba34" exitCode=255 Sep 16 15:52:36.050245 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.050218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" event={"ID":"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb","Type":"ContainerDied","Data":"d2bcf3cb037c2e08d4a4839935b6e6a693205a0f663deea7097db39b845bba34"} Sep 16 15:52:36.050293 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.050281 2563 scope.go:117] "RemoveContainer" containerID="63beb198ba8c8a9374f2c5ded8a90a9d4eae68f4b0cfa1c0953f60204a942dfd" Sep 16 15:52:36.050326 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.050291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdvpg" Sep 16 15:52:36.050443 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.050430 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:52:36.050523 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.050505 2563 scope.go:117] "RemoveContainer" containerID="d2bcf3cb037c2e08d4a4839935b6e6a693205a0f663deea7097db39b845bba34" Sep 16 15:52:36.050751 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:36.050718 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-6z2tt_openshift-console-operator(9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb)\"" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" podUID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" Sep 16 15:52:36.595264 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:36.595210 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6gqtz" podUID="b1294103-6ccc-4614-b660-9e52f39240ed" Sep 16 15:52:36.809601 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.809555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:36.809926 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:36.809641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:36.809926 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:36.809677 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 15:52:36.809926 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:36.809776 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:38.809753023 +0000 UTC m=+159.728815803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : configmap "kube-rbac-proxy" not found Sep 16 15:52:36.809926 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:36.809824 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 15:52:36.809926 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:36.809899 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:38.809881205 +0000 UTC m=+159.728943967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : secret "insights-runtime-extractor-tls" not found Sep 16 15:52:37.054112 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:37.054090 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/1.log" Sep 16 15:52:37.054522 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:37.054503 2563 scope.go:117] "RemoveContainer" containerID="d2bcf3cb037c2e08d4a4839935b6e6a693205a0f663deea7097db39b845bba34" Sep 16 15:52:37.054730 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:37.054703 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-6z2tt_openshift-console-operator(9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb)\"" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" podUID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" Sep 16 15:52:37.350810 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:37.350784 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tp625_eb310b60-a1e1-4961-99a2-80ffefa53f86/dns-node-resolver/0.log" Sep 16 15:52:38.059042 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:38.059008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" event={"ID":"b797ce3b-7fd0-4579-bdd4-3425cdf185c6","Type":"ContainerStarted","Data":"67a703d5f02cf2bb10db6cb1ef36670405b3053e35c4aa7fa2f303cdeee3ffb4"} Sep 16 15:52:38.077245 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:38.077183 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" podStartSLOduration=2.043154785 podStartE2EDuration="5.077162815s" totalImagesPullingTime="3.03400803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:52:38.075945844 +0000 UTC m=+158.995008626" watchObservedRunningTime="2026-09-16 15:52:38.077162815 +0000 UTC m=+158.996225607" Sep 16 15:52:38.351506 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:38.351482 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vn6lj_eb1c4416-dc01-4dd8-b0a0-fc2338c092b1/node-ca/0.log" Sep 16 15:52:38.825522 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:38.825436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:38.825522 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:38.825494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:38.825697 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:38.825566 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 15:52:38.825697 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:38.825608 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 15:52:38.825697 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:38.825633 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:42.825616966 +0000 UTC m=+163.744679727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : configmap "kube-rbac-proxy" not found Sep 16 15:52:38.825697 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:38.825648 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:42.825641354 +0000 UTC m=+163.744704112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : secret "insights-runtime-extractor-tls" not found Sep 16 15:52:38.926335 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:38.926294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:38.926335 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:38.926354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:38.926578 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:38.926449 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 15:52:38.926578 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:38.926479 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:46.926458834 +0000 UTC m=+167.845521596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : configmap references non-existent config key: service-ca.crt Sep 16 15:52:38.926578 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:38.926562 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:52:46.926552716 +0000 UTC m=+167.845615474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : secret "router-metrics-certs-default" not found Sep 16 15:52:38.950369 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:38.950343 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hqwxt_e4fa5110-6b1f-4cbb-a228-3eef9fe6c420/serve-healthcheck-canary/0.log" Sep 16 15:52:40.942526 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:40.942475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:52:40.942971 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:40.942541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") pod \"image-registry-67fb87fbfd-sljf7\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:52:40.942971 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:40.942646 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 15:52:40.942971 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:40.942648 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 15:52:40.942971 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:40.942718 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls podName:41934bfe-1e79-4bd8-a336-34526cf853ac nodeName:}" failed. No retries permitted until 2026-09-16 15:54:42.942701782 +0000 UTC m=+283.861764543 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls") pod "dns-default-zdvpg" (UID: "41934bfe-1e79-4bd8-a336-34526cf853ac") : secret "dns-default-metrics-tls" not found Sep 16 15:52:40.942971 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:40.942657 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fb87fbfd-sljf7: secret "image-registry-tls" not found Sep 16 15:52:40.942971 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:40.942790 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls podName:aa6f44db-a2e5-46ff-a595-73484b61efcb nodeName:}" failed. No retries permitted until 2026-09-16 15:54:42.942774779 +0000 UTC m=+283.861837555 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls") pod "image-registry-67fb87fbfd-sljf7" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb") : secret "image-registry-tls" not found Sep 16 15:52:41.562569 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:41.562526 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:41.562770 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:41.562612 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:52:41.563003 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:41.562981 2563 scope.go:117] "RemoveContainer" containerID="d2bcf3cb037c2e08d4a4839935b6e6a693205a0f663deea7097db39b845bba34" Sep 16 15:52:41.563155 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:41.563137 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-6z2tt_openshift-console-operator(9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb)\"" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" podUID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" Sep 16 15:52:42.858515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:42.858467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:42.858515 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:42.858538 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:42.858975 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:42.858609 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 15:52:42.858975 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:42.858661 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 15:52:42.858975 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:42.858680 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:50.858663492 +0000 UTC m=+171.777726250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : configmap "kube-rbac-proxy" not found Sep 16 15:52:42.858975 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:42.858707 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:52:50.858695862 +0000 UTC m=+171.777758620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : secret "insights-runtime-extractor-tls" not found Sep 16 15:52:43.757351 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:43.757293 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" podUID="3bf7fc0d-b53d-437f-806a-3c5662156016" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Sep 16 15:52:44.080332 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:44.080240 2563 generic.go:356] "Generic (PLEG): container finished" podID="3bf7fc0d-b53d-437f-806a-3c5662156016" containerID="6af029610f3aa508e309bb20277e13420cebbf86636da700970f4b00f9d3f5fd" exitCode=1 Sep 16 15:52:44.080332 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:44.080311 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" event={"ID":"3bf7fc0d-b53d-437f-806a-3c5662156016","Type":"ContainerDied","Data":"6af029610f3aa508e309bb20277e13420cebbf86636da700970f4b00f9d3f5fd"} Sep 16 15:52:44.080716 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:44.080648 2563 scope.go:117] "RemoveContainer" containerID="6af029610f3aa508e309bb20277e13420cebbf86636da700970f4b00f9d3f5fd" Sep 16 15:52:45.087179 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:45.087140 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" event={"ID":"3bf7fc0d-b53d-437f-806a-3c5662156016","Type":"ContainerStarted","Data":"5229aacdb7e152e9522dc63b904637153e4a25c1d8b3dfba2f61a437172ac6c2"} Sep 16 15:52:45.087641 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:45.087456 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:52:45.088167 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:45.088147 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85d644967-c2n2z" Sep 16 15:52:46.995648 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:46.995605 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:46.996089 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:46.995664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:52:46.996089 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:46.995778 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 16 15:52:46.996089 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:46.995792 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:53:02.995773265 +0000 UTC m=+183.914836023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : configmap references non-existent config key: service-ca.crt Sep 16 15:52:46.996089 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:46.995818 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs podName:397cc5b9-30c9-40d4-b9b3-fc59294522ce nodeName:}" failed. No retries permitted until 2026-09-16 15:53:02.995807017 +0000 UTC m=+183.914869775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs") pod "router-default-55f5c59b94-th5kc" (UID: "397cc5b9-30c9-40d4-b9b3-fc59294522ce") : secret "router-metrics-certs-default" not found Sep 16 15:52:48.569484 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:48.569428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:52:50.929105 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:50.929054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:50.929490 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:50.929131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:50.929490 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:50.929235 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 15:52:50.929490 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:50.929289 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls podName:cfe8c9c3-8a48-4786-90be-665c877f7db0 nodeName:}" failed. No retries permitted until 2026-09-16 15:53:06.929275042 +0000 UTC m=+187.848337799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpngb" (UID: "cfe8c9c3-8a48-4786-90be-665c877f7db0") : secret "insights-runtime-extractor-tls" not found Sep 16 15:52:50.929597 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:50.929558 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfe8c9c3-8a48-4786-90be-665c877f7db0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:52:56.570170 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:56.570088 2563 scope.go:117] "RemoveContainer" containerID="d2bcf3cb037c2e08d4a4839935b6e6a693205a0f663deea7097db39b845bba34" Sep 16 15:52:57.123482 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:57.123450 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 15:52:57.123888 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:57.123871 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/1.log" Sep 16 15:52:57.123946 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:57.123907 2563 generic.go:356] "Generic (PLEG): container finished" podID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" containerID="e8ee27b259dcdda1c998758f24e9f330378dc116a95afc887ca46e054b452ad3" exitCode=255 Sep 16 15:52:57.123995 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:57.123981 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" event={"ID":"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb","Type":"ContainerDied","Data":"e8ee27b259dcdda1c998758f24e9f330378dc116a95afc887ca46e054b452ad3"} Sep 16 15:52:57.124047 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:57.124035 2563 scope.go:117] "RemoveContainer" containerID="d2bcf3cb037c2e08d4a4839935b6e6a693205a0f663deea7097db39b845bba34" Sep 16 15:52:57.124362 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:57.124343 2563 scope.go:117] "RemoveContainer" containerID="e8ee27b259dcdda1c998758f24e9f330378dc116a95afc887ca46e054b452ad3" Sep 16 15:52:57.124519 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:52:57.124502 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-6z2tt_openshift-console-operator(9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb)\"" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" podUID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" Sep 16 15:52:58.128621 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:52:58.128590 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 15:53:01.563040 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:01.562994 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:53:01.563425 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:01.563059 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:53:01.563425 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:01.563385 2563 scope.go:117] "RemoveContainer" containerID="e8ee27b259dcdda1c998758f24e9f330378dc116a95afc887ca46e054b452ad3" Sep 16 15:53:01.563579 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:53:01.563557 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-6z2tt_openshift-console-operator(9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb)\"" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" podUID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" Sep 16 15:53:03.019860 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:03.019821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:03.019860 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:03.019873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:03.020431 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:03.020410 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/397cc5b9-30c9-40d4-b9b3-fc59294522ce-service-ca-bundle\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:03.022142 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:03.022121 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/397cc5b9-30c9-40d4-b9b3-fc59294522ce-metrics-certs\") pod \"router-default-55f5c59b94-th5kc\" (UID: \"397cc5b9-30c9-40d4-b9b3-fc59294522ce\") " pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:03.070669 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:03.070634 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8ssfx\"" Sep 16 15:53:03.078595 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:03.078564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:03.359723 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:03.359686 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55f5c59b94-th5kc"] Sep 16 15:53:03.362426 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:03.362402 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397cc5b9_30c9_40d4_b9b3_fc59294522ce.slice/crio-176dbe7f5fb6bd56ae35bb43bf857e2f292549def769f84115515742cc462bf5 WatchSource:0}: Error finding container 176dbe7f5fb6bd56ae35bb43bf857e2f292549def769f84115515742cc462bf5: Status 404 returned error can't find the container with id 176dbe7f5fb6bd56ae35bb43bf857e2f292549def769f84115515742cc462bf5 Sep 16 15:53:04.151786 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:04.151721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55f5c59b94-th5kc" event={"ID":"397cc5b9-30c9-40d4-b9b3-fc59294522ce","Type":"ContainerStarted","Data":"88f74fc8c869ffdd7f29249a8c3d3284ab277dcd9d2baaa47f6fa1164f31b7ad"} Sep 16 15:53:04.152164 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:04.151800 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55f5c59b94-th5kc" event={"ID":"397cc5b9-30c9-40d4-b9b3-fc59294522ce","Type":"ContainerStarted","Data":"176dbe7f5fb6bd56ae35bb43bf857e2f292549def769f84115515742cc462bf5"} Sep 16 15:53:04.173841 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:04.173782 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55f5c59b94-th5kc" podStartSLOduration=33.17375984 podStartE2EDuration="33.17375984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:52:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:04.172842158 +0000 UTC m=+185.091904948" watchObservedRunningTime="2026-09-16 15:53:04.17375984 +0000 UTC m=+185.092822621" Sep 16 15:53:05.079754 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:05.079707 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:05.082310 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:05.082283 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:05.155342 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:05.155310 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:05.156535 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:05.156516 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55f5c59b94-th5kc" Sep 16 15:53:06.949936 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:06.949886 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:53:06.952296 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:06.952269 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfe8c9c3-8a48-4786-90be-665c877f7db0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpngb\" (UID: \"cfe8c9c3-8a48-4786-90be-665c877f7db0\") " pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:53:07.017589 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:07.017555 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v8hqj\"" Sep 16 15:53:07.026408 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:07.026382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wpngb" Sep 16 15:53:07.305036 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:07.304957 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wpngb"] Sep 16 15:53:07.307907 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:07.307865 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe8c9c3_8a48_4786_90be_665c877f7db0.slice/crio-f5e895fd4df84ee996f88a6b6917eae84e840a477b69e16170a50a11025705b7 WatchSource:0}: Error finding container f5e895fd4df84ee996f88a6b6917eae84e840a477b69e16170a50a11025705b7: Status 404 returned error can't find the container with id f5e895fd4df84ee996f88a6b6917eae84e840a477b69e16170a50a11025705b7 Sep 16 15:53:08.166042 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.166005 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpngb" event={"ID":"cfe8c9c3-8a48-4786-90be-665c877f7db0","Type":"ContainerStarted","Data":"a6b9204d7f7ebf412a9e2bf5f8d65e95c87dec7780d614e67944672a4d4592cc"} Sep 16 15:53:08.166499 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.166074 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpngb" event={"ID":"cfe8c9c3-8a48-4786-90be-665c877f7db0","Type":"ContainerStarted","Data":"f5e895fd4df84ee996f88a6b6917eae84e840a477b69e16170a50a11025705b7"} Sep 16 15:53:08.958595 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.958560 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-cxql9"] Sep 16 15:53:08.960825 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.960798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:08.963291 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.963233 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 16 15:53:08.963437 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.963380 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 16 15:53:08.964389 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.964367 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 16 15:53:08.964389 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.964382 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nc7vk\"" Sep 16 15:53:08.964593 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.964424 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 16 15:53:08.964593 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.964529 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 16 15:53:08.972861 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:08.972834 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-cxql9"] Sep 16 15:53:09.069104 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.069060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/660f03a4-72e6-48d7-be37-623e4e57aa7a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.069104 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.069104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkdp2\" (UniqueName: \"kubernetes.io/projected/660f03a4-72e6-48d7-be37-623e4e57aa7a-kube-api-access-kkdp2\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.069354 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.069156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/660f03a4-72e6-48d7-be37-623e4e57aa7a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.069354 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.069187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/660f03a4-72e6-48d7-be37-623e4e57aa7a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.169637 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.169600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/660f03a4-72e6-48d7-be37-623e4e57aa7a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.170120 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.169655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/660f03a4-72e6-48d7-be37-623e4e57aa7a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.170120 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.169751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/660f03a4-72e6-48d7-be37-623e4e57aa7a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.170120 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.169776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkdp2\" (UniqueName: \"kubernetes.io/projected/660f03a4-72e6-48d7-be37-623e4e57aa7a-kube-api-access-kkdp2\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.170475 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.170429 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/660f03a4-72e6-48d7-be37-623e4e57aa7a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.171450 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.171421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpngb" event={"ID":"cfe8c9c3-8a48-4786-90be-665c877f7db0","Type":"ContainerStarted","Data":"81504daa348ba6b4532d53c959db661cce36227675315b4673a536978db384d8"} Sep 16 15:53:09.172714 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.172674 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/660f03a4-72e6-48d7-be37-623e4e57aa7a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.172827 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.172765 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/660f03a4-72e6-48d7-be37-623e4e57aa7a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.179570 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.179542 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkdp2\" (UniqueName: \"kubernetes.io/projected/660f03a4-72e6-48d7-be37-623e4e57aa7a-kube-api-access-kkdp2\") pod \"prometheus-operator-68bcd7f987-cxql9\" (UID: \"660f03a4-72e6-48d7-be37-623e4e57aa7a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.271504 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.271414 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" Sep 16 15:53:09.551913 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:09.550359 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-cxql9"] Sep 16 15:53:09.680462 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:09.680432 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660f03a4_72e6_48d7_be37_623e4e57aa7a.slice/crio-b28977bfd34a5add75fa70163fa7e8e881325e7d2ad5cd4f6148562355a81597 WatchSource:0}: Error finding container b28977bfd34a5add75fa70163fa7e8e881325e7d2ad5cd4f6148562355a81597: Status 404 returned error can't find the container with id b28977bfd34a5add75fa70163fa7e8e881325e7d2ad5cd4f6148562355a81597 Sep 16 15:53:10.177702 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:10.177660 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpngb" event={"ID":"cfe8c9c3-8a48-4786-90be-665c877f7db0","Type":"ContainerStarted","Data":"c7512f0ed97b12d01f1ec505412fc1a627e66428df34756a0270a5bc29781df6"} Sep 16 15:53:10.179288 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:10.179254 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" event={"ID":"660f03a4-72e6-48d7-be37-623e4e57aa7a","Type":"ContainerStarted","Data":"b28977bfd34a5add75fa70163fa7e8e881325e7d2ad5cd4f6148562355a81597"} Sep 16 15:53:10.197551 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:10.197486 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wpngb" podStartSLOduration=32.970847549 podStartE2EDuration="35.197460745s" totalImagesPullingTime="2.226613196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:52:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:10.196282696 +0000 UTC m=+191.115345478" watchObservedRunningTime="2026-09-16 15:53:10.197460745 +0000 UTC m=+191.116523525" Sep 16 15:53:11.184850 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:11.184807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" event={"ID":"660f03a4-72e6-48d7-be37-623e4e57aa7a","Type":"ContainerStarted","Data":"e64ee4d3f8c39f1c989e4d22e7669c27e2b338bcbfad3ac212241dfb9a59a6a0"} Sep 16 15:53:11.185333 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:11.184875 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" event={"ID":"660f03a4-72e6-48d7-be37-623e4e57aa7a","Type":"ContainerStarted","Data":"bed092c1f25d91740e6c2b23df83013bd735a2c48eb1fe24c72eb4cd12cca881"} Sep 16 15:53:11.204793 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:11.204725 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cxql9" podStartSLOduration=2.180202171 podStartE2EDuration="3.204704316s" totalImagesPullingTime="1.024502145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:11.203223675 +0000 UTC m=+192.122286467" watchObservedRunningTime="2026-09-16 15:53:11.204704316 +0000 UTC m=+192.123767095" Sep 16 15:53:12.570224 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:12.570192 2563 scope.go:117] "RemoveContainer" containerID="e8ee27b259dcdda1c998758f24e9f330378dc116a95afc887ca46e054b452ad3" Sep 16 15:53:12.570600 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:53:12.570347 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-6z2tt_openshift-console-operator(9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb)\"" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" podUID="9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb" Sep 16 15:53:13.482368 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.482326 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj"] Sep 16 15:53:13.485709 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.485690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.487963 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.487934 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 16 15:53:13.488108 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.488067 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k65nb\"" Sep 16 15:53:13.488108 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.488091 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 16 15:53:13.511294 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.511256 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj"] Sep 16 15:53:13.522983 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.522946 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l8888"] Sep 16 15:53:13.526057 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.526039 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.528656 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.528631 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 16 15:53:13.528816 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.528659 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 16 15:53:13.528816 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.528675 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cxlm6\"" Sep 16 15:53:13.528816 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.528691 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 16 15:53:13.604243 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-root\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604243 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tthx\" (UniqueName: \"kubernetes.io/projected/c332d5fa-d63c-48b1-8336-5ed84cd862ba-kube-api-access-7tthx\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-textfile\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c332d5fa-d63c-48b1-8336-5ed84cd862ba-metrics-client-ca\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604379 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-wtmp\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604460 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa29376c-5033-48fc-be73-aebeedf58e7e-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-sys\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-tls\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.604664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.604611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6cvg\" (UniqueName: \"kubernetes.io/projected/fa29376c-5033-48fc-be73-aebeedf58e7e-kube-api-access-w6cvg\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.705757 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.705937 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-sys\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.705937 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-tls\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.705937 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.705937 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6cvg\" (UniqueName: \"kubernetes.io/projected/fa29376c-5033-48fc-be73-aebeedf58e7e-kube-api-access-w6cvg\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.705937 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-root\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705930 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-sys\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705968 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-root\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.705967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tthx\" (UniqueName: \"kubernetes.io/projected/c332d5fa-d63c-48b1-8336-5ed84cd862ba-kube-api-access-7tthx\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:53:13.706048 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-textfile\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c332d5fa-d63c-48b1-8336-5ed84cd862ba-metrics-client-ca\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:53:13.706115 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-tls podName:fa29376c-5033-48fc-be73-aebeedf58e7e nodeName:}" failed. No retries permitted until 2026-09-16 15:53:14.206094017 +0000 UTC m=+195.125156789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-rrtqj" (UID: "fa29376c-5033-48fc-be73-aebeedf58e7e") : secret "openshift-state-metrics-tls" not found Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706203 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-wtmp\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706684 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa29376c-5033-48fc-be73-aebeedf58e7e-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.706684 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706610 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-textfile\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706684 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706650 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c332d5fa-d63c-48b1-8336-5ed84cd862ba-metrics-client-ca\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.706684 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706652 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-wtmp\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.707008 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.706986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa29376c-5033-48fc-be73-aebeedf58e7e-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.707356 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.707335 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.708376 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.708343 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-tls\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.708589 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.708570 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.708624 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.708609 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c332d5fa-d63c-48b1-8336-5ed84cd862ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.721322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.721285 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tthx\" (UniqueName: \"kubernetes.io/projected/c332d5fa-d63c-48b1-8336-5ed84cd862ba-kube-api-access-7tthx\") pod \"node-exporter-l8888\" (UID: \"c332d5fa-d63c-48b1-8336-5ed84cd862ba\") " pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.721322 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.721302 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6cvg\" (UniqueName: \"kubernetes.io/projected/fa29376c-5033-48fc-be73-aebeedf58e7e-kube-api-access-w6cvg\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:13.835581 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:13.835539 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l8888" Sep 16 15:53:13.847839 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:13.847808 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc332d5fa_d63c_48b1_8336_5ed84cd862ba.slice/crio-0a75480db17a4646212d3ef110dc9e8d3669322bd2807957ea555620e65c4606 WatchSource:0}: Error finding container 0a75480db17a4646212d3ef110dc9e8d3669322bd2807957ea555620e65c4606: Status 404 returned error can't find the container with id 0a75480db17a4646212d3ef110dc9e8d3669322bd2807957ea555620e65c4606 Sep 16 15:53:14.195553 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:14.195471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l8888" event={"ID":"c332d5fa-d63c-48b1-8336-5ed84cd862ba","Type":"ContainerStarted","Data":"0a75480db17a4646212d3ef110dc9e8d3669322bd2807957ea555620e65c4606"} Sep 16 15:53:14.210931 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:14.210888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:14.213240 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:14.213221 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa29376c-5033-48fc-be73-aebeedf58e7e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-rrtqj\" (UID: \"fa29376c-5033-48fc-be73-aebeedf58e7e\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:14.394499 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:14.394457 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" Sep 16 15:53:14.678928 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:14.678895 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj"] Sep 16 15:53:14.681082 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:14.681051 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa29376c_5033_48fc_be73_aebeedf58e7e.slice/crio-64de32616c00253141bcadd9afc4659ba193d03b5a984121f3ab4d6ae5fd012b WatchSource:0}: Error finding container 64de32616c00253141bcadd9afc4659ba193d03b5a984121f3ab4d6ae5fd012b: Status 404 returned error can't find the container with id 64de32616c00253141bcadd9afc4659ba193d03b5a984121f3ab4d6ae5fd012b Sep 16 15:53:15.204233 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:15.204128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" event={"ID":"fa29376c-5033-48fc-be73-aebeedf58e7e","Type":"ContainerStarted","Data":"f781f951a64c916fbcdf792c44e6643d4f053d18d8533f7da57eda7021032271"} Sep 16 15:53:15.204233 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:15.204208 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" event={"ID":"fa29376c-5033-48fc-be73-aebeedf58e7e","Type":"ContainerStarted","Data":"91764aa799fa34d3a4bfb8a347f975b6dee5d315280846e5de7e965bd678e399"} Sep 16 15:53:15.204233 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:15.204235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" event={"ID":"fa29376c-5033-48fc-be73-aebeedf58e7e","Type":"ContainerStarted","Data":"64de32616c00253141bcadd9afc4659ba193d03b5a984121f3ab4d6ae5fd012b"} Sep 16 15:53:15.206225 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:15.206194 2563 generic.go:356] "Generic (PLEG): container finished" podID="c332d5fa-d63c-48b1-8336-5ed84cd862ba" containerID="ab5f26bb14305d57a4091778b51d2e6e1e5cb107e5615c6a4cfbe65fa36657ef" exitCode=0 Sep 16 15:53:15.206351 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:15.206235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l8888" event={"ID":"c332d5fa-d63c-48b1-8336-5ed84cd862ba","Type":"ContainerDied","Data":"ab5f26bb14305d57a4091778b51d2e6e1e5cb107e5615c6a4cfbe65fa36657ef"} Sep 16 15:53:16.211957 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.211918 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l8888" event={"ID":"c332d5fa-d63c-48b1-8336-5ed84cd862ba","Type":"ContainerStarted","Data":"43dd85bdff0a8df61987d5568706591b4fa487c1c7df2c04f715c1e8c62392a6"} Sep 16 15:53:16.212318 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.211975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l8888" event={"ID":"c332d5fa-d63c-48b1-8336-5ed84cd862ba","Type":"ContainerStarted","Data":"691782b4d19820107e81a689355fb529ad307727eda4d8dce21d0223e347d90a"} Sep 16 15:53:16.234004 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.233935 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l8888" podStartSLOduration=2.075507824 podStartE2EDuration="3.23391127s" totalImagesPullingTime="1.092389652s" totalInitContainerRuntime="66.013794ms" isStatefulPod=true podCreationTimestamp="2026-09-16 15:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:16.23218499 +0000 UTC m=+197.151247765" watchObservedRunningTime="2026-09-16 15:53:16.23391127 +0000 UTC m=+197.152974047" Sep 16 15:53:16.394188 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.393955 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77758c89f-xw65h"] Sep 16 15:53:16.401455 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.401425 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.404167 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.404135 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 16 15:53:16.404356 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.404197 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 16 15:53:16.404356 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.404202 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5om8uoktmkua2\"" Sep 16 15:53:16.404356 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.404141 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 16 15:53:16.404356 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.404230 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 16 15:53:16.404356 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.404236 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 16 15:53:16.404356 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.404303 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hpmps\"" Sep 16 15:53:16.409862 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.409837 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77758c89f-xw65h"] Sep 16 15:53:16.534952 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.534857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.534952 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.534926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.535146 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.534986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zd5t\" (UniqueName: \"kubernetes.io/projected/21e11f0d-0773-4281-9a3b-37534fd32738-kube-api-access-9zd5t\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.535146 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.535047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.535146 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.535073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.535146 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.535106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-grpc-tls\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.535146 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.535143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21e11f0d-0773-4281-9a3b-37534fd32738-metrics-client-ca\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.535290 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.535164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-tls\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.635645 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.635598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.635645 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.635647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.635873 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.635676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-grpc-tls\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.635937 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.635913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21e11f0d-0773-4281-9a3b-37534fd32738-metrics-client-ca\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.635976 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.635956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-tls\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.636022 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.635985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.636109 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.636081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.636170 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.636141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zd5t\" (UniqueName: \"kubernetes.io/projected/21e11f0d-0773-4281-9a3b-37534fd32738-kube-api-access-9zd5t\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.636696 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.636669 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21e11f0d-0773-4281-9a3b-37534fd32738-metrics-client-ca\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.638490 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.638462 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.638639 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.638614 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-tls\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.638860 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.638836 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.638949 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.638841 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.638949 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.638922 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.639033 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.638978 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21e11f0d-0773-4281-9a3b-37534fd32738-secret-grpc-tls\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.644448 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.644424 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zd5t\" (UniqueName: \"kubernetes.io/projected/21e11f0d-0773-4281-9a3b-37534fd32738-kube-api-access-9zd5t\") pod \"thanos-querier-77758c89f-xw65h\" (UID: \"21e11f0d-0773-4281-9a3b-37534fd32738\") " pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.712276 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.712244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:16.996376 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:16.996341 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77758c89f-xw65h"] Sep 16 15:53:17.000179 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:17.000146 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e11f0d_0773_4281_9a3b_37534fd32738.slice/crio-9724cf13efe67775a07a0dde241871f64de7906339b3d5c6be9b105a2f5e7065 WatchSource:0}: Error finding container 9724cf13efe67775a07a0dde241871f64de7906339b3d5c6be9b105a2f5e7065: Status 404 returned error can't find the container with id 9724cf13efe67775a07a0dde241871f64de7906339b3d5c6be9b105a2f5e7065 Sep 16 15:53:17.217416 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.217378 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" event={"ID":"fa29376c-5033-48fc-be73-aebeedf58e7e","Type":"ContainerStarted","Data":"739a10c7e64b4106e538da878a00ad22ee9c91f48d096423a294c14746387210"} Sep 16 15:53:17.218586 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.218565 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" event={"ID":"21e11f0d-0773-4281-9a3b-37534fd32738","Type":"ContainerStarted","Data":"9724cf13efe67775a07a0dde241871f64de7906339b3d5c6be9b105a2f5e7065"} Sep 16 15:53:17.243966 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.243910 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-rrtqj" podStartSLOduration=3.023964058 podStartE2EDuration="4.243888996s" totalImagesPullingTime="1.219924938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:17.243443997 +0000 UTC m=+198.162506778" watchObservedRunningTime="2026-09-16 15:53:17.243888996 +0000 UTC m=+198.162951776" Sep 16 15:53:17.968219 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.968171 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56b8667469-g5wp2"] Sep 16 15:53:17.971717 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.971690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:17.974180 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.974152 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 16 15:53:17.974180 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.974168 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 16 15:53:17.974397 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.974217 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jxd84\"" Sep 16 15:53:17.974397 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.974303 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 16 15:53:17.975483 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.975461 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 16 15:53:17.975620 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.975523 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3dblm3hj8ef0a\"" Sep 16 15:53:17.984051 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:17.984019 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56b8667469-g5wp2"] Sep 16 15:53:18.149223 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.149185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvp7\" (UniqueName: \"kubernetes.io/projected/006d4c9d-262d-4536-bb81-09e987571e0c-kube-api-access-zrvp7\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.149400 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.149230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/006d4c9d-262d-4536-bb81-09e987571e0c-metrics-server-audit-profiles\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.149400 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.149285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-client-ca-bundle\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.149400 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.149313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-secret-metrics-server-tls\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.149400 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.149349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/006d4c9d-262d-4536-bb81-09e987571e0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.149400 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.149387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/006d4c9d-262d-4536-bb81-09e987571e0c-audit-log\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.149633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.149488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-secret-metrics-server-client-certs\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.250605 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.250524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-secret-metrics-server-client-certs\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.250605 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.250576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvp7\" (UniqueName: \"kubernetes.io/projected/006d4c9d-262d-4536-bb81-09e987571e0c-kube-api-access-zrvp7\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.251125 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.250707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/006d4c9d-262d-4536-bb81-09e987571e0c-metrics-server-audit-profiles\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.251125 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.250798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-client-ca-bundle\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.251125 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.250829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-secret-metrics-server-tls\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.251125 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.250856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/006d4c9d-262d-4536-bb81-09e987571e0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.251125 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.250904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/006d4c9d-262d-4536-bb81-09e987571e0c-audit-log\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.251380 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.251282 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/006d4c9d-262d-4536-bb81-09e987571e0c-audit-log\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.251696 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.251672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/006d4c9d-262d-4536-bb81-09e987571e0c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.251926 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.251902 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/006d4c9d-262d-4536-bb81-09e987571e0c-metrics-server-audit-profiles\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.253493 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.253471 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-secret-metrics-server-client-certs\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.253658 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.253638 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-client-ca-bundle\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.253723 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.253693 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/006d4c9d-262d-4536-bb81-09e987571e0c-secret-metrics-server-tls\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.263620 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.263588 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvp7\" (UniqueName: \"kubernetes.io/projected/006d4c9d-262d-4536-bb81-09e987571e0c-kube-api-access-zrvp7\") pod \"metrics-server-56b8667469-g5wp2\" (UID: \"006d4c9d-262d-4536-bb81-09e987571e0c\") " pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.284381 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.284339 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:18.567835 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:18.567802 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56b8667469-g5wp2"] Sep 16 15:53:19.022046 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:19.020450 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006d4c9d_262d_4536_bb81_09e987571e0c.slice/crio-3b15b88cad856beb38051e9d941421a5f9a9e64c923719a18a136ab0fcdc2c92 WatchSource:0}: Error finding container 3b15b88cad856beb38051e9d941421a5f9a9e64c923719a18a136ab0fcdc2c92: Status 404 returned error can't find the container with id 3b15b88cad856beb38051e9d941421a5f9a9e64c923719a18a136ab0fcdc2c92 Sep 16 15:53:19.231807 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:19.231771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" event={"ID":"21e11f0d-0773-4281-9a3b-37534fd32738","Type":"ContainerStarted","Data":"e5c94d0751e4756c50914f209153163bc7467f4ec1f6eb402ff1f4172a3ff02f"} Sep 16 15:53:19.231969 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:19.231872 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" event={"ID":"21e11f0d-0773-4281-9a3b-37534fd32738","Type":"ContainerStarted","Data":"e4e0be29175544d10d9e15a856d09daa95258ce47f7c29a63011882ad96adae6"} Sep 16 15:53:19.233085 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:19.233059 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" event={"ID":"006d4c9d-262d-4536-bb81-09e987571e0c","Type":"ContainerStarted","Data":"3b15b88cad856beb38051e9d941421a5f9a9e64c923719a18a136ab0fcdc2c92"} Sep 16 15:53:20.240879 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:20.240847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" event={"ID":"21e11f0d-0773-4281-9a3b-37534fd32738","Type":"ContainerStarted","Data":"ebb219f6b6ab197c4e2ce6a1e06b5d3bcdd4f8c8044d644f1f41d1e9575de217"} Sep 16 15:53:20.241293 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:20.240915 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" event={"ID":"21e11f0d-0773-4281-9a3b-37534fd32738","Type":"ContainerStarted","Data":"213c2a82a1f2e61a0a446d19b1e2a45e8ed3278def10f29811b7d7df5cd29674"} Sep 16 15:53:21.247970 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:21.247927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" event={"ID":"21e11f0d-0773-4281-9a3b-37534fd32738","Type":"ContainerStarted","Data":"3a7cf0d25e6b87291c9c3828f459e6edbe281d9c7075305c6665c050f894779d"} Sep 16 15:53:21.248442 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:21.248013 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" event={"ID":"21e11f0d-0773-4281-9a3b-37534fd32738","Type":"ContainerStarted","Data":"ab11e3b5052eeb11640bf2689df9d59fa3825a89c9c4bb246d2ca876305a2ac7"} Sep 16 15:53:21.248442 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:21.248081 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:21.249577 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:21.249550 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" event={"ID":"006d4c9d-262d-4536-bb81-09e987571e0c","Type":"ContainerStarted","Data":"2261f38cdf19ac700a58166c5a5fec7884b8545dda8900a8a0963d521f0156a7"} Sep 16 15:53:21.273076 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:21.273021 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" podStartSLOduration=2.352882075 podStartE2EDuration="5.273001389s" totalImagesPullingTime="2.920119314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:53:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:21.27191395 +0000 UTC m=+202.190976734" watchObservedRunningTime="2026-09-16 15:53:21.273001389 +0000 UTC m=+202.192064169" Sep 16 15:53:21.291104 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:21.291050 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" podStartSLOduration=2.649451017 podStartE2EDuration="4.291034457s" totalImagesPullingTime="1.64158344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:21.289920226 +0000 UTC m=+202.208983007" watchObservedRunningTime="2026-09-16 15:53:21.291034457 +0000 UTC m=+202.210097236" Sep 16 15:53:26.569591 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:26.569553 2563 scope.go:117] "RemoveContainer" containerID="e8ee27b259dcdda1c998758f24e9f330378dc116a95afc887ca46e054b452ad3" Sep 16 15:53:27.259147 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:27.259117 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77758c89f-xw65h" Sep 16 15:53:27.273240 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:27.273209 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 15:53:27.273388 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:27.273315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" event={"ID":"9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb","Type":"ContainerStarted","Data":"3ffd322bc261a9d533012ab1a9c4392c0498da8798695dbcd01a6cbecd219509"} Sep 16 15:53:27.273612 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:27.273575 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:53:27.304692 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:27.304624 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" podStartSLOduration=54.098493876 podStartE2EDuration="56.304592294s" totalImagesPullingTime="2.206098418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:27.304361394 +0000 UTC m=+208.223424168" watchObservedRunningTime="2026-09-16 15:53:27.304592294 +0000 UTC m=+208.223655078" Sep 16 15:53:27.323881 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:27.323848 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-6z2tt" Sep 16 15:53:27.613717 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:27.613676 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fb87fbfd-sljf7"] Sep 16 15:53:27.614130 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:53:27.613954 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" podUID="aa6f44db-a2e5-46ff-a595-73484b61efcb" Sep 16 15:53:28.276470 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.276436 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:53:28.283071 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.283044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:53:28.440253 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440220 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa6f44db-a2e5-46ff-a595-73484b61efcb-ca-trust-extracted\") pod \"aa6f44db-a2e5-46ff-a595-73484b61efcb\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " Sep 16 15:53:28.440436 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440276 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-image-registry-private-configuration\") pod \"aa6f44db-a2e5-46ff-a595-73484b61efcb\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " Sep 16 15:53:28.440436 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440321 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-bound-sa-token\") pod \"aa6f44db-a2e5-46ff-a595-73484b61efcb\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " Sep 16 15:53:28.440436 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440351 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-installation-pull-secrets\") pod \"aa6f44db-a2e5-46ff-a595-73484b61efcb\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " Sep 16 15:53:28.440436 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440381 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-certificates\") pod \"aa6f44db-a2e5-46ff-a595-73484b61efcb\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " Sep 16 15:53:28.440436 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440429 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8s8p\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-kube-api-access-f8s8p\") pod \"aa6f44db-a2e5-46ff-a595-73484b61efcb\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " Sep 16 15:53:28.440687 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440466 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-trusted-ca\") pod \"aa6f44db-a2e5-46ff-a595-73484b61efcb\" (UID: \"aa6f44db-a2e5-46ff-a595-73484b61efcb\") " Sep 16 15:53:28.440687 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440541 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6f44db-a2e5-46ff-a595-73484b61efcb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aa6f44db-a2e5-46ff-a595-73484b61efcb" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 15:53:28.440831 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440785 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa6f44db-a2e5-46ff-a595-73484b61efcb-ca-trust-extracted\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:53:28.440884 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440823 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aa6f44db-a2e5-46ff-a595-73484b61efcb" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:53:28.440967 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.440943 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aa6f44db-a2e5-46ff-a595-73484b61efcb" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:53:28.442819 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.442788 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aa6f44db-a2e5-46ff-a595-73484b61efcb" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 15:53:28.442941 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.442871 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-kube-api-access-f8s8p" (OuterVolumeSpecName: "kube-api-access-f8s8p") pod "aa6f44db-a2e5-46ff-a595-73484b61efcb" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb"). InnerVolumeSpecName "kube-api-access-f8s8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 15:53:28.443051 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.443027 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aa6f44db-a2e5-46ff-a595-73484b61efcb" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:53:28.443101 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.443072 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aa6f44db-a2e5-46ff-a595-73484b61efcb" (UID: "aa6f44db-a2e5-46ff-a595-73484b61efcb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:53:28.542248 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.542173 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-image-registry-private-configuration\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:53:28.542248 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.542202 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-bound-sa-token\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:53:28.542248 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.542213 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa6f44db-a2e5-46ff-a595-73484b61efcb-installation-pull-secrets\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:53:28.542248 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.542221 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-certificates\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:53:28.542248 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.542230 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8s8p\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-kube-api-access-f8s8p\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:53:28.542248 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:28.542239 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa6f44db-a2e5-46ff-a595-73484b61efcb-trusted-ca\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:53:29.280110 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:29.280080 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fb87fbfd-sljf7" Sep 16 15:53:29.316013 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:29.315979 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fb87fbfd-sljf7"] Sep 16 15:53:29.320994 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:29.320968 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67fb87fbfd-sljf7"] Sep 16 15:53:29.450063 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:29.450020 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa6f44db-a2e5-46ff-a595-73484b61efcb-registry-tls\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:53:29.575112 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:29.575034 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6f44db-a2e5-46ff-a595-73484b61efcb" path="/var/lib/kubelet/pods/aa6f44db-a2e5-46ff-a595-73484b61efcb/volumes" Sep 16 15:53:38.175190 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.175155 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57ffbdb464-hfrfj"] Sep 16 15:53:38.179594 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.179567 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.182164 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.182134 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 16 15:53:38.182164 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.182137 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 16 15:53:38.183246 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.183206 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 16 15:53:38.183351 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.183218 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 16 15:53:38.183351 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.183265 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 16 15:53:38.183351 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.183220 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-whpcn\"" Sep 16 15:53:38.183351 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.183223 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 16 15:53:38.183558 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.183221 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 16 15:53:38.190921 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.190897 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57ffbdb464-hfrfj"] Sep 16 15:53:38.218069 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.218021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-service-ca\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.218069 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.218068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-oauth-serving-cert\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.218289 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.218123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-console-config\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.218289 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.218161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-oauth-config\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.218289 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.218198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-serving-cert\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.218289 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.218239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqh55\" (UniqueName: \"kubernetes.io/projected/70f04f33-8533-4624-bc42-758415b89948-kube-api-access-dqh55\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.285443 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.285395 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:38.285443 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.285470 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:38.319533 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.319494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-oauth-config\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.319732 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.319579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-serving-cert\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.319732 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.319629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqh55\" (UniqueName: \"kubernetes.io/projected/70f04f33-8533-4624-bc42-758415b89948-kube-api-access-dqh55\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.319940 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.319911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-service-ca\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.320007 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.319957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-oauth-serving-cert\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.320007 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.320002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-console-config\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.320580 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.320557 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-console-config\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.320666 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.320564 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-oauth-serving-cert\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.320666 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.320590 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-service-ca\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.322061 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.322039 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-oauth-config\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.322180 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.322162 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-serving-cert\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.328222 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.328197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqh55\" (UniqueName: \"kubernetes.io/projected/70f04f33-8533-4624-bc42-758415b89948-kube-api-access-dqh55\") pod \"console-57ffbdb464-hfrfj\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.489098 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.488996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:38.765944 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:38.765813 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57ffbdb464-hfrfj"] Sep 16 15:53:38.768637 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:38.768607 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f04f33_8533_4624_bc42_758415b89948.slice/crio-79d8316b74843d3db019ab998d98aeab7bbed6c7648ec8b1350abcf96a7cf1fb WatchSource:0}: Error finding container 79d8316b74843d3db019ab998d98aeab7bbed6c7648ec8b1350abcf96a7cf1fb: Status 404 returned error can't find the container with id 79d8316b74843d3db019ab998d98aeab7bbed6c7648ec8b1350abcf96a7cf1fb Sep 16 15:53:39.321478 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:39.321445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57ffbdb464-hfrfj" event={"ID":"70f04f33-8533-4624-bc42-758415b89948","Type":"ContainerStarted","Data":"79d8316b74843d3db019ab998d98aeab7bbed6c7648ec8b1350abcf96a7cf1fb"} Sep 16 15:53:42.335789 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:42.335729 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57ffbdb464-hfrfj" event={"ID":"70f04f33-8533-4624-bc42-758415b89948","Type":"ContainerStarted","Data":"df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b"} Sep 16 15:53:42.364701 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:42.364646 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57ffbdb464-hfrfj" podStartSLOduration=1.6540096050000002 podStartE2EDuration="4.364628944s" totalImagesPullingTime="2.710619339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:42.364084529 +0000 UTC m=+223.283147314" watchObservedRunningTime="2026-09-16 15:53:42.364628944 +0000 UTC m=+223.283691724" Sep 16 15:53:46.606052 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.606015 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd9c95589-znxwf"] Sep 16 15:53:46.611841 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.611816 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.619978 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.619937 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 16 15:53:46.622940 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.622917 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd9c95589-znxwf"] Sep 16 15:53:46.689982 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.689935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-oauth-config\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.690176 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.689995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-config\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.690176 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.690040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-service-ca\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.690176 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.690070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-oauth-serving-cert\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.690176 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.690096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-serving-cert\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.690176 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.690123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-trusted-ca-bundle\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.690437 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.690219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbzbp\" (UniqueName: \"kubernetes.io/projected/a6e59cbb-0198-4303-b0cc-e11648aee2eb-kube-api-access-vbzbp\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.791224 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.791182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-trusted-ca-bundle\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.791372 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.791240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbzbp\" (UniqueName: \"kubernetes.io/projected/a6e59cbb-0198-4303-b0cc-e11648aee2eb-kube-api-access-vbzbp\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.791372 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.791306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-oauth-config\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.791496 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.791471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-config\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.791537 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.791507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-service-ca\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.791537 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.791532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-oauth-serving-cert\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.791626 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.791559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-serving-cert\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.792223 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.792188 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-config\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.792339 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.792231 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-service-ca\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.792339 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.792199 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-trusted-ca-bundle\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.792498 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.792477 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-oauth-serving-cert\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.793917 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.793892 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-serving-cert\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.794028 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.794011 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-oauth-config\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.799299 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.799273 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbzbp\" (UniqueName: \"kubernetes.io/projected/a6e59cbb-0198-4303-b0cc-e11648aee2eb-kube-api-access-vbzbp\") pod \"console-7fd9c95589-znxwf\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:46.921976 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:46.921878 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:47.217652 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:47.217578 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd9c95589-znxwf"] Sep 16 15:53:47.220042 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:53:47.220009 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e59cbb_0198_4303_b0cc_e11648aee2eb.slice/crio-b2c91a326d331ebc7f28897cc8230a5bc818b3bb309b96e3fa34234eb246d807 WatchSource:0}: Error finding container b2c91a326d331ebc7f28897cc8230a5bc818b3bb309b96e3fa34234eb246d807: Status 404 returned error can't find the container with id b2c91a326d331ebc7f28897cc8230a5bc818b3bb309b96e3fa34234eb246d807 Sep 16 15:53:47.355478 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:47.355447 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd9c95589-znxwf" event={"ID":"a6e59cbb-0198-4303-b0cc-e11648aee2eb","Type":"ContainerStarted","Data":"7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0"} Sep 16 15:53:47.355640 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:47.355500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd9c95589-znxwf" event={"ID":"a6e59cbb-0198-4303-b0cc-e11648aee2eb","Type":"ContainerStarted","Data":"b2c91a326d331ebc7f28897cc8230a5bc818b3bb309b96e3fa34234eb246d807"} Sep 16 15:53:47.378291 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:47.378235 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd9c95589-znxwf" podStartSLOduration=1.378218847 podStartE2EDuration="1.378218847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:53:47.37685513 +0000 UTC m=+228.295917910" watchObservedRunningTime="2026-09-16 15:53:47.378218847 +0000 UTC m=+228.297281627" Sep 16 15:53:48.489470 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:48.489415 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:48.489470 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:48.489489 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:48.494519 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:48.494479 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:49.367973 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:49.367945 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:53:53.618068 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:53.618036 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56b8667469-g5wp2_006d4c9d-262d-4536-bb81-09e987571e0c/metrics-server/0.log" Sep 16 15:53:54.616714 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:54.616687 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l8888_c332d5fa-d63c-48b1-8336-5ed84cd862ba/init-textfile/0.log" Sep 16 15:53:54.817287 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:54.817259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l8888_c332d5fa-d63c-48b1-8336-5ed84cd862ba/node-exporter/0.log" Sep 16 15:53:55.016537 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:55.016415 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l8888_c332d5fa-d63c-48b1-8336-5ed84cd862ba/kube-rbac-proxy/0.log" Sep 16 15:53:55.816405 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:55.816377 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rrtqj_fa29376c-5033-48fc-be73-aebeedf58e7e/kube-rbac-proxy-main/0.log" Sep 16 15:53:56.016013 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:56.015950 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rrtqj_fa29376c-5033-48fc-be73-aebeedf58e7e/kube-rbac-proxy-self/0.log" Sep 16 15:53:56.216906 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:56.216878 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rrtqj_fa29376c-5033-48fc-be73-aebeedf58e7e/openshift-state-metrics/0.log" Sep 16 15:53:56.922577 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:56.922535 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:56.922820 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:56.922618 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:56.927569 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:56.927548 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:57.396631 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:57.396603 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:53:57.450997 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:57.450951 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57ffbdb464-hfrfj"] Sep 16 15:53:57.817832 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:57.817751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-cxql9_660f03a4-72e6-48d7-be37-623e4e57aa7a/prometheus-operator/0.log" Sep 16 15:53:58.016166 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.016127 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-cxql9_660f03a4-72e6-48d7-be37-623e4e57aa7a/kube-rbac-proxy/0.log" Sep 16 15:53:58.290855 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.290825 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:58.294628 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.294604 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56b8667469-g5wp2" Sep 16 15:53:58.397902 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.397870 2563 generic.go:356] "Generic (PLEG): container finished" podID="b797ce3b-7fd0-4579-bdd4-3425cdf185c6" containerID="67a703d5f02cf2bb10db6cb1ef36670405b3053e35c4aa7fa2f303cdeee3ffb4" exitCode=0 Sep 16 15:53:58.398359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.397936 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" event={"ID":"b797ce3b-7fd0-4579-bdd4-3425cdf185c6","Type":"ContainerDied","Data":"67a703d5f02cf2bb10db6cb1ef36670405b3053e35c4aa7fa2f303cdeee3ffb4"} Sep 16 15:53:58.398359 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.398347 2563 scope.go:117] "RemoveContainer" containerID="67a703d5f02cf2bb10db6cb1ef36670405b3053e35c4aa7fa2f303cdeee3ffb4" Sep 16 15:53:58.419345 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.419322 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/thanos-query/0.log" Sep 16 15:53:58.617007 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.616981 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/kube-rbac-proxy-web/0.log" Sep 16 15:53:58.816818 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:58.816791 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/kube-rbac-proxy/0.log" Sep 16 15:53:59.016839 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:59.016759 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/prom-label-proxy/0.log" Sep 16 15:53:59.216852 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:59.216818 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/kube-rbac-proxy-rules/0.log" Sep 16 15:53:59.404404 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:59.404360 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-mw9xt" event={"ID":"b797ce3b-7fd0-4579-bdd4-3425cdf185c6","Type":"ContainerStarted","Data":"1409a367c9305e15a924c27aae1e3f75e51b80ae035c3d8ed84c0ddc104fe86f"} Sep 16 15:53:59.416654 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:59.416627 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/kube-rbac-proxy-metrics/0.log" Sep 16 15:53:59.816761 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:53:59.816661 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 15:54:00.019035 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:00.018999 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/3.log" Sep 16 15:54:00.215885 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:00.215856 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57ffbdb464-hfrfj_70f04f33-8533-4624-bc42-758415b89948/console/0.log" Sep 16 15:54:00.417964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:00.417937 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fd9c95589-znxwf_a6e59cbb-0198-4303-b0cc-e11648aee2eb/console/0.log" Sep 16 15:54:02.416148 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:02.416118 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tp625_eb310b60-a1e1-4961-99a2-80ffefa53f86/dns-node-resolver/0.log" Sep 16 15:54:11.411594 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:11.411549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:54:11.413862 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:11.413840 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1294103-6ccc-4614-b660-9e52f39240ed-metrics-certs\") pod \"network-metrics-daemon-6gqtz\" (UID: \"b1294103-6ccc-4614-b660-9e52f39240ed\") " pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:54:11.672927 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:11.672849 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2kt6p\"" Sep 16 15:54:11.681343 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:11.681320 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gqtz" Sep 16 15:54:11.953257 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:11.953232 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6gqtz"] Sep 16 15:54:11.955389 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:54:11.955360 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1294103_6ccc_4614_b660_9e52f39240ed.slice/crio-03fbe90a615659bca0330cf0b7fe8fceadbfbb1d73baff050d52c4f4d03dea14 WatchSource:0}: Error finding container 03fbe90a615659bca0330cf0b7fe8fceadbfbb1d73baff050d52c4f4d03dea14: Status 404 returned error can't find the container with id 03fbe90a615659bca0330cf0b7fe8fceadbfbb1d73baff050d52c4f4d03dea14 Sep 16 15:54:12.457540 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:12.457505 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gqtz" event={"ID":"b1294103-6ccc-4614-b660-9e52f39240ed","Type":"ContainerStarted","Data":"03fbe90a615659bca0330cf0b7fe8fceadbfbb1d73baff050d52c4f4d03dea14"} Sep 16 15:54:13.463234 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:13.463142 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gqtz" event={"ID":"b1294103-6ccc-4614-b660-9e52f39240ed","Type":"ContainerStarted","Data":"5de188a093caf7c914a9fa306c35067cb3ae01552b347535bf3bd7ccbd542f90"} Sep 16 15:54:13.463594 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:13.463236 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gqtz" event={"ID":"b1294103-6ccc-4614-b660-9e52f39240ed","Type":"ContainerStarted","Data":"b26884e5684bf144ea71630c44d1ea914abcf027083d1434ffe0dd8bb6fa5c8c"} Sep 16 15:54:13.490358 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:13.490302 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6gqtz" podStartSLOduration=253.307844179 podStartE2EDuration="4m14.490286552s" totalImagesPullingTime="1.182442373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:54:13.489870099 +0000 UTC m=+254.408932879" watchObservedRunningTime="2026-09-16 15:54:13.490286552 +0000 UTC m=+254.409349331" Sep 16 15:54:22.471092 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.470970 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57ffbdb464-hfrfj" podUID="70f04f33-8533-4624-bc42-758415b89948" containerName="console" containerID="cri-o://df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b" gracePeriod=15 Sep 16 15:54:22.712818 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.712786 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:54:22.812805 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.812685 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-serving-cert\") pod \"70f04f33-8533-4624-bc42-758415b89948\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " Sep 16 15:54:22.812805 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.812730 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-service-ca\") pod \"70f04f33-8533-4624-bc42-758415b89948\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " Sep 16 15:54:22.812805 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.812784 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-console-config\") pod \"70f04f33-8533-4624-bc42-758415b89948\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " Sep 16 15:54:22.813060 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.812819 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-oauth-serving-cert\") pod \"70f04f33-8533-4624-bc42-758415b89948\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " Sep 16 15:54:22.813060 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.812847 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqh55\" (UniqueName: \"kubernetes.io/projected/70f04f33-8533-4624-bc42-758415b89948-kube-api-access-dqh55\") pod \"70f04f33-8533-4624-bc42-758415b89948\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " Sep 16 15:54:22.813060 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.812995 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-oauth-config\") pod \"70f04f33-8533-4624-bc42-758415b89948\" (UID: \"70f04f33-8533-4624-bc42-758415b89948\") " Sep 16 15:54:22.813234 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.813212 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-console-config" (OuterVolumeSpecName: "console-config") pod "70f04f33-8533-4624-bc42-758415b89948" (UID: "70f04f33-8533-4624-bc42-758415b89948"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:54:22.813289 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.813224 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-service-ca" (OuterVolumeSpecName: "service-ca") pod "70f04f33-8533-4624-bc42-758415b89948" (UID: "70f04f33-8533-4624-bc42-758415b89948"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:54:22.813289 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.813237 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "70f04f33-8533-4624-bc42-758415b89948" (UID: "70f04f33-8533-4624-bc42-758415b89948"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:54:22.813380 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.813309 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-console-config\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:54:22.813380 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.813330 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-oauth-serving-cert\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:54:22.815269 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.815237 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "70f04f33-8533-4624-bc42-758415b89948" (UID: "70f04f33-8533-4624-bc42-758415b89948"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:54:22.815525 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.815510 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "70f04f33-8533-4624-bc42-758415b89948" (UID: "70f04f33-8533-4624-bc42-758415b89948"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:54:22.815592 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.815531 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f04f33-8533-4624-bc42-758415b89948-kube-api-access-dqh55" (OuterVolumeSpecName: "kube-api-access-dqh55") pod "70f04f33-8533-4624-bc42-758415b89948" (UID: "70f04f33-8533-4624-bc42-758415b89948"). InnerVolumeSpecName "kube-api-access-dqh55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 15:54:22.914682 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.914631 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-serving-cert\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:54:22.914682 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.914672 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70f04f33-8533-4624-bc42-758415b89948-service-ca\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:54:22.914682 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.914682 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqh55\" (UniqueName: \"kubernetes.io/projected/70f04f33-8533-4624-bc42-758415b89948-kube-api-access-dqh55\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:54:22.914682 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:22.914690 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70f04f33-8533-4624-bc42-758415b89948-console-oauth-config\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:54:23.501799 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.501765 2563 generic.go:356] "Generic (PLEG): container finished" podID="70f04f33-8533-4624-bc42-758415b89948" containerID="df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b" exitCode=0 Sep 16 15:54:23.502180 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.501866 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57ffbdb464-hfrfj" Sep 16 15:54:23.502180 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.501873 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57ffbdb464-hfrfj" event={"ID":"70f04f33-8533-4624-bc42-758415b89948","Type":"ContainerDied","Data":"df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b"} Sep 16 15:54:23.502180 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.501929 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57ffbdb464-hfrfj" event={"ID":"70f04f33-8533-4624-bc42-758415b89948","Type":"ContainerDied","Data":"79d8316b74843d3db019ab998d98aeab7bbed6c7648ec8b1350abcf96a7cf1fb"} Sep 16 15:54:23.502180 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.501956 2563 scope.go:117] "RemoveContainer" containerID="df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b" Sep 16 15:54:23.510585 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.510559 2563 scope.go:117] "RemoveContainer" containerID="df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b" Sep 16 15:54:23.510932 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:54:23.510908 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b\": container with ID starting with df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b not found: ID does not exist" containerID="df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b" Sep 16 15:54:23.511012 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.510942 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b"} err="failed to get container status \"df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b\": rpc error: code = NotFound desc = could not find container \"df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b\": container with ID starting with df51edc45527b44c3a6946886e6e7387e4c77730fd8c64b12cfd72a4d5c47d6b not found: ID does not exist" Sep 16 15:54:23.523309 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.523278 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57ffbdb464-hfrfj"] Sep 16 15:54:23.525131 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.525107 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57ffbdb464-hfrfj"] Sep 16 15:54:23.574849 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:23.574816 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f04f33-8533-4624-bc42-758415b89948" path="/var/lib/kubelet/pods/70f04f33-8533-4624-bc42-758415b89948/volumes" Sep 16 15:54:37.730749 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.730644 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74658bcccc-42jb7"] Sep 16 15:54:37.731475 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.731449 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f04f33-8533-4624-bc42-758415b89948" containerName="console" Sep 16 15:54:37.731475 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.731476 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f04f33-8533-4624-bc42-758415b89948" containerName="console" Sep 16 15:54:37.731619 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.731572 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f04f33-8533-4624-bc42-758415b89948" containerName="console" Sep 16 15:54:37.736427 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.736400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.739587 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.739544 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 16 15:54:37.739969 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.739937 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d8lzd\"" Sep 16 15:54:37.739969 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.739961 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 16 15:54:37.740494 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.740473 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 16 15:54:37.740588 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.740555 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 16 15:54:37.740748 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.740720 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 16 15:54:37.744065 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.744041 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 16 15:54:37.754781 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.754749 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74658bcccc-42jb7"] Sep 16 15:54:37.829134 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.828678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-metrics-client-ca\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.829134 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.828761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-serving-certs-ca-bundle\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.829134 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.828795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.829134 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.828822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-secret-telemeter-client\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.829134 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.828845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.829134 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.828880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-telemeter-client-tls\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.829134 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.828927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgmzg\" (UniqueName: \"kubernetes.io/projected/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-kube-api-access-kgmzg\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.829134 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.828997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-federate-client-tls\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.929987 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.929952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.929987 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.929992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-telemeter-client-tls\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.930249 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.930026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgmzg\" (UniqueName: \"kubernetes.io/projected/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-kube-api-access-kgmzg\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.930249 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.930071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-federate-client-tls\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.930249 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.930100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-metrics-client-ca\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.930249 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.930148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-serving-certs-ca-bundle\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.930249 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.930184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.930249 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.930213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-secret-telemeter-client\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.931014 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.930977 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-metrics-client-ca\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.931219 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.930977 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-serving-certs-ca-bundle\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.931802 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.931753 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.933707 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.933198 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-secret-telemeter-client\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.933707 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.933664 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-federate-client-tls\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.933887 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.933818 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-telemeter-client-tls\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.934506 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.934481 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:37.939226 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:37.939202 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgmzg\" (UniqueName: \"kubernetes.io/projected/bd8307d6-1f56-42e1-8387-10bd5a8b27bd-kube-api-access-kgmzg\") pod \"telemeter-client-74658bcccc-42jb7\" (UID: \"bd8307d6-1f56-42e1-8387-10bd5a8b27bd\") " pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:38.047632 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:38.047538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" Sep 16 15:54:38.339518 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:38.339382 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74658bcccc-42jb7"] Sep 16 15:54:38.343270 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:54:38.343216 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8307d6_1f56_42e1_8387_10bd5a8b27bd.slice/crio-aa88c755fd4f71fcfc52bdae6d72d5d0b74d29b87fbb2ecf5e6c29d647490aa3 WatchSource:0}: Error finding container aa88c755fd4f71fcfc52bdae6d72d5d0b74d29b87fbb2ecf5e6c29d647490aa3: Status 404 returned error can't find the container with id aa88c755fd4f71fcfc52bdae6d72d5d0b74d29b87fbb2ecf5e6c29d647490aa3 Sep 16 15:54:38.563329 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:38.563292 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" event={"ID":"bd8307d6-1f56-42e1-8387-10bd5a8b27bd","Type":"ContainerStarted","Data":"aa88c755fd4f71fcfc52bdae6d72d5d0b74d29b87fbb2ecf5e6c29d647490aa3"} Sep 16 15:54:39.051418 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:54:39.051358 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zdvpg" podUID="41934bfe-1e79-4bd8-a336-34526cf853ac" Sep 16 15:54:39.567601 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:39.567561 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdvpg" Sep 16 15:54:40.573180 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:40.573146 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" event={"ID":"bd8307d6-1f56-42e1-8387-10bd5a8b27bd","Type":"ContainerStarted","Data":"3466670d3b802703bc693c22c1dd0c0e5dd3292fd5aef7dff94b367ee77dd9a5"} Sep 16 15:54:41.578090 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.578043 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" event={"ID":"bd8307d6-1f56-42e1-8387-10bd5a8b27bd","Type":"ContainerStarted","Data":"be58e90c05150890ac91dde862e1f4f556930a00d0cac10edac7914ffe674a1d"} Sep 16 15:54:41.578511 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.578119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" event={"ID":"bd8307d6-1f56-42e1-8387-10bd5a8b27bd","Type":"ContainerStarted","Data":"fe92b7a0572d9e947f299fa8c78d84636f33a0c79af5e810549368f39778a70b"} Sep 16 15:54:41.611646 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.611594 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74658bcccc-42jb7" podStartSLOduration=1.6548100369999998 podStartE2EDuration="4.611577065s" totalImagesPullingTime="2.956767028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:54:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:54:41.611220458 +0000 UTC m=+282.530283239" watchObservedRunningTime="2026-09-16 15:54:41.611577065 +0000 UTC m=+282.530639845" Sep 16 15:54:41.717244 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.717158 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bbf7686c7-drzx9"] Sep 16 15:54:41.721074 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.721047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.735345 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.735318 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbf7686c7-drzx9"] Sep 16 15:54:41.765424 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.765386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlrs\" (UniqueName: \"kubernetes.io/projected/b4b95342-b738-43f0-aa43-4bacbb93bdb5-kube-api-access-wqlrs\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.765633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.765455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-oauth-config\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.765633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.765477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-config\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.765633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.765522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-oauth-serving-cert\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.765633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.765561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-serving-cert\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.765633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.765581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-service-ca\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.765633 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.765603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-trusted-ca-bundle\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.866294 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.866260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-oauth-config\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.866294 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.866299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-config\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.866523 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.866326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-oauth-serving-cert\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.866523 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.866381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-serving-cert\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.866523 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.866401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-service-ca\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.866523 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.866437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-trusted-ca-bundle\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.866714 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.866575 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlrs\" (UniqueName: \"kubernetes.io/projected/b4b95342-b738-43f0-aa43-4bacbb93bdb5-kube-api-access-wqlrs\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.867165 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.867143 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-service-ca\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.867267 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.867146 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-config\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.867307 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.867290 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-trusted-ca-bundle\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.867413 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.867387 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-oauth-serving-cert\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.868963 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.868938 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-serving-cert\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.869072 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.869037 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-oauth-config\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:41.879907 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:41.879879 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlrs\" (UniqueName: \"kubernetes.io/projected/b4b95342-b738-43f0-aa43-4bacbb93bdb5-kube-api-access-wqlrs\") pod \"console-bbf7686c7-drzx9\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:42.034126 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:42.033802 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:42.317291 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:42.317260 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbf7686c7-drzx9"] Sep 16 15:54:42.319339 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:54:42.319313 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b95342_b738_43f0_aa43_4bacbb93bdb5.slice/crio-67b3a9d27c8bbe5635851e57ed19a1f7f3cf9faf030fda12deb20aff421a5b3b WatchSource:0}: Error finding container 67b3a9d27c8bbe5635851e57ed19a1f7f3cf9faf030fda12deb20aff421a5b3b: Status 404 returned error can't find the container with id 67b3a9d27c8bbe5635851e57ed19a1f7f3cf9faf030fda12deb20aff421a5b3b Sep 16 15:54:42.583719 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:42.583685 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbf7686c7-drzx9" event={"ID":"b4b95342-b738-43f0-aa43-4bacbb93bdb5","Type":"ContainerStarted","Data":"814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d"} Sep 16 15:54:42.584117 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:42.583768 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbf7686c7-drzx9" event={"ID":"b4b95342-b738-43f0-aa43-4bacbb93bdb5","Type":"ContainerStarted","Data":"67b3a9d27c8bbe5635851e57ed19a1f7f3cf9faf030fda12deb20aff421a5b3b"} Sep 16 15:54:42.605093 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:42.605050 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bbf7686c7-drzx9" podStartSLOduration=1.605034794 podStartE2EDuration="1.605034794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:54:42.604138445 +0000 UTC m=+283.523201226" watchObservedRunningTime="2026-09-16 15:54:42.605034794 +0000 UTC m=+283.524097575" Sep 16 15:54:42.976748 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:42.976645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:54:42.979043 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:42.979013 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41934bfe-1e79-4bd8-a336-34526cf853ac-metrics-tls\") pod \"dns-default-zdvpg\" (UID: \"41934bfe-1e79-4bd8-a336-34526cf853ac\") " pod="openshift-dns/dns-default-zdvpg" Sep 16 15:54:43.171549 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:43.171512 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpn5l\"" Sep 16 15:54:43.179435 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:43.179400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zdvpg" Sep 16 15:54:43.452474 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:43.452446 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zdvpg"] Sep 16 15:54:43.454209 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:54:43.454186 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41934bfe_1e79_4bd8_a336_34526cf853ac.slice/crio-4352ae4c26b32e5248216aa3a1b600c22aa5bbd3ecc10efe4616b0aa8fcbf2fe WatchSource:0}: Error finding container 4352ae4c26b32e5248216aa3a1b600c22aa5bbd3ecc10efe4616b0aa8fcbf2fe: Status 404 returned error can't find the container with id 4352ae4c26b32e5248216aa3a1b600c22aa5bbd3ecc10efe4616b0aa8fcbf2fe Sep 16 15:54:43.588800 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:43.588764 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdvpg" event={"ID":"41934bfe-1e79-4bd8-a336-34526cf853ac","Type":"ContainerStarted","Data":"4352ae4c26b32e5248216aa3a1b600c22aa5bbd3ecc10efe4616b0aa8fcbf2fe"} Sep 16 15:54:46.602178 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:46.602138 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdvpg" event={"ID":"41934bfe-1e79-4bd8-a336-34526cf853ac","Type":"ContainerStarted","Data":"b3edf4a3fcc417d11f51f7cbe1160a639f88a988d48c44f05f6bf94b206bd1f6"} Sep 16 15:54:46.602570 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:46.602230 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zdvpg" event={"ID":"41934bfe-1e79-4bd8-a336-34526cf853ac","Type":"ContainerStarted","Data":"c950bcbeacd6202dfb46405826e8f28ef8901a257dc868789a97cf64f38190c5"} Sep 16 15:54:46.602570 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:46.602260 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zdvpg" Sep 16 15:54:46.620105 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:46.620051 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zdvpg" podStartSLOduration=252.56840995 podStartE2EDuration="4m14.620034331s" totalImagesPullingTime="2.051624381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:54:46.618932 +0000 UTC m=+287.537994779" watchObservedRunningTime="2026-09-16 15:54:46.620034331 +0000 UTC m=+287.539097111" Sep 16 15:54:52.035064 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:52.035006 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:52.035064 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:52.035078 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:52.039878 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:52.039855 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:52.630074 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:52.630041 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:54:52.680835 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:52.680796 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd9c95589-znxwf"] Sep 16 15:54:56.609249 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:56.609217 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zdvpg" Sep 16 15:54:59.448389 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:59.448357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 15:54:59.450607 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:59.450410 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 15:54:59.460053 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:54:59.460030 2563 kubelet.go:1648] "Image garbage collection succeeded" Sep 16 15:55:17.706276 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:17.706205 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fd9c95589-znxwf" podUID="a6e59cbb-0198-4303-b0cc-e11648aee2eb" containerName="console" containerID="cri-o://7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0" gracePeriod=15 Sep 16 15:55:17.944003 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:17.943971 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:55:18.061253 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061162 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-serving-cert\") pod \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " Sep 16 15:55:18.061253 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061202 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-service-ca\") pod \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " Sep 16 15:55:18.061253 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061244 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-config\") pod \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " Sep 16 15:55:18.061538 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061290 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbzbp\" (UniqueName: \"kubernetes.io/projected/a6e59cbb-0198-4303-b0cc-e11648aee2eb-kube-api-access-vbzbp\") pod \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " Sep 16 15:55:18.061538 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061317 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-trusted-ca-bundle\") pod \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " Sep 16 15:55:18.061538 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061345 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-oauth-config\") pod \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " Sep 16 15:55:18.061538 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061361 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-oauth-serving-cert\") pod \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\" (UID: \"a6e59cbb-0198-4303-b0cc-e11648aee2eb\") " Sep 16 15:55:18.061798 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061767 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-config" (OuterVolumeSpecName: "console-config") pod "a6e59cbb-0198-4303-b0cc-e11648aee2eb" (UID: "a6e59cbb-0198-4303-b0cc-e11648aee2eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:55:18.061883 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061776 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6e59cbb-0198-4303-b0cc-e11648aee2eb" (UID: "a6e59cbb-0198-4303-b0cc-e11648aee2eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:55:18.061883 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061852 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6e59cbb-0198-4303-b0cc-e11648aee2eb" (UID: "a6e59cbb-0198-4303-b0cc-e11648aee2eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:55:18.061883 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.061865 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a6e59cbb-0198-4303-b0cc-e11648aee2eb" (UID: "a6e59cbb-0198-4303-b0cc-e11648aee2eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:55:18.063510 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.063486 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6e59cbb-0198-4303-b0cc-e11648aee2eb" (UID: "a6e59cbb-0198-4303-b0cc-e11648aee2eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:55:18.063918 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.063896 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6e59cbb-0198-4303-b0cc-e11648aee2eb" (UID: "a6e59cbb-0198-4303-b0cc-e11648aee2eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:55:18.063981 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.063930 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e59cbb-0198-4303-b0cc-e11648aee2eb-kube-api-access-vbzbp" (OuterVolumeSpecName: "kube-api-access-vbzbp") pod "a6e59cbb-0198-4303-b0cc-e11648aee2eb" (UID: "a6e59cbb-0198-4303-b0cc-e11648aee2eb"). InnerVolumeSpecName "kube-api-access-vbzbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 15:55:18.162366 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.162329 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-config\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:55:18.162366 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.162360 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbzbp\" (UniqueName: \"kubernetes.io/projected/a6e59cbb-0198-4303-b0cc-e11648aee2eb-kube-api-access-vbzbp\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:55:18.162366 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.162373 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-trusted-ca-bundle\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:55:18.162587 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.162387 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-oauth-config\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:55:18.162587 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.162399 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-oauth-serving-cert\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:55:18.162587 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.162411 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e59cbb-0198-4303-b0cc-e11648aee2eb-console-serving-cert\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:55:18.162587 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.162423 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6e59cbb-0198-4303-b0cc-e11648aee2eb-service-ca\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:55:18.729885 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.729846 2563 generic.go:356] "Generic (PLEG): container finished" podID="a6e59cbb-0198-4303-b0cc-e11648aee2eb" containerID="7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0" exitCode=0 Sep 16 15:55:18.729885 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.729890 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd9c95589-znxwf" Sep 16 15:55:18.730368 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.729931 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd9c95589-znxwf" event={"ID":"a6e59cbb-0198-4303-b0cc-e11648aee2eb","Type":"ContainerDied","Data":"7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0"} Sep 16 15:55:18.730368 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.729983 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd9c95589-znxwf" event={"ID":"a6e59cbb-0198-4303-b0cc-e11648aee2eb","Type":"ContainerDied","Data":"b2c91a326d331ebc7f28897cc8230a5bc818b3bb309b96e3fa34234eb246d807"} Sep 16 15:55:18.730368 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.730005 2563 scope.go:117] "RemoveContainer" containerID="7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0" Sep 16 15:55:18.740682 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.740655 2563 scope.go:117] "RemoveContainer" containerID="7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0" Sep 16 15:55:18.741075 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:55:18.741054 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0\": container with ID starting with 7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0 not found: ID does not exist" containerID="7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0" Sep 16 15:55:18.741145 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.741086 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0"} err="failed to get container status \"7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0\": rpc error: code = NotFound desc = could not find container \"7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0\": container with ID starting with 7824248f6b33bf958a81894798705fe2e0b919f309500172308440e00eb4a5d0 not found: ID does not exist" Sep 16 15:55:18.752877 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.752844 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd9c95589-znxwf"] Sep 16 15:55:18.755877 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:18.755848 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fd9c95589-znxwf"] Sep 16 15:55:19.574906 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:19.574874 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e59cbb-0198-4303-b0cc-e11648aee2eb" path="/var/lib/kubelet/pods/a6e59cbb-0198-4303-b0cc-e11648aee2eb/volumes" Sep 16 15:55:54.810864 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.810784 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-998b9dbdb-gf7nn"] Sep 16 15:55:54.811434 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.811231 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e59cbb-0198-4303-b0cc-e11648aee2eb" containerName="console" Sep 16 15:55:54.811434 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.811250 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e59cbb-0198-4303-b0cc-e11648aee2eb" containerName="console" Sep 16 15:55:54.811434 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.811368 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e59cbb-0198-4303-b0cc-e11648aee2eb" containerName="console" Sep 16 15:55:54.814492 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.814465 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.826400 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.826369 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-998b9dbdb-gf7nn"] Sep 16 15:55:54.861376 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.861340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-oauth-config\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.861584 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.861478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-trusted-ca-bundle\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.861584 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.861515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-serving-cert\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.861584 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.861541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-config\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.861584 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.861564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-oauth-serving-cert\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.861815 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.861598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-service-ca\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.861815 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.861677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjx9s\" (UniqueName: \"kubernetes.io/projected/acee8cee-fb39-4d27-82aa-87900d36f5ba-kube-api-access-zjx9s\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.962702 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.962656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-trusted-ca-bundle\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.962702 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.962697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-serving-cert\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.962702 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.962714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-config\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.963044 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.962730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-oauth-serving-cert\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.963044 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.962788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-service-ca\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.963044 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.962819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjx9s\" (UniqueName: \"kubernetes.io/projected/acee8cee-fb39-4d27-82aa-87900d36f5ba-kube-api-access-zjx9s\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.963044 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.962857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-oauth-config\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.963603 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.963575 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-oauth-serving-cert\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.963603 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.963585 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-config\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.963787 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.963656 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-trusted-ca-bundle\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.963787 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.963703 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-service-ca\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.965656 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.965633 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-oauth-config\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.965874 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.965853 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-serving-cert\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:54.973684 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:54.973657 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjx9s\" (UniqueName: \"kubernetes.io/projected/acee8cee-fb39-4d27-82aa-87900d36f5ba-kube-api-access-zjx9s\") pod \"console-998b9dbdb-gf7nn\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:55.125376 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:55.125331 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:55:55.403087 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:55.403056 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-998b9dbdb-gf7nn"] Sep 16 15:55:55.405451 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:55:55.405423 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacee8cee_fb39_4d27_82aa_87900d36f5ba.slice/crio-697a9e5ff267089183a6864c00f366f9c87ab0ae17d9cc17d6740d034e4296c7 WatchSource:0}: Error finding container 697a9e5ff267089183a6864c00f366f9c87ab0ae17d9cc17d6740d034e4296c7: Status 404 returned error can't find the container with id 697a9e5ff267089183a6864c00f366f9c87ab0ae17d9cc17d6740d034e4296c7 Sep 16 15:55:55.874564 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:55.874533 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998b9dbdb-gf7nn" event={"ID":"acee8cee-fb39-4d27-82aa-87900d36f5ba","Type":"ContainerStarted","Data":"4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4"} Sep 16 15:55:55.874964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:55.874581 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998b9dbdb-gf7nn" event={"ID":"acee8cee-fb39-4d27-82aa-87900d36f5ba","Type":"ContainerStarted","Data":"697a9e5ff267089183a6864c00f366f9c87ab0ae17d9cc17d6740d034e4296c7"} Sep 16 15:55:55.896160 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:55:55.896109 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-998b9dbdb-gf7nn" podStartSLOduration=1.896086269 podStartE2EDuration="1.896086269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:55:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:55:55.895523856 +0000 UTC m=+356.814586636" watchObservedRunningTime="2026-09-16 15:55:55.896086269 +0000 UTC m=+356.815149051" Sep 16 15:56:05.126185 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:05.126134 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:56:05.126646 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:05.126202 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:56:05.131206 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:05.131178 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:56:05.917387 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:05.917358 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:56:05.976188 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:05.976154 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bbf7686c7-drzx9"] Sep 16 15:56:30.998040 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:30.997976 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bbf7686c7-drzx9" podUID="b4b95342-b738-43f0-aa43-4bacbb93bdb5" containerName="console" containerID="cri-o://814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d" gracePeriod=15 Sep 16 15:56:31.242455 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.242426 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:56:31.359281 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359249 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqlrs\" (UniqueName: \"kubernetes.io/projected/b4b95342-b738-43f0-aa43-4bacbb93bdb5-kube-api-access-wqlrs\") pod \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " Sep 16 15:56:31.359445 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359297 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-config\") pod \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " Sep 16 15:56:31.359445 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359329 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-serving-cert\") pod \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " Sep 16 15:56:31.359445 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359346 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-oauth-serving-cert\") pod \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " Sep 16 15:56:31.359445 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359376 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-trusted-ca-bundle\") pod \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " Sep 16 15:56:31.359445 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359403 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-oauth-config\") pod \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " Sep 16 15:56:31.359445 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359444 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-service-ca\") pod \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\" (UID: \"b4b95342-b738-43f0-aa43-4bacbb93bdb5\") " Sep 16 15:56:31.359929 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359888 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4b95342-b738-43f0-aa43-4bacbb93bdb5" (UID: "b4b95342-b738-43f0-aa43-4bacbb93bdb5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:56:31.360037 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359948 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4b95342-b738-43f0-aa43-4bacbb93bdb5" (UID: "b4b95342-b738-43f0-aa43-4bacbb93bdb5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:56:31.360037 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359959 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-config" (OuterVolumeSpecName: "console-config") pod "b4b95342-b738-43f0-aa43-4bacbb93bdb5" (UID: "b4b95342-b738-43f0-aa43-4bacbb93bdb5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:56:31.360037 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.359987 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4b95342-b738-43f0-aa43-4bacbb93bdb5" (UID: "b4b95342-b738-43f0-aa43-4bacbb93bdb5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:56:31.361544 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.361523 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4b95342-b738-43f0-aa43-4bacbb93bdb5" (UID: "b4b95342-b738-43f0-aa43-4bacbb93bdb5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:56:31.361977 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.361959 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b95342-b738-43f0-aa43-4bacbb93bdb5-kube-api-access-wqlrs" (OuterVolumeSpecName: "kube-api-access-wqlrs") pod "b4b95342-b738-43f0-aa43-4bacbb93bdb5" (UID: "b4b95342-b738-43f0-aa43-4bacbb93bdb5"). InnerVolumeSpecName "kube-api-access-wqlrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 15:56:31.362029 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.361957 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4b95342-b738-43f0-aa43-4bacbb93bdb5" (UID: "b4b95342-b738-43f0-aa43-4bacbb93bdb5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:56:31.460082 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.460040 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-trusted-ca-bundle\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:56:31.460082 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.460072 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-oauth-config\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:56:31.460082 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.460081 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-service-ca\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:56:31.460082 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.460090 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqlrs\" (UniqueName: \"kubernetes.io/projected/b4b95342-b738-43f0-aa43-4bacbb93bdb5-kube-api-access-wqlrs\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:56:31.460338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.460099 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-config\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:56:31.460338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.460107 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4b95342-b738-43f0-aa43-4bacbb93bdb5-console-serving-cert\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:56:31.460338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:31.460117 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4b95342-b738-43f0-aa43-4bacbb93bdb5-oauth-serving-cert\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:56:32.014155 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.014123 2563 generic.go:356] "Generic (PLEG): container finished" podID="b4b95342-b738-43f0-aa43-4bacbb93bdb5" containerID="814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d" exitCode=0 Sep 16 15:56:32.014542 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.014168 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbf7686c7-drzx9" Sep 16 15:56:32.014542 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.014184 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbf7686c7-drzx9" event={"ID":"b4b95342-b738-43f0-aa43-4bacbb93bdb5","Type":"ContainerDied","Data":"814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d"} Sep 16 15:56:32.014542 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.014221 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbf7686c7-drzx9" event={"ID":"b4b95342-b738-43f0-aa43-4bacbb93bdb5","Type":"ContainerDied","Data":"67b3a9d27c8bbe5635851e57ed19a1f7f3cf9faf030fda12deb20aff421a5b3b"} Sep 16 15:56:32.014542 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.014253 2563 scope.go:117] "RemoveContainer" containerID="814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d" Sep 16 15:56:32.022720 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.022697 2563 scope.go:117] "RemoveContainer" containerID="814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d" Sep 16 15:56:32.023089 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:56:32.023067 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d\": container with ID starting with 814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d not found: ID does not exist" containerID="814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d" Sep 16 15:56:32.023163 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.023099 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d"} err="failed to get container status \"814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d\": rpc error: code = NotFound desc = could not find container \"814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d\": container with ID starting with 814f6c9536ebc0882dfe919cc7cca4496b516c255844f5e5861b096e6418ba0d not found: ID does not exist" Sep 16 15:56:32.032136 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.032105 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bbf7686c7-drzx9"] Sep 16 15:56:32.035933 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:32.035905 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bbf7686c7-drzx9"] Sep 16 15:56:33.575089 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:56:33.575056 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4b95342-b738-43f0-aa43-4bacbb93bdb5" path="/var/lib/kubelet/pods/b4b95342-b738-43f0-aa43-4bacbb93bdb5/volumes" Sep 16 15:58:14.032373 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.032337 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4"] Sep 16 15:58:14.032897 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.032655 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b95342-b738-43f0-aa43-4bacbb93bdb5" containerName="console" Sep 16 15:58:14.032897 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.032667 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b95342-b738-43f0-aa43-4bacbb93bdb5" containerName="console" Sep 16 15:58:14.032897 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.032719 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4b95342-b738-43f0-aa43-4bacbb93bdb5" containerName="console" Sep 16 15:58:14.035893 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.035874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.038339 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.038322 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 16 15:58:14.039197 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.039176 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sfj9t\"" Sep 16 15:58:14.039269 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.039176 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 16 15:58:14.052174 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.052129 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4"] Sep 16 15:58:14.087050 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.087003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rfl9\" (UniqueName: \"kubernetes.io/projected/0b60436f-acdd-4b60-85ea-c960be3b4503-kube-api-access-6rfl9\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.087239 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.087113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.087239 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.087138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.188079 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.188037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rfl9\" (UniqueName: \"kubernetes.io/projected/0b60436f-acdd-4b60-85ea-c960be3b4503-kube-api-access-6rfl9\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.188284 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.188109 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.188284 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.188128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.188479 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.188461 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.188527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.188509 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.196998 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.196970 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rfl9\" (UniqueName: \"kubernetes.io/projected/0b60436f-acdd-4b60-85ea-c960be3b4503-kube-api-access-6rfl9\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.344977 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.344937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:14.624447 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.624420 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4"] Sep 16 15:58:14.627118 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:58:14.627088 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b60436f_acdd_4b60_85ea_c960be3b4503.slice/crio-b5112da1c9ce4ccf2e655666febd09ce966dce89b168d45765da6bcff2d0cafb WatchSource:0}: Error finding container b5112da1c9ce4ccf2e655666febd09ce966dce89b168d45765da6bcff2d0cafb: Status 404 returned error can't find the container with id b5112da1c9ce4ccf2e655666febd09ce966dce89b168d45765da6bcff2d0cafb Sep 16 15:58:14.629223 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:14.629202 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 15:58:15.406840 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:15.406795 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" event={"ID":"0b60436f-acdd-4b60-85ea-c960be3b4503","Type":"ContainerStarted","Data":"b5112da1c9ce4ccf2e655666febd09ce966dce89b168d45765da6bcff2d0cafb"} Sep 16 15:58:21.433577 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:21.433544 2563 generic.go:356] "Generic (PLEG): container finished" podID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerID="c0a72828b308064fbff4d7a5f3059fe8646d6ce69c291ecbb916607103589920" exitCode=0 Sep 16 15:58:21.433945 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:21.433622 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" event={"ID":"0b60436f-acdd-4b60-85ea-c960be3b4503","Type":"ContainerDied","Data":"c0a72828b308064fbff4d7a5f3059fe8646d6ce69c291ecbb916607103589920"} Sep 16 15:58:24.450696 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:24.450658 2563 generic.go:356] "Generic (PLEG): container finished" podID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerID="a8b24a93aba9e86f37a8f40cad5cf1d2900c35ca9fea905aaa303fdd3ba260a9" exitCode=0 Sep 16 15:58:24.450696 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:24.450704 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" event={"ID":"0b60436f-acdd-4b60-85ea-c960be3b4503","Type":"ContainerDied","Data":"a8b24a93aba9e86f37a8f40cad5cf1d2900c35ca9fea905aaa303fdd3ba260a9"} Sep 16 15:58:30.901731 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:58:30.901696 2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b60436f_acdd_4b60_85ea_c960be3b4503.slice/crio-conmon-4dd88ef2285a3a4111e3e683a86fe3e63253e5e9a2a5757d8e5ab43ce03e99d1.scope\": RecentStats: unable to find data in memory cache]" Sep 16 15:58:31.490437 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:31.490395 2563 generic.go:356] "Generic (PLEG): container finished" podID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerID="4dd88ef2285a3a4111e3e683a86fe3e63253e5e9a2a5757d8e5ab43ce03e99d1" exitCode=0 Sep 16 15:58:31.490610 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:31.490473 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" event={"ID":"0b60436f-acdd-4b60-85ea-c960be3b4503","Type":"ContainerDied","Data":"4dd88ef2285a3a4111e3e683a86fe3e63253e5e9a2a5757d8e5ab43ce03e99d1"} Sep 16 15:58:32.623615 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.623583 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:32.745996 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.745895 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-bundle\") pod \"0b60436f-acdd-4b60-85ea-c960be3b4503\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " Sep 16 15:58:32.745996 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.745938 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-util\") pod \"0b60436f-acdd-4b60-85ea-c960be3b4503\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " Sep 16 15:58:32.745996 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.745973 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rfl9\" (UniqueName: \"kubernetes.io/projected/0b60436f-acdd-4b60-85ea-c960be3b4503-kube-api-access-6rfl9\") pod \"0b60436f-acdd-4b60-85ea-c960be3b4503\" (UID: \"0b60436f-acdd-4b60-85ea-c960be3b4503\") " Sep 16 15:58:32.746581 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.746559 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-bundle" (OuterVolumeSpecName: "bundle") pod "0b60436f-acdd-4b60-85ea-c960be3b4503" (UID: "0b60436f-acdd-4b60-85ea-c960be3b4503"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 15:58:32.748238 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.748214 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b60436f-acdd-4b60-85ea-c960be3b4503-kube-api-access-6rfl9" (OuterVolumeSpecName: "kube-api-access-6rfl9") pod "0b60436f-acdd-4b60-85ea-c960be3b4503" (UID: "0b60436f-acdd-4b60-85ea-c960be3b4503"). InnerVolumeSpecName "kube-api-access-6rfl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 15:58:32.750481 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.750456 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-util" (OuterVolumeSpecName: "util") pod "0b60436f-acdd-4b60-85ea-c960be3b4503" (UID: "0b60436f-acdd-4b60-85ea-c960be3b4503"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 15:58:32.847527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.847486 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rfl9\" (UniqueName: \"kubernetes.io/projected/0b60436f-acdd-4b60-85ea-c960be3b4503-kube-api-access-6rfl9\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:58:32.847527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.847520 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-bundle\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:58:32.847527 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:32.847531 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b60436f-acdd-4b60-85ea-c960be3b4503-util\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:58:33.500804 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:33.500776 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" Sep 16 15:58:33.500970 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:33.500779 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1arh8w4" event={"ID":"0b60436f-acdd-4b60-85ea-c960be3b4503","Type":"ContainerDied","Data":"b5112da1c9ce4ccf2e655666febd09ce966dce89b168d45765da6bcff2d0cafb"} Sep 16 15:58:33.500970 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:33.500899 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5112da1c9ce4ccf2e655666febd09ce966dce89b168d45765da6bcff2d0cafb" Sep 16 15:58:36.407274 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.407229 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l"] Sep 16 15:58:36.407696 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.407679 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerName="pull" Sep 16 15:58:36.407751 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.407700 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerName="pull" Sep 16 15:58:36.407751 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.407717 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerName="extract" Sep 16 15:58:36.407751 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.407727 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerName="extract" Sep 16 15:58:36.407850 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.407766 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerName="util" Sep 16 15:58:36.407850 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.407777 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerName="util" Sep 16 15:58:36.407922 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.407853 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b60436f-acdd-4b60-85ea-c960be3b4503" containerName="extract" Sep 16 15:58:36.453030 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.452985 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l"] Sep 16 15:58:36.453457 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.453245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:36.456844 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.456311 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 16 15:58:36.456844 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.456362 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Sep 16 15:58:36.456844 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.456656 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 16 15:58:36.456844 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.456804 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-2mrqf\"" Sep 16 15:58:36.581794 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.581728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/251a621d-3b6b-4227-8521-528d4f2a6627-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-jss5l\" (UID: \"251a621d-3b6b-4227-8521-528d4f2a6627\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:36.581983 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.581861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt8fd\" (UniqueName: \"kubernetes.io/projected/251a621d-3b6b-4227-8521-528d4f2a6627-kube-api-access-rt8fd\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-jss5l\" (UID: \"251a621d-3b6b-4227-8521-528d4f2a6627\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:36.682854 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.682753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/251a621d-3b6b-4227-8521-528d4f2a6627-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-jss5l\" (UID: \"251a621d-3b6b-4227-8521-528d4f2a6627\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:36.683034 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.682872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt8fd\" (UniqueName: \"kubernetes.io/projected/251a621d-3b6b-4227-8521-528d4f2a6627-kube-api-access-rt8fd\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-jss5l\" (UID: \"251a621d-3b6b-4227-8521-528d4f2a6627\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:36.685096 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.685072 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/251a621d-3b6b-4227-8521-528d4f2a6627-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-jss5l\" (UID: \"251a621d-3b6b-4227-8521-528d4f2a6627\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:36.692144 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.692118 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt8fd\" (UniqueName: \"kubernetes.io/projected/251a621d-3b6b-4227-8521-528d4f2a6627-kube-api-access-rt8fd\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-jss5l\" (UID: \"251a621d-3b6b-4227-8521-528d4f2a6627\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:36.765352 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:36.765311 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:37.061362 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:37.061336 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l"] Sep 16 15:58:37.064135 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:58:37.064101 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251a621d_3b6b_4227_8521_528d4f2a6627.slice/crio-7a4616b7674e526b26ef1a2096aceac839d0eaaf4d2d2a4c7ec7e3586e9b0cf2 WatchSource:0}: Error finding container 7a4616b7674e526b26ef1a2096aceac839d0eaaf4d2d2a4c7ec7e3586e9b0cf2: Status 404 returned error can't find the container with id 7a4616b7674e526b26ef1a2096aceac839d0eaaf4d2d2a4c7ec7e3586e9b0cf2 Sep 16 15:58:37.518172 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:37.518134 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" event={"ID":"251a621d-3b6b-4227-8521-528d4f2a6627","Type":"ContainerStarted","Data":"7a4616b7674e526b26ef1a2096aceac839d0eaaf4d2d2a4c7ec7e3586e9b0cf2"} Sep 16 15:58:40.535475 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:40.535430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" event={"ID":"251a621d-3b6b-4227-8521-528d4f2a6627","Type":"ContainerStarted","Data":"ca93b6027140874d584c86bd6cad5e99f37a70f04d52633ea25c976cf16cd5ca"} Sep 16 15:58:40.535964 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:40.535637 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:58:40.559664 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:40.559610 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" podStartSLOduration=1.304961789 podStartE2EDuration="4.559594497s" totalImagesPullingTime="3.254632708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:58:40.558290455 +0000 UTC m=+521.477353234" watchObservedRunningTime="2026-09-16 15:58:40.559594497 +0000 UTC m=+521.478657277" Sep 16 15:58:41.081325 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.081285 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-fjtlt"] Sep 16 15:58:41.097908 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.097871 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-fjtlt"] Sep 16 15:58:41.098070 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.098023 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.100484 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.100460 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Sep 16 15:58:41.100484 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.100477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-bhfrv\"" Sep 16 15:58:41.100484 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.100462 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Sep 16 15:58:41.224365 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.224327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/57d9e176-e332-4854-a1b6-111616ce5748-cabundle0\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.224536 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.224395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-certificates\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.224536 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.224478 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphcl\" (UniqueName: \"kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-kube-api-access-tphcl\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.325109 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.325070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-certificates\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.325287 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.325142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tphcl\" (UniqueName: \"kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-kube-api-access-tphcl\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.325287 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.325173 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/57d9e176-e332-4854-a1b6-111616ce5748-cabundle0\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.325287 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:58:41.325243 2563 secret.go:281] references non-existent secret key: ca.crt Sep 16 15:58:41.325287 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:58:41.325264 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 16 15:58:41.325287 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:58:41.325273 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-fjtlt: references non-existent secret key: ca.crt Sep 16 15:58:41.325474 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:58:41.325332 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-certificates podName:57d9e176-e332-4854-a1b6-111616ce5748 nodeName:}" failed. No retries permitted until 2026-09-16 15:58:41.825317812 +0000 UTC m=+522.744380576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-certificates") pod "keda-operator-579c8958f7-fjtlt" (UID: "57d9e176-e332-4854-a1b6-111616ce5748") : references non-existent secret key: ca.crt Sep 16 15:58:41.325801 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.325785 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/57d9e176-e332-4854-a1b6-111616ce5748-cabundle0\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.342174 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.342135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphcl\" (UniqueName: \"kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-kube-api-access-tphcl\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.346227 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.346201 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6"] Sep 16 15:58:41.367884 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.367852 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.370384 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.370183 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Sep 16 15:58:41.371916 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.371843 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6"] Sep 16 15:58:41.376072 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.375609 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745877448f-46djl"] Sep 16 15:58:41.395901 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.395867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.407765 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.407666 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745877448f-46djl"] Sep 16 15:58:41.426188 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.426157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.426188 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.426195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-certificates\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.426418 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.426240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vhrs\" (UniqueName: \"kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-kube-api-access-8vhrs\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.527092 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17118c3d-09cf-472c-8244-d13feba039b7-console-oauth-config\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.527092 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-trusted-ca-bundle\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.527338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-oauth-serving-cert\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.527338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.527338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17118c3d-09cf-472c-8244-d13feba039b7-console-serving-cert\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.527338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-certificates\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.527338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t495h\" (UniqueName: \"kubernetes.io/projected/17118c3d-09cf-472c-8244-d13feba039b7-kube-api-access-t495h\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.527592 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vhrs\" (UniqueName: \"kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-kube-api-access-8vhrs\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.527592 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:58:41.527408 2563 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Sep 16 15:58:41.527592 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:58:41.527433 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6: secret "keda-metrics-apiserver-certs" not found Sep 16 15:58:41.527592 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-console-config\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.527592 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:58:41.527483 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-certificates podName:b49918f7-148f-4ea8-a71f-2e7caaf4f0fd nodeName:}" failed. No retries permitted until 2026-09-16 15:58:42.027466338 +0000 UTC m=+522.946529097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-certificates") pod "keda-metrics-apiserver-77857b7b98-8bpl6" (UID: "b49918f7-148f-4ea8-a71f-2e7caaf4f0fd") : secret "keda-metrics-apiserver-certs" not found Sep 16 15:58:41.527592 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-service-ca\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.527856 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.527656 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.538424 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.538398 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vhrs\" (UniqueName: \"kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-kube-api-access-8vhrs\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:41.628626 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.628516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17118c3d-09cf-472c-8244-d13feba039b7-console-oauth-config\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.628626 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.628567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-trusted-ca-bundle\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.628626 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.628592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-oauth-serving-cert\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.628950 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.628641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17118c3d-09cf-472c-8244-d13feba039b7-console-serving-cert\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.628950 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.628805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t495h\" (UniqueName: \"kubernetes.io/projected/17118c3d-09cf-472c-8244-d13feba039b7-kube-api-access-t495h\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.628950 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.628907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-console-config\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.628950 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.628935 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-service-ca\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.630089 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.630052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-service-ca\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.630089 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.630079 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-oauth-serving-cert\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.630299 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.630093 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-console-config\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.630299 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.630245 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17118c3d-09cf-472c-8244-d13feba039b7-trusted-ca-bundle\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.631221 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.631192 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17118c3d-09cf-472c-8244-d13feba039b7-console-serving-cert\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.631349 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.631283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17118c3d-09cf-472c-8244-d13feba039b7-console-oauth-config\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.638303 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.638272 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t495h\" (UniqueName: \"kubernetes.io/projected/17118c3d-09cf-472c-8244-d13feba039b7-kube-api-access-t495h\") pod \"console-745877448f-46djl\" (UID: \"17118c3d-09cf-472c-8244-d13feba039b7\") " pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.690241 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.690209 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-s87dt"] Sep 16 15:58:41.707030 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.707001 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:41.719631 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.719498 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-s87dt"] Sep 16 15:58:41.719631 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.719604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:41.722151 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.722121 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Sep 16 15:58:41.831229 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.830767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n727l\" (UniqueName: \"kubernetes.io/projected/d972a234-67c0-4c68-bd25-2f6be1f1d39b-kube-api-access-n727l\") pod \"keda-admission-6c4d864b86-s87dt\" (UID: \"d972a234-67c0-4c68-bd25-2f6be1f1d39b\") " pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:41.831229 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.830830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d972a234-67c0-4c68-bd25-2f6be1f1d39b-certificates\") pod \"keda-admission-6c4d864b86-s87dt\" (UID: \"d972a234-67c0-4c68-bd25-2f6be1f1d39b\") " pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:41.831229 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.830948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-certificates\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.834018 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.833989 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/57d9e176-e332-4854-a1b6-111616ce5748-certificates\") pod \"keda-operator-579c8958f7-fjtlt\" (UID: \"57d9e176-e332-4854-a1b6-111616ce5748\") " pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:41.933970 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.933874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n727l\" (UniqueName: \"kubernetes.io/projected/d972a234-67c0-4c68-bd25-2f6be1f1d39b-kube-api-access-n727l\") pod \"keda-admission-6c4d864b86-s87dt\" (UID: \"d972a234-67c0-4c68-bd25-2f6be1f1d39b\") " pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:41.933970 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.933917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d972a234-67c0-4c68-bd25-2f6be1f1d39b-certificates\") pod \"keda-admission-6c4d864b86-s87dt\" (UID: \"d972a234-67c0-4c68-bd25-2f6be1f1d39b\") " pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:41.936407 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.936381 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d972a234-67c0-4c68-bd25-2f6be1f1d39b-certificates\") pod \"keda-admission-6c4d864b86-s87dt\" (UID: \"d972a234-67c0-4c68-bd25-2f6be1f1d39b\") " pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:41.944414 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:41.944339 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n727l\" (UniqueName: \"kubernetes.io/projected/d972a234-67c0-4c68-bd25-2f6be1f1d39b-kube-api-access-n727l\") pod \"keda-admission-6c4d864b86-s87dt\" (UID: \"d972a234-67c0-4c68-bd25-2f6be1f1d39b\") " pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:42.009059 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.009019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:42.018154 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.018114 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745877448f-46djl"] Sep 16 15:58:42.022822 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:58:42.022788 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17118c3d_09cf_472c_8244_d13feba039b7.slice/crio-9371070a46e21aebfc91ab83ee6a266763c64235bfd4bcefed82c0006243651a WatchSource:0}: Error finding container 9371070a46e21aebfc91ab83ee6a266763c64235bfd4bcefed82c0006243651a: Status 404 returned error can't find the container with id 9371070a46e21aebfc91ab83ee6a266763c64235bfd4bcefed82c0006243651a Sep 16 15:58:42.033679 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.033641 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:42.035066 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.035035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-certificates\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:42.037851 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.037823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b49918f7-148f-4ea8-a71f-2e7caaf4f0fd-certificates\") pod \"keda-metrics-apiserver-77857b7b98-8bpl6\" (UID: \"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:42.283184 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.282846 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:42.310843 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.310816 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-fjtlt"] Sep 16 15:58:42.314214 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:58:42.314181 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d9e176_e332_4854_a1b6_111616ce5748.slice/crio-cf6cc2e6d9ae587fab999c53c449baabd18ef14127de21a4ed9a27340e9db126 WatchSource:0}: Error finding container cf6cc2e6d9ae587fab999c53c449baabd18ef14127de21a4ed9a27340e9db126: Status 404 returned error can't find the container with id cf6cc2e6d9ae587fab999c53c449baabd18ef14127de21a4ed9a27340e9db126 Sep 16 15:58:42.340921 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.340885 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-s87dt"] Sep 16 15:58:42.345048 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:58:42.345008 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd972a234_67c0_4c68_bd25_2f6be1f1d39b.slice/crio-f42942971e38b55007bea672c768ddc7bc44ff3541f71a691b28e1d1a27b54b9 WatchSource:0}: Error finding container f42942971e38b55007bea672c768ddc7bc44ff3541f71a691b28e1d1a27b54b9: Status 404 returned error can't find the container with id f42942971e38b55007bea672c768ddc7bc44ff3541f71a691b28e1d1a27b54b9 Sep 16 15:58:42.544992 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.544903 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-s87dt" event={"ID":"d972a234-67c0-4c68-bd25-2f6be1f1d39b","Type":"ContainerStarted","Data":"f42942971e38b55007bea672c768ddc7bc44ff3541f71a691b28e1d1a27b54b9"} Sep 16 15:58:42.546200 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.546166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-fjtlt" event={"ID":"57d9e176-e332-4854-a1b6-111616ce5748","Type":"ContainerStarted","Data":"cf6cc2e6d9ae587fab999c53c449baabd18ef14127de21a4ed9a27340e9db126"} Sep 16 15:58:42.547844 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.547819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745877448f-46djl" event={"ID":"17118c3d-09cf-472c-8244-d13feba039b7","Type":"ContainerStarted","Data":"2c608ad653568b0cbe4654c09fcc6f2277495d2942bf5385d5a1a82e88cbf8fa"} Sep 16 15:58:42.547947 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.547864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745877448f-46djl" event={"ID":"17118c3d-09cf-472c-8244-d13feba039b7","Type":"ContainerStarted","Data":"9371070a46e21aebfc91ab83ee6a266763c64235bfd4bcefed82c0006243651a"} Sep 16 15:58:42.569867 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.569812 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745877448f-46djl" podStartSLOduration=1.56979366 podStartE2EDuration="1.56979366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:58:42.567986251 +0000 UTC m=+523.487049031" watchObservedRunningTime="2026-09-16 15:58:42.56979366 +0000 UTC m=+523.488856506" Sep 16 15:58:42.572588 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:42.572407 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6"] Sep 16 15:58:42.575583 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:58:42.575555 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49918f7_148f_4ea8_a71f_2e7caaf4f0fd.slice/crio-f5efc75d77fe5e4816b782bf2d3b3d36d4d56b34d7cf0458f52739e8f87b1577 WatchSource:0}: Error finding container f5efc75d77fe5e4816b782bf2d3b3d36d4d56b34d7cf0458f52739e8f87b1577: Status 404 returned error can't find the container with id f5efc75d77fe5e4816b782bf2d3b3d36d4d56b34d7cf0458f52739e8f87b1577 Sep 16 15:58:43.557080 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:43.557042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" event={"ID":"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd","Type":"ContainerStarted","Data":"f5efc75d77fe5e4816b782bf2d3b3d36d4d56b34d7cf0458f52739e8f87b1577"} Sep 16 15:58:44.564725 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:44.564684 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-s87dt" event={"ID":"d972a234-67c0-4c68-bd25-2f6be1f1d39b","Type":"ContainerStarted","Data":"6a3175e778715c9c95c7152f273291abcb2eca9a686408c5c0f65a28d57a325c"} Sep 16 15:58:44.565188 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:44.564778 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:58:44.583439 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:44.583341 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-s87dt" podStartSLOduration=1.586992779 podStartE2EDuration="3.583315064s" totalImagesPullingTime="1.996322285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:58:44.581269976 +0000 UTC m=+525.500332760" watchObservedRunningTime="2026-09-16 15:58:44.583315064 +0000 UTC m=+525.502377845" Sep 16 15:58:47.583256 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:47.583217 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-fjtlt" event={"ID":"57d9e176-e332-4854-a1b6-111616ce5748","Type":"ContainerStarted","Data":"ff870060f10c3cb67ac6924aee13ad078d6868608a559094d22ab6a4c517aa40"} Sep 16 15:58:47.583686 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:47.583281 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:58:47.584865 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:47.584838 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" event={"ID":"b49918f7-148f-4ea8-a71f-2e7caaf4f0fd","Type":"ContainerStarted","Data":"15e16693eea4f86a0aa3549778b80a7bfb02aaa27b0ebaedab4c070a804c2da0"} Sep 16 15:58:47.584969 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:47.584893 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:58:47.602467 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:47.602418 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-fjtlt" podStartSLOduration=2.304075036 podStartE2EDuration="6.602404104s" totalImagesPullingTime="4.298329068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:58:47.601550687 +0000 UTC m=+528.520613461" watchObservedRunningTime="2026-09-16 15:58:47.602404104 +0000 UTC m=+528.521466881" Sep 16 15:58:47.620240 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:47.620188 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" podStartSLOduration=2.588780258 podStartE2EDuration="6.62017332s" totalImagesPullingTime="4.031393062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:58:47.618587125 +0000 UTC m=+528.537649907" watchObservedRunningTime="2026-09-16 15:58:47.62017332 +0000 UTC m=+528.539236099" Sep 16 15:58:51.708022 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:51.707931 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:51.708022 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:51.708014 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:51.713471 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:51.713441 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:52.619825 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:52.619796 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745877448f-46djl" Sep 16 15:58:52.670906 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:52.670868 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-998b9dbdb-gf7nn"] Sep 16 15:58:58.597116 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:58:58.597084 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-8bpl6" Sep 16 15:59:01.543003 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:01.542961 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-jss5l" Sep 16 15:59:05.576653 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:05.576616 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-s87dt" Sep 16 15:59:08.594945 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:08.594919 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-fjtlt" Sep 16 15:59:17.694899 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:17.694840 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-998b9dbdb-gf7nn" podUID="acee8cee-fb39-4d27-82aa-87900d36f5ba" containerName="console" containerID="cri-o://4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4" gracePeriod=15 Sep 16 15:59:17.945116 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:17.945045 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:59:18.060271 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060221 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-trusted-ca-bundle\") pod \"acee8cee-fb39-4d27-82aa-87900d36f5ba\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " Sep 16 15:59:18.060482 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060292 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-oauth-serving-cert\") pod \"acee8cee-fb39-4d27-82aa-87900d36f5ba\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " Sep 16 15:59:18.060482 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060328 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjx9s\" (UniqueName: \"kubernetes.io/projected/acee8cee-fb39-4d27-82aa-87900d36f5ba-kube-api-access-zjx9s\") pod \"acee8cee-fb39-4d27-82aa-87900d36f5ba\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " Sep 16 15:59:18.060482 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060347 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-serving-cert\") pod \"acee8cee-fb39-4d27-82aa-87900d36f5ba\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " Sep 16 15:59:18.060482 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060363 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-config\") pod \"acee8cee-fb39-4d27-82aa-87900d36f5ba\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " Sep 16 15:59:18.060482 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060462 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-service-ca\") pod \"acee8cee-fb39-4d27-82aa-87900d36f5ba\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " Sep 16 15:59:18.060769 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060499 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-oauth-config\") pod \"acee8cee-fb39-4d27-82aa-87900d36f5ba\" (UID: \"acee8cee-fb39-4d27-82aa-87900d36f5ba\") " Sep 16 15:59:18.060769 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060702 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "acee8cee-fb39-4d27-82aa-87900d36f5ba" (UID: "acee8cee-fb39-4d27-82aa-87900d36f5ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:59:18.060894 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060788 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-config" (OuterVolumeSpecName: "console-config") pod "acee8cee-fb39-4d27-82aa-87900d36f5ba" (UID: "acee8cee-fb39-4d27-82aa-87900d36f5ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:59:18.060894 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060802 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "acee8cee-fb39-4d27-82aa-87900d36f5ba" (UID: "acee8cee-fb39-4d27-82aa-87900d36f5ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:59:18.060894 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.060875 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "acee8cee-fb39-4d27-82aa-87900d36f5ba" (UID: "acee8cee-fb39-4d27-82aa-87900d36f5ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 15:59:18.062631 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.062604 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "acee8cee-fb39-4d27-82aa-87900d36f5ba" (UID: "acee8cee-fb39-4d27-82aa-87900d36f5ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:59:18.062715 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.062681 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acee8cee-fb39-4d27-82aa-87900d36f5ba-kube-api-access-zjx9s" (OuterVolumeSpecName: "kube-api-access-zjx9s") pod "acee8cee-fb39-4d27-82aa-87900d36f5ba" (UID: "acee8cee-fb39-4d27-82aa-87900d36f5ba"). InnerVolumeSpecName "kube-api-access-zjx9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 15:59:18.062715 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.062685 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "acee8cee-fb39-4d27-82aa-87900d36f5ba" (UID: "acee8cee-fb39-4d27-82aa-87900d36f5ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 15:59:18.162115 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.162064 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-oauth-config\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:59:18.162115 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.162110 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-trusted-ca-bundle\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:59:18.162115 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.162120 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-oauth-serving-cert\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:59:18.162115 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.162129 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjx9s\" (UniqueName: \"kubernetes.io/projected/acee8cee-fb39-4d27-82aa-87900d36f5ba-kube-api-access-zjx9s\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:59:18.162376 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.162137 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-serving-cert\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:59:18.162376 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.162146 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-console-config\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:59:18.162376 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.162154 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acee8cee-fb39-4d27-82aa-87900d36f5ba-service-ca\") on node \"ip-10-0-129-216.ec2.internal\" DevicePath \"\"" Sep 16 15:59:18.738032 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.737994 2563 generic.go:356] "Generic (PLEG): container finished" podID="acee8cee-fb39-4d27-82aa-87900d36f5ba" containerID="4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4" exitCode=0 Sep 16 15:59:18.738449 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.738044 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998b9dbdb-gf7nn" Sep 16 15:59:18.738449 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.738053 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998b9dbdb-gf7nn" event={"ID":"acee8cee-fb39-4d27-82aa-87900d36f5ba","Type":"ContainerDied","Data":"4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4"} Sep 16 15:59:18.738449 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.738091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998b9dbdb-gf7nn" event={"ID":"acee8cee-fb39-4d27-82aa-87900d36f5ba","Type":"ContainerDied","Data":"697a9e5ff267089183a6864c00f366f9c87ab0ae17d9cc17d6740d034e4296c7"} Sep 16 15:59:18.738449 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.738111 2563 scope.go:117] "RemoveContainer" containerID="4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4" Sep 16 15:59:18.747800 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.747781 2563 scope.go:117] "RemoveContainer" containerID="4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4" Sep 16 15:59:18.748131 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:59:18.748112 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4\": container with ID starting with 4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4 not found: ID does not exist" containerID="4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4" Sep 16 15:59:18.748178 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.748141 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4"} err="failed to get container status \"4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4\": rpc error: code = NotFound desc = could not find container \"4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4\": container with ID starting with 4eaee7ecbcf7b7a24222ded45e5d9ce98eb24c35884161f53d6f523812cc4dc4 not found: ID does not exist" Sep 16 15:59:18.761338 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.761302 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-998b9dbdb-gf7nn"] Sep 16 15:59:18.766250 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:18.766220 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-998b9dbdb-gf7nn"] Sep 16 15:59:19.574880 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:19.574845 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acee8cee-fb39-4d27-82aa-87900d36f5ba" path="/var/lib/kubelet/pods/acee8cee-fb39-4d27-82aa-87900d36f5ba/volumes" Sep 16 15:59:58.193871 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.193815 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq"] Sep 16 15:59:58.194530 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.194509 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acee8cee-fb39-4d27-82aa-87900d36f5ba" containerName="console" Sep 16 15:59:58.194622 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.194533 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="acee8cee-fb39-4d27-82aa-87900d36f5ba" containerName="console" Sep 16 15:59:58.194622 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.194608 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="acee8cee-fb39-4d27-82aa-87900d36f5ba" containerName="console" Sep 16 15:59:58.197466 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.197442 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:58.199835 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.199808 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Sep 16 15:59:58.199973 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.199822 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-2l9vr\"" Sep 16 15:59:58.200659 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.200638 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 16 15:59:58.200762 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.200692 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 16 15:59:58.207866 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.207732 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq"] Sep 16 15:59:58.292089 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.292050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/326eda80-b051-4c93-bb30-27af19cc8058-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wqkzq\" (UID: \"326eda80-b051-4c93-bb30-27af19cc8058\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:58.292282 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.292113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ngj5\" (UniqueName: \"kubernetes.io/projected/326eda80-b051-4c93-bb30-27af19cc8058-kube-api-access-4ngj5\") pod \"llmisvc-controller-manager-645f9c8fd6-wqkzq\" (UID: \"326eda80-b051-4c93-bb30-27af19cc8058\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:58.392556 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.392508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/326eda80-b051-4c93-bb30-27af19cc8058-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wqkzq\" (UID: \"326eda80-b051-4c93-bb30-27af19cc8058\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:58.392770 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.392593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ngj5\" (UniqueName: \"kubernetes.io/projected/326eda80-b051-4c93-bb30-27af19cc8058-kube-api-access-4ngj5\") pod \"llmisvc-controller-manager-645f9c8fd6-wqkzq\" (UID: \"326eda80-b051-4c93-bb30-27af19cc8058\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:58.392770 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:59:58.392650 2563 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 16 15:59:58.392770 ip-10-0-129-216 kubenswrapper[2563]: E0916 15:59:58.392714 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326eda80-b051-4c93-bb30-27af19cc8058-cert podName:326eda80-b051-4c93-bb30-27af19cc8058 nodeName:}" failed. No retries permitted until 2026-09-16 15:59:58.892698333 +0000 UTC m=+599.811761091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/326eda80-b051-4c93-bb30-27af19cc8058-cert") pod "llmisvc-controller-manager-645f9c8fd6-wqkzq" (UID: "326eda80-b051-4c93-bb30-27af19cc8058") : secret "llmisvc-webhook-server-cert" not found Sep 16 15:59:58.401860 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.401825 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ngj5\" (UniqueName: \"kubernetes.io/projected/326eda80-b051-4c93-bb30-27af19cc8058-kube-api-access-4ngj5\") pod \"llmisvc-controller-manager-645f9c8fd6-wqkzq\" (UID: \"326eda80-b051-4c93-bb30-27af19cc8058\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:58.896853 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.896818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/326eda80-b051-4c93-bb30-27af19cc8058-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wqkzq\" (UID: \"326eda80-b051-4c93-bb30-27af19cc8058\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:58.899349 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:58.899310 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/326eda80-b051-4c93-bb30-27af19cc8058-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wqkzq\" (UID: \"326eda80-b051-4c93-bb30-27af19cc8058\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:59.108073 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:59.108031 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 15:59:59.383218 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:59.383117 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq"] Sep 16 15:59:59.385506 ip-10-0-129-216 kubenswrapper[2563]: W0916 15:59:59.385474 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod326eda80_b051_4c93_bb30_27af19cc8058.slice/crio-4a557e149c75c691ec41a3d1989d3b95f153b499de5a9517f24066f3411bcca1 WatchSource:0}: Error finding container 4a557e149c75c691ec41a3d1989d3b95f153b499de5a9517f24066f3411bcca1: Status 404 returned error can't find the container with id 4a557e149c75c691ec41a3d1989d3b95f153b499de5a9517f24066f3411bcca1 Sep 16 15:59:59.484871 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:59.484789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 15:59:59.485029 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:59.484999 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 15:59:59.926264 ip-10-0-129-216 kubenswrapper[2563]: I0916 15:59:59.926220 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" event={"ID":"326eda80-b051-4c93-bb30-27af19cc8058","Type":"ContainerStarted","Data":"4a557e149c75c691ec41a3d1989d3b95f153b499de5a9517f24066f3411bcca1"} Sep 16 16:00:02.944114 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:00:02.944068 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" event={"ID":"326eda80-b051-4c93-bb30-27af19cc8058","Type":"ContainerStarted","Data":"0f2e20267eb0e8f77a79f6c275b503cbfab2630b9cba0c4ac15fc451bbcc1fee"} Sep 16 16:00:02.944567 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:00:02.944231 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 16:00:02.961758 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:00:02.961686 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" podStartSLOduration=2.224411538 podStartE2EDuration="4.961669566s" totalImagesPullingTime="2.737258028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 16:00:02.960136859 +0000 UTC m=+603.879199640" watchObservedRunningTime="2026-09-16 16:00:02.961669566 +0000 UTC m=+603.880732382" Sep 16 16:00:33.950828 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:00:33.950789 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wqkzq" Sep 16 16:01:11.813882 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:11.813850 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4vltk_639c65c1-532e-4ebb-b896-8a5a33158004/global-pull-secret-syncer/0.log" Sep 16 16:01:11.994021 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:11.993992 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wm9c6_91bf516f-486b-4d8d-885a-7a102f9bd961/konnectivity-agent/0.log" Sep 16 16:01:12.049899 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:12.049872 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-216.ec2.internal_63ad1e6b9e811b72ceb5b25bb5b9b667/haproxy/0.log" Sep 16 16:01:16.514633 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:16.514604 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56b8667469-g5wp2_006d4c9d-262d-4536-bb81-09e987571e0c/metrics-server/0.log" Sep 16 16:01:16.700374 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:16.700341 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l8888_c332d5fa-d63c-48b1-8336-5ed84cd862ba/node-exporter/0.log" Sep 16 16:01:16.732790 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:16.732762 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l8888_c332d5fa-d63c-48b1-8336-5ed84cd862ba/kube-rbac-proxy/0.log" Sep 16 16:01:16.761654 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:16.761627 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l8888_c332d5fa-d63c-48b1-8336-5ed84cd862ba/init-textfile/0.log" Sep 16 16:01:16.886767 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:16.886726 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rrtqj_fa29376c-5033-48fc-be73-aebeedf58e7e/kube-rbac-proxy-main/0.log" Sep 16 16:01:16.921809 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:16.921776 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rrtqj_fa29376c-5033-48fc-be73-aebeedf58e7e/kube-rbac-proxy-self/0.log" Sep 16 16:01:16.952528 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:16.952498 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-rrtqj_fa29376c-5033-48fc-be73-aebeedf58e7e/openshift-state-metrics/0.log" Sep 16 16:01:17.302177 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.302098 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-cxql9_660f03a4-72e6-48d7-be37-623e4e57aa7a/prometheus-operator/0.log" Sep 16 16:01:17.346905 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.346873 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-cxql9_660f03a4-72e6-48d7-be37-623e4e57aa7a/kube-rbac-proxy/0.log" Sep 16 16:01:17.459818 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.459789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74658bcccc-42jb7_bd8307d6-1f56-42e1-8387-10bd5a8b27bd/telemeter-client/0.log" Sep 16 16:01:17.513503 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.513477 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74658bcccc-42jb7_bd8307d6-1f56-42e1-8387-10bd5a8b27bd/reload/0.log" Sep 16 16:01:17.569371 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.569292 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74658bcccc-42jb7_bd8307d6-1f56-42e1-8387-10bd5a8b27bd/kube-rbac-proxy/0.log" Sep 16 16:01:17.636416 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.636387 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/thanos-query/0.log" Sep 16 16:01:17.686444 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.686417 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/kube-rbac-proxy-web/0.log" Sep 16 16:01:17.732977 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.732952 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/kube-rbac-proxy/0.log" Sep 16 16:01:17.778352 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.778320 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/prom-label-proxy/0.log" Sep 16 16:01:17.834793 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.834722 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/kube-rbac-proxy-rules/0.log" Sep 16 16:01:17.889764 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:17.889714 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77758c89f-xw65h_21e11f0d-0773-4281-9a3b-37534fd32738/kube-rbac-proxy-metrics/0.log" Sep 16 16:01:19.592138 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.592107 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/2.log" Sep 16 16:01:19.596196 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.596169 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-6z2tt_9b833dbd-33c5-42d4-8a83-7b12b2e7f5eb/console-operator/3.log" Sep 16 16:01:19.942928 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.942847 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4"] Sep 16 16:01:19.946111 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.946091 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:19.948679 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.948652 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z4zqb\"/\"kube-root-ca.crt\"" Sep 16 16:01:19.948844 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.948648 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z4zqb\"/\"openshift-service-ca.crt\"" Sep 16 16:01:19.949520 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.949498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z4zqb\"/\"default-dockercfg-n5cp4\"" Sep 16 16:01:19.963536 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.963504 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4"] Sep 16 16:01:19.967696 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.967519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-sys\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:19.967696 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.967577 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-podres\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:19.967696 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.967673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-lib-modules\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:19.967927 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.967707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s89nx\" (UniqueName: \"kubernetes.io/projected/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-kube-api-access-s89nx\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:19.967927 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:19.967732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-proc\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.068921 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.068877 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-sys\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.069095 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.068931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-podres\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.069095 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.068958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-lib-modules\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.069095 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.068975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s89nx\" (UniqueName: \"kubernetes.io/projected/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-kube-api-access-s89nx\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.069095 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.068998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-proc\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.069095 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.069008 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-sys\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.069256 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.069110 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-proc\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.069256 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.069120 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-lib-modules\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.069256 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.069121 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-podres\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.080116 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.080080 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89nx\" (UniqueName: \"kubernetes.io/projected/1ca8e3b5-f207-4708-a3cb-1de24291a3d4-kube-api-access-s89nx\") pod \"perf-node-gather-daemonset-ccvx4\" (UID: \"1ca8e3b5-f207-4708-a3cb-1de24291a3d4\") " pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.117446 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.117419 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-745877448f-46djl_17118c3d-09cf-472c-8244-d13feba039b7/console/0.log" Sep 16 16:01:20.256259 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.256173 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:20.527130 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:20.527084 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4"] Sep 16 16:01:20.529524 ip-10-0-129-216 kubenswrapper[2563]: W0916 16:01:20.529496 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1ca8e3b5_f207_4708_a3cb_1de24291a3d4.slice/crio-3fe0825865ecf6ccfb581f33523dbe047a718785a6db378489d9de4bee781362 WatchSource:0}: Error finding container 3fe0825865ecf6ccfb581f33523dbe047a718785a6db378489d9de4bee781362: Status 404 returned error can't find the container with id 3fe0825865ecf6ccfb581f33523dbe047a718785a6db378489d9de4bee781362 Sep 16 16:01:21.295109 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:21.295070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" event={"ID":"1ca8e3b5-f207-4708-a3cb-1de24291a3d4","Type":"ContainerStarted","Data":"9193a91c2cd307ffba3bda3bf1557ae40fe20065ab4fc847defec7c127045d36"} Sep 16 16:01:21.295496 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:21.295129 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" event={"ID":"1ca8e3b5-f207-4708-a3cb-1de24291a3d4","Type":"ContainerStarted","Data":"3fe0825865ecf6ccfb581f33523dbe047a718785a6db378489d9de4bee781362"} Sep 16 16:01:21.295496 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:21.295162 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:21.311233 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:21.311128 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" podStartSLOduration=2.3111111380000002 podStartE2EDuration="2.311111138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 16:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 16:01:21.310947159 +0000 UTC m=+682.230009940" watchObservedRunningTime="2026-09-16 16:01:21.311111138 +0000 UTC m=+682.230173897" Sep 16 16:01:21.737119 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:21.737092 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zdvpg_41934bfe-1e79-4bd8-a336-34526cf853ac/dns/0.log" Sep 16 16:01:21.763068 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:21.763014 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zdvpg_41934bfe-1e79-4bd8-a336-34526cf853ac/kube-rbac-proxy/0.log" Sep 16 16:01:21.846469 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:21.846443 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tp625_eb310b60-a1e1-4961-99a2-80ffefa53f86/dns-node-resolver/0.log" Sep 16 16:01:22.366709 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:22.366664 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vn6lj_eb1c4416-dc01-4dd8-b0a0-fc2338c092b1/node-ca/0.log" Sep 16 16:01:23.138509 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:23.138473 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55f5c59b94-th5kc_397cc5b9-30c9-40d4-b9b3-fc59294522ce/router/0.log" Sep 16 16:01:23.540981 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:23.540903 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hqwxt_e4fa5110-6b1f-4cbb-a228-3eef9fe6c420/serve-healthcheck-canary/0.log" Sep 16 16:01:24.129070 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:24.129040 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpngb_cfe8c9c3-8a48-4786-90be-665c877f7db0/kube-rbac-proxy/0.log" Sep 16 16:01:24.153817 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:24.153787 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpngb_cfe8c9c3-8a48-4786-90be-665c877f7db0/exporter/0.log" Sep 16 16:01:24.180235 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:24.180179 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpngb_cfe8c9c3-8a48-4786-90be-665c877f7db0/extractor/0.log" Sep 16 16:01:26.464778 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:26.464723 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-wqkzq_326eda80-b051-4c93-bb30-27af19cc8058/manager/0.log" Sep 16 16:01:27.310467 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:27.310440 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z4zqb/perf-node-gather-daemonset-ccvx4" Sep 16 16:01:32.506814 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:32.506785 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqtcs_9fed7df2-9d30-4bb7-b890-529b9ee797f1/kube-multus-additional-cni-plugins/0.log" Sep 16 16:01:32.542479 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:32.542403 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqtcs_9fed7df2-9d30-4bb7-b890-529b9ee797f1/egress-router-binary-copy/0.log" Sep 16 16:01:32.571516 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:32.571485 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqtcs_9fed7df2-9d30-4bb7-b890-529b9ee797f1/cni-plugins/0.log" Sep 16 16:01:32.608177 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:32.608147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqtcs_9fed7df2-9d30-4bb7-b890-529b9ee797f1/bond-cni-plugin/0.log" Sep 16 16:01:32.642631 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:32.642603 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqtcs_9fed7df2-9d30-4bb7-b890-529b9ee797f1/routeoverride-cni/0.log" Sep 16 16:01:32.674217 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:32.674190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqtcs_9fed7df2-9d30-4bb7-b890-529b9ee797f1/whereabouts-cni-bincopy/0.log" Sep 16 16:01:32.705695 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:32.705650 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jqtcs_9fed7df2-9d30-4bb7-b890-529b9ee797f1/whereabouts-cni/0.log" Sep 16 16:01:33.213388 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:33.213353 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mr5sk_416d8a9f-5cca-4b46-85eb-4a33707770ee/kube-multus/0.log" Sep 16 16:01:33.277850 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:33.277820 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6gqtz_b1294103-6ccc-4614-b660-9e52f39240ed/network-metrics-daemon/0.log" Sep 16 16:01:33.306893 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:33.306861 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6gqtz_b1294103-6ccc-4614-b660-9e52f39240ed/kube-rbac-proxy/0.log" Sep 16 16:01:34.489040 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:34.489003 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fg5cd_06466182-beca-4abd-b37e-c6e64b8a669a/ovn-controller/0.log" Sep 16 16:01:34.518092 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:34.518062 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fg5cd_06466182-beca-4abd-b37e-c6e64b8a669a/ovn-acl-logging/0.log" Sep 16 16:01:34.551838 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:34.551800 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fg5cd_06466182-beca-4abd-b37e-c6e64b8a669a/kube-rbac-proxy-node/0.log" Sep 16 16:01:34.580866 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:34.580835 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fg5cd_06466182-beca-4abd-b37e-c6e64b8a669a/kube-rbac-proxy-ovn-metrics/0.log" Sep 16 16:01:34.645469 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:34.645440 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fg5cd_06466182-beca-4abd-b37e-c6e64b8a669a/northd/0.log" Sep 16 16:01:34.714632 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:34.714605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fg5cd_06466182-beca-4abd-b37e-c6e64b8a669a/nbdb/0.log" Sep 16 16:01:34.752009 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:34.751932 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fg5cd_06466182-beca-4abd-b37e-c6e64b8a669a/sbdb/0.log" Sep 16 16:01:34.797447 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:34.797413 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fg5cd_06466182-beca-4abd-b37e-c6e64b8a669a/ovnkube-controller/0.log" Sep 16 16:01:36.218305 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:36.218276 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7g8v9_e9460ed2-7f64-4f4f-ba99-0f63b6a6d151/network-check-target-container/0.log" Sep 16 16:01:37.219594 ip-10-0-129-216 kubenswrapper[2563]: I0916 16:01:37.219563 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dttjc_5d8908e3-940b-413e-b4c8-d90b1e57ecc6/iptables-alerter/0.log"