Sep 18 21:48:50.915880 ip-10-0-129-249 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 21:48:50.915891 ip-10-0-129-249 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 21:48:50.915901 ip-10-0-129-249 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 21:48:50.916056 ip-10-0-129-249 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 21:49:01.048918 ip-10-0-129-249 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 21:49:01.048936 ip-10-0-129-249 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 13bf4a88f8cd4b54bf309aeaad5432dd -- Sep 18 21:50:45.727474 ip-10-0-129-249 systemd[1]: Starting Kubernetes Kubelet... Sep 18 21:50:49.173323 ip-10-0-129-249 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:50:49.173323 ip-10-0-129-249 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 21:50:49.173323 ip-10-0-129-249 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:50:49.173323 ip-10-0-129-249 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 21:50:49.173323 ip-10-0-129-249 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:50:49.174087 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.173398 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 21:50:49.177303 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177287 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:49.177303 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177302 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177305 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177309 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177313 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177316 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177319 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177321 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177324 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177327 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177330 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177333 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177335 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177339 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177342 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177345 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177347 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177350 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177353 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177355 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177358 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:49.177368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177361 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177364 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177367 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177372 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177377 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177381 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177385 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177388 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177390 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177393 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177396 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177399 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177402 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177405 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177408 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177411 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177414 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177417 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177419 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:49.177846 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177422 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177425 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177427 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177430 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177433 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177436 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177438 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177441 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177444 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177446 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177449 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177452 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177454 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177457 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177460 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177464 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177467 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177470 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177473 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177476 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:49.178372 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177478 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177481 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177484 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177487 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177489 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177492 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177495 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177498 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177500 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177503 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177506 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177509 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177512 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177515 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177517 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177520 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177523 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177526 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177528 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:49.178854 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177531 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177534 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177536 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177539 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177542 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177545 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177548 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177551 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177554 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177557 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177559 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177562 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177565 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177569 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177572 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177574 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177577 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177581 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177585 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.177588 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:49.179323 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178258 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178266 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178269 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178272 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178275 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178278 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178281 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178283 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178286 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178289 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178292 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178296 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178301 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178304 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178307 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178310 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178314 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178317 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178320 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:49.179797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178323 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178327 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178330 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178333 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178335 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178338 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178341 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178344 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178347 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178349 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178352 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178355 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178358 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178360 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178363 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178366 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178368 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178371 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178374 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178378 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:49.180283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178382 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178385 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178388 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178392 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178397 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178400 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178403 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178406 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178409 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178412 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178414 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178417 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178420 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178424 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178427 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178430 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178433 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178436 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178438 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:49.180816 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178441 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178444 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178447 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178450 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178452 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178455 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178458 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178460 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178463 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178466 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178468 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178471 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178474 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178477 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178479 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178482 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178485 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178488 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178490 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178493 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:49.181295 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178497 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178500 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178503 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178505 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178508 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178511 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178514 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178517 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178520 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178522 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178525 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178528 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178530 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178533 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178536 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178539 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178542 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178544 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178547 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178550 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:49.181778 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178553 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178892 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178897 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178900 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178904 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178912 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178915 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178918 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178921 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178923 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178926 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178929 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178932 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178935 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178938 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178940 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178943 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178946 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178948 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178951 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:49.182283 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178954 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178957 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178960 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178962 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178965 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178968 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178971 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178975 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178979 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178983 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178985 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178988 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178991 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178994 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178997 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.178999 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179002 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179006 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179010 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179012 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:49.182815 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179015 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179018 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179021 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179023 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179026 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179029 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179031 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179034 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179037 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179040 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179042 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179045 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179049 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179052 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179055 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179057 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179060 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179063 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179066 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179068 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:49.183327 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179071 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179074 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179076 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179079 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179082 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179084 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179087 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179090 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179092 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179096 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179099 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179102 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179106 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179109 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179112 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179115 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179118 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179121 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179124 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:49.183825 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179140 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179143 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179146 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179149 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179153 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179156 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179159 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179161 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179166 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179169 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179173 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179176 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179179 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179181 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179184 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179187 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179190 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179192 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179195 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:49.184301 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179197 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179200 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179270 2567 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179306 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179312 2567 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179317 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179324 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179328 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179333 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179337 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179341 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179344 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179348 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179351 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179355 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179358 2567 flags.go:64] FLAG: --cgroup-root="" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179361 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179365 2567 flags.go:64] FLAG: --client-ca-file="" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179368 2567 flags.go:64] FLAG: --cloud-provider="external" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179371 2567 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179375 2567 flags.go:64] FLAG: --cluster-domain="" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179379 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179382 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179385 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 21:50:49.184766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179389 2567 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179392 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179396 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179399 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179403 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179406 2567 flags.go:64] FLAG: --contention-profiling="false" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179409 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179412 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179416 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179419 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179423 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179427 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179430 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179433 2567 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179436 2567 flags.go:64] FLAG: --enable-server="true" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179440 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179444 2567 flags.go:64] FLAG: --event-burst="100" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179448 2567 flags.go:64] FLAG: --event-qps="50" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179450 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179454 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179457 2567 flags.go:64] FLAG: --eviction-hard="" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179460 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179463 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179466 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179469 2567 flags.go:64] FLAG: --eviction-soft="" Sep 18 21:50:49.185359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179474 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179477 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179480 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179483 2567 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179487 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179490 2567 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179493 2567 flags.go:64] FLAG: --feature-gates="" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179497 2567 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179500 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179503 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179506 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179509 2567 flags.go:64] FLAG: --healthz-port="10248" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179513 2567 flags.go:64] FLAG: --help="false" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179516 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179519 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179522 2567 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179525 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179529 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179533 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179536 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179539 2567 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179542 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179545 2567 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 21:50:49.185956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179549 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179552 2567 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179555 2567 flags.go:64] FLAG: --kube-reserved="" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179558 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179561 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179564 2567 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179567 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179570 2567 flags.go:64] FLAG: --lock-file="" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179573 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179577 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179581 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179587 2567 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179590 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179593 2567 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179596 2567 flags.go:64] FLAG: --logging-format="text" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179599 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179602 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179606 2567 flags.go:64] FLAG: --manifest-url="" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179609 2567 flags.go:64] FLAG: --manifest-url-header="" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179613 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179616 2567 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179620 2567 flags.go:64] FLAG: --max-pods="110" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179623 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179627 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179630 2567 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 21:50:49.186601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179633 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179637 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179640 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179643 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179650 2567 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179653 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179656 2567 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179659 2567 flags.go:64] FLAG: --pod-cidr="" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179663 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179668 2567 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179671 2567 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179675 2567 flags.go:64] FLAG: --pods-per-core="0" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179678 2567 flags.go:64] FLAG: --port="10250" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179681 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179684 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-060796098b89f5a89" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179688 2567 flags.go:64] FLAG: --qos-reserved="" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179693 2567 flags.go:64] FLAG: --read-only-port="10255" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179696 2567 flags.go:64] FLAG: --register-node="true" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179699 2567 flags.go:64] FLAG: --register-with-taints="" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179704 2567 flags.go:64] FLAG: --registry-burst="10" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179707 2567 flags.go:64] FLAG: --registry-qps="5" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179710 2567 flags.go:64] FLAG: --reserved-cpus="" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179713 2567 flags.go:64] FLAG: --reserved-memory="" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179716 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179720 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 21:50:49.187238 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179723 2567 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179727 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179730 2567 flags.go:64] FLAG: --runonce="false" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179733 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179736 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179740 2567 flags.go:64] FLAG: --seccomp-default="false" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179743 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179746 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179749 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179752 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179755 2567 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179758 2567 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179761 2567 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179764 2567 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179767 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179770 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179774 2567 flags.go:64] FLAG: --system-cgroups="" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179776 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179782 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179785 2567 flags.go:64] FLAG: --tls-cert-file="" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179788 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179792 2567 flags.go:64] FLAG: --tls-min-version="" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179795 2567 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179799 2567 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179802 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 21:50:49.187849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179805 2567 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179809 2567 flags.go:64] FLAG: --v="2" Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179813 2567 flags.go:64] FLAG: --version="false" Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179817 2567 flags.go:64] FLAG: --vmodule="" Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179820 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.179824 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179948 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179952 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179955 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179958 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179961 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179964 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179969 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179972 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179975 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179977 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179980 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179983 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179986 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179989 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179992 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:49.188477 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179995 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.179997 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180001 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180004 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180007 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180010 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180012 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180015 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180018 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180022 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180025 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180028 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180031 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180034 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180037 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180039 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180042 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180045 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180048 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180050 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:49.189026 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180053 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180058 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180061 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180066 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180070 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180074 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180078 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180081 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180084 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180087 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180090 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180094 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180097 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180100 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180103 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180106 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180110 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180113 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:49.189881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180116 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180119 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180121 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180139 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180142 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180145 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180147 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180150 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180153 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180156 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180159 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180162 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180165 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180167 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180170 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180174 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180176 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180180 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180183 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180186 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:49.190476 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180189 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180192 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180195 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180198 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180201 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180203 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180206 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180209 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180212 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180215 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180218 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180225 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180227 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180230 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180233 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180237 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180240 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180243 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180245 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180248 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:49.190960 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180251 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180254 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180256 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180259 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180262 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.180264 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.180270 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.187062 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.187078 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.187098 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.187105 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187187 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187193 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187197 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187202 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:49.191570 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187207 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187211 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187215 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187220 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187224 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187227 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187230 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187232 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187237 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187242 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187245 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187249 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187252 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187255 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187258 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187260 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187264 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187267 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187270 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187273 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:49.191946 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187276 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187280 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187283 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187286 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187289 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187294 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187297 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187300 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187303 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187306 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187308 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187311 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187314 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187316 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187319 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187322 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187325 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187329 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187333 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:49.192455 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187335 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187338 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187341 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187344 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187346 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187349 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187352 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187354 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187357 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187360 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187363 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187365 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187368 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187371 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187374 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187376 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187379 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187382 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187385 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187388 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:49.192934 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187391 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187394 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187396 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187399 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187402 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187405 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187408 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187411 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187413 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187416 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187419 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187421 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187424 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187427 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187430 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187433 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187435 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187438 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187441 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:49.193435 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187444 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187447 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187450 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187452 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187455 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187458 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187461 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187464 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187466 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187469 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187471 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187475 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187478 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187481 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187483 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187486 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:49.193922 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187489 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.187494 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187604 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187609 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187612 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187615 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187617 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187620 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187623 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187626 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187628 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187631 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187634 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187636 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187639 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:49.194335 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187642 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187645 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187648 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187650 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187653 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187656 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187659 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187661 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187664 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187667 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187669 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187672 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187675 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187678 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187680 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187683 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187686 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187689 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187692 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187695 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:49.194689 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187697 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187701 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187703 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187706 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187709 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187711 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187714 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187717 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187720 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187723 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187725 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187728 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187731 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187734 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187736 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187740 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187744 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187747 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187750 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:49.195186 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187753 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187755 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187758 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187761 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187764 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187767 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187769 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187772 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187775 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187778 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187781 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187783 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187786 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187789 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187792 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187794 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187797 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187799 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187802 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187805 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:49.195651 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187808 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187810 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187813 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187816 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187819 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187821 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187824 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187827 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187829 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187832 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187836 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187840 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187843 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187845 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187850 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187854 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187858 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187862 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187865 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187868 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:49.196191 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187872 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187874 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187882 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187885 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187887 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187890 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:49.187893 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.187898 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.188009 2567 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.191334 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.192490 2567 server.go:1019] "Starting client certificate rotation" Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.192586 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.192613 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 21:50:49.196712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.194758 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 21:50:49.197211 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.195995 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 21:50:49.199519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.199498 2567 log.go:25] "Validated CRI v1 runtime API" Sep 18 21:50:49.200950 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.200936 2567 log.go:25] "Validated CRI v1 image API" Sep 18 21:50:49.201858 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.201838 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 21:50:49.203992 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.203970 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b68196bf-6986-4d28-adc5-de057e3697c1:/dev/nvme0n1p4 fba2bea1-bbbc-4323-8e2e-5966bf84cd81:/dev/nvme0n1p3] Sep 18 21:50:49.204073 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.203989 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 21:50:49.208213 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.208071 2567 manager.go:216] Machine: {Timestamp:2026-09-18 21:50:49.207619789 +0000 UTC m=+1.910185144 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104133 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29c0f0428fddc555c3a8845d825838 SystemUUID:ec29c0f0-428f-ddc5-55c3-a8845d825838 BootID:13bf4a88-f8cd-4b54-bf30-9aeaad5432dd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e0:9b:b1:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e0:9b:b1:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:eb:ac:d3:7c:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 21:50:49.208213 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.208205 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 21:50:49.208368 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.208330 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 21:50:49.209779 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.209757 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 21:50:49.209920 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.209781 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 21:50:49.210895 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.210883 2567 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 21:50:49.210932 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.210897 2567 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 21:50:49.210932 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.210906 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 21:50:49.210932 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.210916 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 21:50:49.211898 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.211889 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 21:50:49.215255 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215244 2567 state_mem.go:36] "Initialized new in-memory state store" Sep 18 21:50:49.215361 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215352 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 21:50:49.215396 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215383 2567 kubelet.go:486] "Attempting to sync node with API server" Sep 18 21:50:49.215396 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215395 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 21:50:49.215463 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215408 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 21:50:49.215463 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215422 2567 kubelet.go:398] "Adding apiserver pod source" Sep 18 21:50:49.215463 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215431 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 21:50:49.215768 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215754 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 21:50:49.215819 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.215785 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 21:50:49.226281 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.226255 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 21:50:49.228086 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.228065 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 21:50:49.228165 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.228107 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 21:50:49.228302 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.228288 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 21:50:49.228345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.228325 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 21:50:49.229270 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229251 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 21:50:49.229270 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229267 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229286 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229295 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229302 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229311 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229317 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229330 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229337 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229345 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 21:50:49.229351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229353 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 21:50:49.229602 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229363 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 21:50:49.229602 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229368 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 21:50:49.229602 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229393 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 21:50:49.229602 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.229398 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 21:50:49.233303 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.233289 2567 server.go:1268] "Started kubelet" Sep 18 21:50:49.233400 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.233325 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 21:50:49.233460 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.233397 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 21:50:49.233518 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.233463 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 21:50:49.233772 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.233757 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 21:50:49.234061 ip-10-0-129-249 systemd[1]: Started Kubernetes Kubelet. Sep 18 21:50:49.234810 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.234726 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 21:50:49.234957 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.234939 2567 server.go:310] "Adding debug handlers to kubelet server" Sep 18 21:50:49.238032 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.238005 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 21:50:49.240115 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.240099 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 21:50:49.240186 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.240113 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 21:50:49.240431 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.240404 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:49.240822 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.240809 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 21:50:49.240914 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.240885 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 21:50:49.240978 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.240963 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 21:50:49.241085 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241080 2567 reconstruct.go:97] "Volume reconstruction finished" Sep 18 21:50:49.241085 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241086 2567 reconciler.go:29] "Reconciler: start to sync state" Sep 18 21:50:49.241216 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241146 2567 factory.go:55] Registering systemd factory Sep 18 21:50:49.241216 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241158 2567 factory.go:223] Registration of the systemd container factory successfully Sep 18 21:50:49.241444 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241434 2567 factory.go:153] Registering CRI-O factory Sep 18 21:50:49.241444 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241445 2567 factory.go:223] Registration of the crio container factory successfully Sep 18 21:50:49.241519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241484 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 21:50:49.241519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241497 2567 factory.go:103] Registering Raw factory Sep 18 21:50:49.241519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.241507 2567 manager.go:1196] Started watching for new ooms in manager Sep 18 21:50:49.242228 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.242217 2567 manager.go:349] Starting recovery of all containers Sep 18 21:50:49.245408 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.245383 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 21:50:49.245408 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.245397 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 21:50:49.247915 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.247892 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pbh9g" Sep 18 21:50:49.263145 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.263106 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pbh9g" Sep 18 21:50:49.265986 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.265967 2567 manager.go:354] Recovery completed Sep 18 21:50:49.271029 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.270064 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-249.ec2.internal.18d688bd75cf53f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-249.ec2.internal,UID:ip-10-0-129-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-249.ec2.internal,},FirstTimestamp:2026-09-18 21:50:49.233069043 +0000 UTC m=+1.935634397,LastTimestamp:2026-09-18 21:50:49.233069043 +0000 UTC m=+1.935634397,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-249.ec2.internal,}" Sep 18 21:50:49.271522 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.271510 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:49.273407 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.273392 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:49.273467 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.273418 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:49.273467 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.273427 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:49.273902 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.273887 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 21:50:49.273902 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.273901 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 21:50:49.273995 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.273921 2567 state_mem.go:36] "Initialized new in-memory state store" Sep 18 21:50:49.273995 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.273901 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:49.274596 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.274582 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:49.274652 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.274607 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:49.274652 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.274620 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:49.275898 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.275886 2567 policy_none.go:49] "None policy: Start" Sep 18 21:50:49.275942 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.275903 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 21:50:49.275942 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.275914 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 21:50:49.277871 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.277859 2567 policy_none.go:47] "Start" Sep 18 21:50:49.312692 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.312673 2567 manager.go:337] "Starting Device Plugin manager" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.312741 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.312755 2567 server.go:87] "Starting device plugin registration server" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.312971 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.313006 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.313089 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.313181 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.313191 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.313671 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 21:50:49.332578 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.313718 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:49.387115 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.387083 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 21:50:49.388158 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.388141 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 21:50:49.388225 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.388181 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 21:50:49.388225 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.388201 2567 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 21:50:49.388300 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.388243 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 21:50:49.390378 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.390363 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:49.413245 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.413215 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:49.413976 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.413961 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:49.414028 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.413988 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:49.414028 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.413999 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:49.414028 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.414018 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.422088 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.422074 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.422157 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.422094 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-249.ec2.internal\": node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:49.447479 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.447420 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:49.488511 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.488492 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal"] Sep 18 21:50:49.488577 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.488547 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:49.489291 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.489271 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:49.489373 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.489299 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:49.489373 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.489313 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:49.491497 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.491485 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:49.491616 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.491603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.491656 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.491629 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:49.492213 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.492200 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:49.492270 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.492205 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:49.492270 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.492259 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:49.492339 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.492272 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:49.492339 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.492227 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:49.492339 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.492301 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:49.494419 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.494403 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.494472 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.494437 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:49.495100 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.495084 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:49.495195 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.495104 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:49.495195 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.495119 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:49.515706 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.515684 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-249.ec2.internal\" not found" node="ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.519714 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.519700 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-249.ec2.internal\" not found" node="ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.543779 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.543759 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d0f63af6811757e41a790f4604e9861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal\" (UID: \"2d0f63af6811757e41a790f4604e9861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.543838 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.543784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0f63af6811757e41a790f4604e9861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal\" (UID: \"2d0f63af6811757e41a790f4604e9861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.543838 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.543798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb0775bf473807b2efdbafa25f20da9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-249.ec2.internal\" (UID: \"beb0775bf473807b2efdbafa25f20da9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.548445 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.548431 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:49.644673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.644652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d0f63af6811757e41a790f4604e9861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal\" (UID: \"2d0f63af6811757e41a790f4604e9861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.644737 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.644676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0f63af6811757e41a790f4604e9861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal\" (UID: \"2d0f63af6811757e41a790f4604e9861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.644737 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.644690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb0775bf473807b2efdbafa25f20da9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-249.ec2.internal\" (UID: \"beb0775bf473807b2efdbafa25f20da9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.644737 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.644719 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb0775bf473807b2efdbafa25f20da9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-249.ec2.internal\" (UID: \"beb0775bf473807b2efdbafa25f20da9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.644847 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.644738 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d0f63af6811757e41a790f4604e9861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal\" (UID: \"2d0f63af6811757e41a790f4604e9861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.644847 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.644751 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0f63af6811757e41a790f4604e9861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal\" (UID: \"2d0f63af6811757e41a790f4604e9861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.648771 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.648756 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:49.749465 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.749423 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:49.821630 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.821599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.822698 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:49.822684 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" Sep 18 21:50:49.850396 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.850370 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:49.950945 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:49.950914 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:50.051399 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.051348 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-249.ec2.internal\" not found" Sep 18 21:50:50.113423 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.113405 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:50.140646 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.140622 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" Sep 18 21:50:50.152937 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.152921 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 21:50:50.154294 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.154279 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" Sep 18 21:50:50.166262 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.166245 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 21:50:50.192405 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.192388 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 21:50:50.192790 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.192515 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 21:50:50.192790 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.192560 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 21:50:50.215620 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.215601 2567 apiserver.go:52] "Watching apiserver" Sep 18 21:50:50.236521 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.236362 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 21:50:50.236737 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.236718 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-48g9m","openshift-ovn-kubernetes/ovnkube-node-6wlv2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn","openshift-dns/node-resolver-jljlf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal","openshift-multus/multus-additional-cni-plugins-dshmg","openshift-multus/multus-f6k4r","openshift-multus/network-metrics-daemon-zmxqf","openshift-network-diagnostics/network-check-target-rv7js","openshift-network-operator/iptables-alerter-mz6wf","kube-system/global-pull-secret-syncer-6wvwr","kube-system/konnectivity-agent-zv7xs","kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hlfnz"] Sep 18 21:50:50.239086 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.239067 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.240418 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.240399 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 21:50:50.241226 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.241211 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:50.241300 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.241264 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:50:50.242147 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.241773 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 21:50:50.242147 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.242041 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 21:50:50.242147 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.242083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6bvxx\"" Sep 18 21:50:50.242147 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.242086 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 21:50:50.242493 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.242476 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 21:50:50.243656 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.243636 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.245956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.245934 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.247100 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.247081 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hm26x\"" Sep 18 21:50:50.247240 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.247102 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 21:50:50.247240 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.247106 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 21:50:50.247355 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.247257 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 21:50:50.248353 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-system-cni-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248469 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-cnibin\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248469 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-cni-multus\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248469 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248390 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-daemon-config\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248469 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-multus-certs\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248469 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9ljz\" (UniqueName: \"kubernetes.io/projected/87fb5366-a15a-419e-a7aa-0021e94f4ce9-kube-api-access-f9ljz\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248469 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248455 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-hostroot\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-etc-kubernetes\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-socket-dir-parent\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-k8s-cni-cncf-io\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-netns\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-cni-bin\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h42jx\" (UniqueName: \"kubernetes.io/projected/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-kube-api-access-h42jx\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248651 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-cni-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248664 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87fb5366-a15a-419e-a7aa-0021e94f4ce9-cni-binary-copy\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248675 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-kubelet\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.248706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248710 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-conf-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.249211 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.248745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.249211 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.249056 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 21:50:50.249312 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.249284 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tcstv\"" Sep 18 21:50:50.251317 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.251296 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 21:50:50.251457 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.251424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.251556 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.251516 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 21:50:50.251973 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.251954 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 21:50:50.252477 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.252463 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-scr5g\"" Sep 18 21:50:50.254060 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.254035 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 21:50:50.254174 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.254158 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:50.254272 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.254236 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:50:50.254321 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.254301 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nhk9k\"" Sep 18 21:50:50.254432 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.254396 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 21:50:50.254519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.254504 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 21:50:50.256699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.256684 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.259374 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.259357 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.259467 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.259449 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:50:50.259521 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.259481 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q2gsv\"" Sep 18 21:50:50.260072 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.260057 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 21:50:50.261938 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.261923 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.262487 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.262469 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-prrr8\"" Sep 18 21:50:50.262572 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.262516 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 21:50:50.262572 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.262562 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 21:50:50.262752 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.262738 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 21:50:50.262864 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.262851 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 21:50:50.263144 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.263116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 21:50:50.263224 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.263159 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 21:50:50.264600 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.264579 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.264678 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.264628 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:50:50.266017 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.266001 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:50:50.266085 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.266015 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 21:50:50.266118 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.266091 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 21:50:50.266447 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.266430 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-78br8\"" Sep 18 21:50:50.267333 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.267315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:50:50.270467 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.270434 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 21:45:49 +0000 UTC" deadline="2028-03-12 18:44:22.32343721 +0000 UTC" Sep 18 21:50:50.270467 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.270464 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12980h53m32.052976963s" Sep 18 21:50:50.270858 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.270842 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2qc9t\"" Sep 18 21:50:50.271280 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.271266 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 21:50:50.271492 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.271479 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 21:50:50.283157 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.283125 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zrpj6" Sep 18 21:50:50.292024 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.292010 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zrpj6" Sep 18 21:50:50.316585 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.314854 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:50.342117 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.342097 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 21:50:50.349828 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.349805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-modprobe-d\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.349943 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.349832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysctl-conf\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.349943 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.349849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-cni-netd\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.349943 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.349866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5zxm\" (UniqueName: \"kubernetes.io/projected/12d97d79-cce7-4ea4-8a28-b5b063c38de4-kube-api-access-s5zxm\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.349943 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.349895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-etc-kubernetes\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.349943 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.349920 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.349958 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-etc-kubernetes\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.349971 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74nvc\" (UniqueName: \"kubernetes.io/projected/773ea4a7-48e7-4058-b069-410810a4612a-kube-api-access-74nvc\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-run-netns\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-node-log\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350056 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-dbus\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-socket-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-registration-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-k8s-cni-cncf-io\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7cmx\" (UniqueName: \"kubernetes.io/projected/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-kube-api-access-t7cmx\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.350212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350196 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bbc25d9-a502-4422-a9e7-65be602585e9-serviceca\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-cni-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/124f4987-4985-4cf1-8be9-b086f66d755f-host-slash\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350246 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-k8s-cni-cncf-io\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350292 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-slash\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-var-lib-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovnkube-config\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-system-cni-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350394 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-cni-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350408 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-system-cni-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cnibin\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350500 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysconfig\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9sc\" (UniqueName: \"kubernetes.io/projected/f58cd2af-9385-476b-ac3d-53a5a14a384b-kube-api-access-4n9sc\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.350615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350600 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bbc25d9-a502-4422-a9e7-65be602585e9-host\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-hostroot\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-kubernetes\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysctl-d\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350686 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-hostroot\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350708 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/773ea4a7-48e7-4058-b069-410810a4612a-etc-tuned\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350734 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-kubelet-config\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcfxl\" (UniqueName: \"kubernetes.io/projected/5bbc25d9-a502-4422-a9e7-65be602585e9-kube-api-access-kcfxl\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-log-socket\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-cni-bin\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovnkube-script-lib\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f164b2da-3aca-442e-be9c-0d900172e351-konnectivity-ca\") pod \"konnectivity-agent-zv7xs\" (UID: \"f164b2da-3aca-442e-be9c-0d900172e351\") " pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-kubelet\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-sys\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350979 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-kubelet\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.350983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-ovn\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f164b2da-3aca-442e-be9c-0d900172e351-agent-certs\") pod \"konnectivity-agent-zv7xs\" (UID: \"f164b2da-3aca-442e-be9c-0d900172e351\") " pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:50:50.351194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e10c295-0617-4e38-b7c8-9c47cd1f651d-hosts-file\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-cnibin\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-systemd\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351210 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-cnibin\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-kubelet\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-systemd-units\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-socket-dir-parent\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-netns\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351403 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-netns\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-cni-bin\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351439 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-socket-dir-parent\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-run\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-lib-modules\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351492 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-cni-bin\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-host\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.351939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h42jx\" (UniqueName: \"kubernetes.io/projected/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-kube-api-access-h42jx\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/124f4987-4985-4cf1-8be9-b086f66d755f-iptables-alerter-script\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351598 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-var-lib-kubelet\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovn-node-metrics-cert\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351646 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-multus-certs\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/773ea4a7-48e7-4058-b069-410810a4612a-tmp\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351699 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-run-multus-certs\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351712 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-etc-selinux\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjwk\" (UniqueName: \"kubernetes.io/projected/4e10c295-0617-4e38-b7c8-9c47cd1f651d-kube-api-access-zcjwk\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351777 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351829 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-sys-fs\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-etc-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.352558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-env-overrides\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-systemd\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbgks\" (UniqueName: \"kubernetes.io/projected/124f4987-4985-4cf1-8be9-b086f66d755f-kube-api-access-gbgks\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351927 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87fb5366-a15a-419e-a7aa-0021e94f4ce9-cni-binary-copy\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.351972 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-conf-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-daemon-config\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.352078 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352078 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-conf-dir\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-device-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.352193 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:50.852172206 +0000 UTC m=+3.554737558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352223 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e10c295-0617-4e38-b7c8-9c47cd1f651d-tmp-dir\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352248 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-cni-multus\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9ljz\" (UniqueName: \"kubernetes.io/projected/87fb5366-a15a-419e-a7aa-0021e94f4ce9-kube-api-access-f9ljz\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352317 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87fb5366-a15a-419e-a7aa-0021e94f4ce9-host-var-lib-cni-multus\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.353007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352375 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87fb5366-a15a-419e-a7aa-0021e94f4ce9-cni-binary-copy\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.353522 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.352490 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87fb5366-a15a-419e-a7aa-0021e94f4ce9-multus-daemon-config\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.357983 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.357961 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 21:50:50.361092 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.361073 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h42jx\" (UniqueName: \"kubernetes.io/projected/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-kube-api-access-h42jx\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:50.361226 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.361208 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9ljz\" (UniqueName: \"kubernetes.io/projected/87fb5366-a15a-419e-a7aa-0021e94f4ce9-kube-api-access-f9ljz\") pod \"multus-f6k4r\" (UID: \"87fb5366-a15a-419e-a7aa-0021e94f4ce9\") " pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.453256 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-systemd\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453347 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-kubelet\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.453347 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-systemd-units\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.453347 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-run\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453347 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-lib-modules\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453347 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453341 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-host\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453347 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453341 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-systemd\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453352 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-kubelet\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453356 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-systemd-units\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/124f4987-4985-4cf1-8be9-b086f66d755f-iptables-alerter-script\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453400 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-host\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453400 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-run\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453423 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-var-lib-kubelet\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovn-node-metrics-cert\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/773ea4a7-48e7-4058-b069-410810a4612a-tmp\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453513 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453512 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-lib-modules\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453532 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-var-lib-kubelet\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-etc-selinux\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453560 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjwk\" (UniqueName: \"kubernetes.io/projected/4e10c295-0617-4e38-b7c8-9c47cd1f651d-kube-api-access-zcjwk\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453572 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.453618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453606 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453616 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-etc-selinux\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453631 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-sys-fs\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453700 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-etc-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-env-overrides\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-systemd\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.453790 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453798 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-etc-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbgks\" (UniqueName: \"kubernetes.io/projected/124f4987-4985-4cf1-8be9-b086f66d755f-kube-api-access-gbgks\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.453866 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret podName:221a8ad9-e6c6-4986-bf4a-cdd50bad02f8 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:50.95384883 +0000 UTC m=+3.656414175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret") pod "global-pull-secret-syncer-6wvwr" (UID: "221a8ad9-e6c6-4986-bf4a-cdd50bad02f8") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453869 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-sys-fs\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-device-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453900 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-systemd\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.454345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453921 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/124f4987-4985-4cf1-8be9-b086f66d755f-iptables-alerter-script\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e10c295-0617-4e38-b7c8-9c47cd1f651d-tmp-dir\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453969 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-modprobe-d\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453985 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-device-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysctl-conf\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-cni-netd\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.453862 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454124 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5zxm\" (UniqueName: \"kubernetes.io/projected/12d97d79-cce7-4ea4-8a28-b5b063c38de4-kube-api-access-s5zxm\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454302 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e10c295-0617-4e38-b7c8-9c47cd1f651d-tmp-dir\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454570 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-env-overrides\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454620 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454638 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-cni-netd\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74nvc\" (UniqueName: \"kubernetes.io/projected/773ea4a7-48e7-4058-b069-410810a4612a-kube-api-access-74nvc\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-run-netns\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-node-log\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454730 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysctl-conf\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.455124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454767 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-node-log\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-dbus\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454801 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-run-netns\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454842 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-socket-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-registration-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454911 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-dbus\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454950 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-modprobe-d\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454961 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-registration-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.454992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7cmx\" (UniqueName: \"kubernetes.io/projected/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-kube-api-access-t7cmx\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455028 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-socket-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455024 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bbc25d9-a502-4422-a9e7-65be602585e9-serviceca\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/124f4987-4985-4cf1-8be9-b086f66d755f-host-slash\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455085 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455119 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-slash\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455159 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/124f4987-4985-4cf1-8be9-b086f66d755f-host-slash\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455168 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-slash\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.455936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-var-lib-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455192 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-var-lib-openvswitch\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovnkube-config\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cnibin\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455267 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysconfig\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455313 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-cnibin\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9sc\" (UniqueName: \"kubernetes.io/projected/f58cd2af-9385-476b-ac3d-53a5a14a384b-kube-api-access-4n9sc\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bbc25d9-a502-4422-a9e7-65be602585e9-host\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455369 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysconfig\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455385 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-kubernetes\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455439 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bbc25d9-a502-4422-a9e7-65be602585e9-host\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455440 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bbc25d9-a502-4422-a9e7-65be602585e9-serviceca\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455463 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysctl-d\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/773ea4a7-48e7-4058-b069-410810a4612a-etc-tuned\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-kubelet-config\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcfxl\" (UniqueName: \"kubernetes.io/projected/5bbc25d9-a502-4422-a9e7-65be602585e9-kube-api-access-kcfxl\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.456673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-log-socket\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455578 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-kubernetes\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-cni-bin\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovnkube-script-lib\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f164b2da-3aca-442e-be9c-0d900172e351-konnectivity-ca\") pod \"konnectivity-agent-zv7xs\" (UID: \"f164b2da-3aca-442e-be9c-0d900172e351\") " pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-sys\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-ovn\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455716 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-kubelet-config\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f164b2da-3aca-442e-be9c-0d900172e351-agent-certs\") pod \"konnectivity-agent-zv7xs\" (UID: \"f164b2da-3aca-442e-be9c-0d900172e351\") " pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e10c295-0617-4e38-b7c8-9c47cd1f651d-hosts-file\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455784 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455836 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-host-cni-bin\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455849 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-run-ovn\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455890 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455907 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-sys\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455674 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovnkube-config\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.457388 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455841 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f58cd2af-9385-476b-ac3d-53a5a14a384b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455953 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/773ea4a7-48e7-4058-b069-410810a4612a-etc-sysctl-d\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.455995 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12d97d79-cce7-4ea4-8a28-b5b063c38de4-log-socket\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.456030 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-system-cni-dir\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.456018 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e10c295-0617-4e38-b7c8-9c47cd1f651d-hosts-file\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.456215 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovn-node-metrics-cert\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.456266 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f164b2da-3aca-442e-be9c-0d900172e351-konnectivity-ca\") pod \"konnectivity-agent-zv7xs\" (UID: \"f164b2da-3aca-442e-be9c-0d900172e351\") " pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.456399 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/773ea4a7-48e7-4058-b069-410810a4612a-tmp\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.456495 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12d97d79-cce7-4ea4-8a28-b5b063c38de4-ovnkube-script-lib\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.458165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.457675 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/773ea4a7-48e7-4058-b069-410810a4612a-etc-tuned\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.458535 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.458360 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f164b2da-3aca-442e-be9c-0d900172e351-agent-certs\") pod \"konnectivity-agent-zv7xs\" (UID: \"f164b2da-3aca-442e-be9c-0d900172e351\") " pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:50:50.464420 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.464388 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb0775bf473807b2efdbafa25f20da9.slice/crio-63b0cfc01ed65f85fdbde5a2a5cf8ec059fa828f8c8c59a911b19597d0ea2599 WatchSource:0}: Error finding container 63b0cfc01ed65f85fdbde5a2a5cf8ec059fa828f8c8c59a911b19597d0ea2599: Status 404 returned error can't find the container with id 63b0cfc01ed65f85fdbde5a2a5cf8ec059fa828f8c8c59a911b19597d0ea2599 Sep 18 21:50:50.464797 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.464774 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0f63af6811757e41a790f4604e9861.slice/crio-361bc6eb41fbd79116d5892b73507d573f0ee517369dcd894cc92ed2ffed603f WatchSource:0}: Error finding container 361bc6eb41fbd79116d5892b73507d573f0ee517369dcd894cc92ed2ffed603f: Status 404 returned error can't find the container with id 361bc6eb41fbd79116d5892b73507d573f0ee517369dcd894cc92ed2ffed603f Sep 18 21:50:50.466285 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.466266 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcfxl\" (UniqueName: \"kubernetes.io/projected/5bbc25d9-a502-4422-a9e7-65be602585e9-kube-api-access-kcfxl\") pod \"node-ca-48g9m\" (UID: \"5bbc25d9-a502-4422-a9e7-65be602585e9\") " pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.466745 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.466446 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:50.466745 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.466470 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:50.466745 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.466483 2567 projected.go:196] Error preparing data for projected volume kube-api-access-f4jhc for pod openshift-network-diagnostics/network-check-target-rv7js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:50.466745 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.466548 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc podName:e1c73eff-6805-4948-8f4a-a517cdb0f814 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:50.966530875 +0000 UTC m=+3.669096234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f4jhc" (UniqueName: "kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc") pod "network-check-target-rv7js" (UID: "e1c73eff-6805-4948-8f4a-a517cdb0f814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:50.466745 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.466676 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9sc\" (UniqueName: \"kubernetes.io/projected/f58cd2af-9385-476b-ac3d-53a5a14a384b-kube-api-access-4n9sc\") pod \"aws-ebs-csi-driver-node-6lktn\" (UID: \"f58cd2af-9385-476b-ac3d-53a5a14a384b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.467085 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.467062 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7cmx\" (UniqueName: \"kubernetes.io/projected/30d234e5-9e6e-4ef4-b7d8-bfee22756fbd-kube-api-access-t7cmx\") pod \"multus-additional-cni-plugins-dshmg\" (UID: \"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd\") " pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.467166 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.467122 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74nvc\" (UniqueName: \"kubernetes.io/projected/773ea4a7-48e7-4058-b069-410810a4612a-kube-api-access-74nvc\") pod \"tuned-hlfnz\" (UID: \"773ea4a7-48e7-4058-b069-410810a4612a\") " pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.468339 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.468314 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbgks\" (UniqueName: \"kubernetes.io/projected/124f4987-4985-4cf1-8be9-b086f66d755f-kube-api-access-gbgks\") pod \"iptables-alerter-mz6wf\" (UID: \"124f4987-4985-4cf1-8be9-b086f66d755f\") " pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.468561 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.468517 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjwk\" (UniqueName: \"kubernetes.io/projected/4e10c295-0617-4e38-b7c8-9c47cd1f651d-kube-api-access-zcjwk\") pod \"node-resolver-jljlf\" (UID: \"4e10c295-0617-4e38-b7c8-9c47cd1f651d\") " pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.469155 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.469122 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5zxm\" (UniqueName: \"kubernetes.io/projected/12d97d79-cce7-4ea4-8a28-b5b063c38de4-kube-api-access-s5zxm\") pod \"ovnkube-node-6wlv2\" (UID: \"12d97d79-cce7-4ea4-8a28-b5b063c38de4\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.469964 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.469947 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 21:50:50.571813 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.571723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f6k4r" Sep 18 21:50:50.575752 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.575727 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" Sep 18 21:50:50.577810 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.577787 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:50.584069 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.584048 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58cd2af_9385_476b_ac3d_53a5a14a384b.slice/crio-47d77a9a83c3f60da93e1a8b33c150b919581e368cb54e90f30c1a1c3fe4e7d5 WatchSource:0}: Error finding container 47d77a9a83c3f60da93e1a8b33c150b919581e368cb54e90f30c1a1c3fe4e7d5: Status 404 returned error can't find the container with id 47d77a9a83c3f60da93e1a8b33c150b919581e368cb54e90f30c1a1c3fe4e7d5 Sep 18 21:50:50.612946 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.612926 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jljlf" Sep 18 21:50:50.622505 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.622485 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e10c295_0617_4e38_b7c8_9c47cd1f651d.slice/crio-a37f542dae52db18cb251bf53f2e6c78a5a0444ac90fce59e3e38327ffc0c0da WatchSource:0}: Error finding container a37f542dae52db18cb251bf53f2e6c78a5a0444ac90fce59e3e38327ffc0c0da: Status 404 returned error can't find the container with id a37f542dae52db18cb251bf53f2e6c78a5a0444ac90fce59e3e38327ffc0c0da Sep 18 21:50:50.628347 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.628332 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-48g9m" Sep 18 21:50:50.636343 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.636326 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbc25d9_a502_4422_a9e7_65be602585e9.slice/crio-7b32a3ab64923be8de5b31f1bd3ee3b16e7267ac02c0eb6723e493887a8e43f7 WatchSource:0}: Error finding container 7b32a3ab64923be8de5b31f1bd3ee3b16e7267ac02c0eb6723e493887a8e43f7: Status 404 returned error can't find the container with id 7b32a3ab64923be8de5b31f1bd3ee3b16e7267ac02c0eb6723e493887a8e43f7 Sep 18 21:50:50.648656 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.648635 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dshmg" Sep 18 21:50:50.657291 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.657273 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d234e5_9e6e_4ef4_b7d8_bfee22756fbd.slice/crio-4e4152024985342207ad2479279cd4986c99254fe4985784f8f872cb208402df WatchSource:0}: Error finding container 4e4152024985342207ad2479279cd4986c99254fe4985784f8f872cb208402df: Status 404 returned error can't find the container with id 4e4152024985342207ad2479279cd4986c99254fe4985784f8f872cb208402df Sep 18 21:50:50.672597 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.672581 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" Sep 18 21:50:50.678295 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.678279 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:50:50.679410 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.679391 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773ea4a7_48e7_4058_b069_410810a4612a.slice/crio-af9ecef97e3b548439c80ea97984cd3c9367d354f0d00041c86c176a4fbccdb6 WatchSource:0}: Error finding container af9ecef97e3b548439c80ea97984cd3c9367d354f0d00041c86c176a4fbccdb6: Status 404 returned error can't find the container with id af9ecef97e3b548439c80ea97984cd3c9367d354f0d00041c86c176a4fbccdb6 Sep 18 21:50:50.685716 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.685683 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d97d79_cce7_4ea4_8a28_b5b063c38de4.slice/crio-1232881c02c75f376d9bea71a21bd14ef072456324609cd72f36d1f31df83729 WatchSource:0}: Error finding container 1232881c02c75f376d9bea71a21bd14ef072456324609cd72f36d1f31df83729: Status 404 returned error can't find the container with id 1232881c02c75f376d9bea71a21bd14ef072456324609cd72f36d1f31df83729 Sep 18 21:50:50.694757 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.694743 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mz6wf" Sep 18 21:50:50.699317 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.699301 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:50:50.703052 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.703029 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124f4987_4985_4cf1_8be9_b086f66d755f.slice/crio-a54d38db992789ea1a94f5b743a284babe6a9e3031943f52901b023f158ef2c6 WatchSource:0}: Error finding container a54d38db992789ea1a94f5b743a284babe6a9e3031943f52901b023f158ef2c6: Status 404 returned error can't find the container with id a54d38db992789ea1a94f5b743a284babe6a9e3031943f52901b023f158ef2c6 Sep 18 21:50:50.707799 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:50:50.707778 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf164b2da_3aca_442e_be9c_0d900172e351.slice/crio-22d455b1a85a47eb1dfd0c3adc12427ccd83031e8e5f8fb4c56d42acdbb25c2c WatchSource:0}: Error finding container 22d455b1a85a47eb1dfd0c3adc12427ccd83031e8e5f8fb4c56d42acdbb25c2c: Status 404 returned error can't find the container with id 22d455b1a85a47eb1dfd0c3adc12427ccd83031e8e5f8fb4c56d42acdbb25c2c Sep 18 21:50:50.859416 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.859350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:50.859513 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.859473 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:50.859565 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.859526 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:51.859512572 +0000 UTC m=+4.562077931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:50.960086 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:50.960051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:50.960253 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.960204 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:50.960314 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:50.960268 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret podName:221a8ad9-e6c6-4986-bf4a-cdd50bad02f8 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:51.960251142 +0000 UTC m=+4.662816500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret") pod "global-pull-secret-syncer-6wvwr" (UID: "221a8ad9-e6c6-4986-bf4a-cdd50bad02f8") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:51.061505 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.060877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:51.061505 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:51.061060 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:51.061505 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:51.061084 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:51.061505 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:51.061097 2567 projected.go:196] Error preparing data for projected volume kube-api-access-f4jhc for pod openshift-network-diagnostics/network-check-target-rv7js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:51.061505 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:51.061169 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc podName:e1c73eff-6805-4948-8f4a-a517cdb0f814 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:52.061150632 +0000 UTC m=+4.763715981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4jhc" (UniqueName: "kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc") pod "network-check-target-rv7js" (UID: "e1c73eff-6805-4948-8f4a-a517cdb0f814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:51.294596 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.294440 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:45:50 +0000 UTC" deadline="2028-03-08 10:37:58.155087612 +0000 UTC" Sep 18 21:50:51.294596 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.294498 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12876h47m6.860594082s" Sep 18 21:50:51.309646 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.309619 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:51.411448 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.411345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zv7xs" event={"ID":"f164b2da-3aca-442e-be9c-0d900172e351","Type":"ContainerStarted","Data":"22d455b1a85a47eb1dfd0c3adc12427ccd83031e8e5f8fb4c56d42acdbb25c2c"} Sep 18 21:50:51.421800 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.421766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mz6wf" event={"ID":"124f4987-4985-4cf1-8be9-b086f66d755f","Type":"ContainerStarted","Data":"a54d38db992789ea1a94f5b743a284babe6a9e3031943f52901b023f158ef2c6"} Sep 18 21:50:51.436009 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.435943 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jljlf" event={"ID":"4e10c295-0617-4e38-b7c8-9c47cd1f651d","Type":"ContainerStarted","Data":"a37f542dae52db18cb251bf53f2e6c78a5a0444ac90fce59e3e38327ffc0c0da"} Sep 18 21:50:51.454159 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.454076 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f6k4r" event={"ID":"87fb5366-a15a-419e-a7aa-0021e94f4ce9","Type":"ContainerStarted","Data":"e8e02cb6526d11eaeb0844e14e381fed64392bc00716da60e1a46401b89c1773"} Sep 18 21:50:51.465927 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.465835 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" event={"ID":"beb0775bf473807b2efdbafa25f20da9","Type":"ContainerStarted","Data":"63b0cfc01ed65f85fdbde5a2a5cf8ec059fa828f8c8c59a911b19597d0ea2599"} Sep 18 21:50:51.480548 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.480518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"1232881c02c75f376d9bea71a21bd14ef072456324609cd72f36d1f31df83729"} Sep 18 21:50:51.506715 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.506646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" event={"ID":"773ea4a7-48e7-4058-b069-410810a4612a","Type":"ContainerStarted","Data":"af9ecef97e3b548439c80ea97984cd3c9367d354f0d00041c86c176a4fbccdb6"} Sep 18 21:50:51.517216 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.517140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshmg" event={"ID":"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd","Type":"ContainerStarted","Data":"4e4152024985342207ad2479279cd4986c99254fe4985784f8f872cb208402df"} Sep 18 21:50:51.535861 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.535768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-48g9m" event={"ID":"5bbc25d9-a502-4422-a9e7-65be602585e9","Type":"ContainerStarted","Data":"7b32a3ab64923be8de5b31f1bd3ee3b16e7267ac02c0eb6723e493887a8e43f7"} Sep 18 21:50:51.556461 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.556304 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" event={"ID":"f58cd2af-9385-476b-ac3d-53a5a14a384b","Type":"ContainerStarted","Data":"47d77a9a83c3f60da93e1a8b33c150b919581e368cb54e90f30c1a1c3fe4e7d5"} Sep 18 21:50:51.570379 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.570347 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" event={"ID":"2d0f63af6811757e41a790f4604e9861","Type":"ContainerStarted","Data":"361bc6eb41fbd79116d5892b73507d573f0ee517369dcd894cc92ed2ffed603f"} Sep 18 21:50:51.868330 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.868244 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:51.868476 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:51.868404 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:51.868476 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:51.868472 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:53.868453653 +0000 UTC m=+6.571019001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:51.969500 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:51.969460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:51.969684 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:51.969640 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:51.969748 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:51.969699 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret podName:221a8ad9-e6c6-4986-bf4a-cdd50bad02f8 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:53.969681712 +0000 UTC m=+6.672247059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret") pod "global-pull-secret-syncer-6wvwr" (UID: "221a8ad9-e6c6-4986-bf4a-cdd50bad02f8") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:52.070197 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:52.070165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:52.070377 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:52.070365 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:52.070443 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:52.070385 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:52.070443 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:52.070397 2567 projected.go:196] Error preparing data for projected volume kube-api-access-f4jhc for pod openshift-network-diagnostics/network-check-target-rv7js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:52.070530 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:52.070450 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc podName:e1c73eff-6805-4948-8f4a-a517cdb0f814 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:54.070432417 +0000 UTC m=+6.772997771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4jhc" (UniqueName: "kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc") pod "network-check-target-rv7js" (UID: "e1c73eff-6805-4948-8f4a-a517cdb0f814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:52.294999 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:52.294900 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:45:50 +0000 UTC" deadline="2028-02-24 14:14:39.216540643 +0000 UTC" Sep 18 21:50:52.294999 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:52.294960 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12568h23m46.921585359s" Sep 18 21:50:52.390188 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:52.389427 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:52.390188 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:52.389555 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:50:52.390188 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:52.389637 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:52.390188 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:52.389704 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:50:52.390188 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:52.389754 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:52.390188 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:52.389822 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:50:53.176650 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:53.176621 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:53.883466 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:53.883347 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:53.883963 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:53.883525 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:53.883963 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:53.883601 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:57.883577913 +0000 UTC m=+10.586143321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:53.984540 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:53.984479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:53.984713 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:53.984657 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:53.984771 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:53.984719 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret podName:221a8ad9-e6c6-4986-bf4a-cdd50bad02f8 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:57.984701423 +0000 UTC m=+10.687266769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret") pod "global-pull-secret-syncer-6wvwr" (UID: "221a8ad9-e6c6-4986-bf4a-cdd50bad02f8") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:54.085213 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:54.085084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:54.085387 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:54.085291 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:54.085387 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:54.085316 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:54.085387 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:54.085330 2567 projected.go:196] Error preparing data for projected volume kube-api-access-f4jhc for pod openshift-network-diagnostics/network-check-target-rv7js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:54.085387 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:54.085387 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc podName:e1c73eff-6805-4948-8f4a-a517cdb0f814 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:58.085369341 +0000 UTC m=+10.787934685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4jhc" (UniqueName: "kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc") pod "network-check-target-rv7js" (UID: "e1c73eff-6805-4948-8f4a-a517cdb0f814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:54.388676 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:54.388641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:54.388860 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:54.388680 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:54.388860 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:54.388792 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:50:54.388967 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:54.388866 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:50:54.388967 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:54.388911 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:54.389069 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:54.388983 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:50:56.388415 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:56.388380 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:56.388831 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:56.388531 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:50:56.388908 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:56.388877 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:56.388993 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:56.388971 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:50:56.389047 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:56.389020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:56.389107 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:56.389089 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:50:57.916518 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:57.916470 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:57.916960 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:57.916623 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:57.916960 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:57.916693 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:05.91667314 +0000 UTC m=+18.619238484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:58.018099 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:58.017567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:58.018099 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.017728 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:58.018099 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.017786 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret podName:221a8ad9-e6c6-4986-bf4a-cdd50bad02f8 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:06.01776843 +0000 UTC m=+18.720333779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret") pod "global-pull-secret-syncer-6wvwr" (UID: "221a8ad9-e6c6-4986-bf4a-cdd50bad02f8") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:58.118240 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:58.118206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:58.118409 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.118391 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:58.118479 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.118416 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:58.118479 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.118430 2567 projected.go:196] Error preparing data for projected volume kube-api-access-f4jhc for pod openshift-network-diagnostics/network-check-target-rv7js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:58.118588 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.118491 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc podName:e1c73eff-6805-4948-8f4a-a517cdb0f814 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:06.118471731 +0000 UTC m=+18.821037089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4jhc" (UniqueName: "kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc") pod "network-check-target-rv7js" (UID: "e1c73eff-6805-4948-8f4a-a517cdb0f814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:58.389283 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:58.389211 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:50:58.389435 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.389345 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:50:58.389435 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:58.389416 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:50:58.389546 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:50:58.389437 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:50:58.389546 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.389534 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:50:58.389660 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:50:58.389634 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:00.389225 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:00.389191 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:00.389705 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:00.389198 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:00.389705 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:00.389307 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:00.389705 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:00.389386 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:00.389705 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:00.389198 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:00.389705 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:00.389474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:02.388925 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:02.388895 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:02.389492 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:02.388959 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:02.389492 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:02.389094 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:02.389492 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:02.389142 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:02.389492 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:02.389214 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:02.389492 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:02.389309 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:04.388991 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:04.388958 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:04.389456 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:04.389000 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:04.389456 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:04.389070 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:04.389456 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:04.389085 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:04.389456 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:04.389192 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:04.389456 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:04.389283 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:05.972399 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:05.972360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:05.972856 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:05.972479 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:51:05.972856 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:05.972561 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:21.972544361 +0000 UTC m=+34.675109702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:51:06.072951 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:06.072917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:06.073107 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.073049 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:51:06.073182 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.073123 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret podName:221a8ad9-e6c6-4986-bf4a-cdd50bad02f8 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:22.07310434 +0000 UTC m=+34.775669682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret") pod "global-pull-secret-syncer-6wvwr" (UID: "221a8ad9-e6c6-4986-bf4a-cdd50bad02f8") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:51:06.173777 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:06.173733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:06.173942 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.173923 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:51:06.174011 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.173948 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:51:06.174011 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.173961 2567 projected.go:196] Error preparing data for projected volume kube-api-access-f4jhc for pod openshift-network-diagnostics/network-check-target-rv7js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:51:06.174011 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.174011 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc podName:e1c73eff-6805-4948-8f4a-a517cdb0f814 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:22.173996771 +0000 UTC m=+34.876562130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4jhc" (UniqueName: "kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc") pod "network-check-target-rv7js" (UID: "e1c73eff-6805-4948-8f4a-a517cdb0f814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:51:06.389374 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:06.389290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:06.389520 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:06.389290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:06.389520 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.389408 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:06.389520 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:06.389290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:06.389520 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.389479 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:06.389689 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:06.389567 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:08.388948 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:08.388900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:08.388948 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:08.388932 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:08.389518 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:08.388944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:08.389518 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:08.389036 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:08.389518 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:08.389100 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:08.389518 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:08.389226 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:09.609210 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.608559 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" event={"ID":"f58cd2af-9385-476b-ac3d-53a5a14a384b","Type":"ContainerStarted","Data":"b7725d6f2e98e2e6ba1330d5f91fbcdc5f38051d99bb62dd26cf11a915668138"} Sep 18 21:51:09.610746 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.610723 2567 generic.go:356] "Generic (PLEG): container finished" podID="2d0f63af6811757e41a790f4604e9861" containerID="3b39ab1868e2712066f2053a2c1e95a95846738f1411afe9c6ba1cbfe8fed4c6" exitCode=0 Sep 18 21:51:09.610843 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.610794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" event={"ID":"2d0f63af6811757e41a790f4604e9861","Type":"ContainerDied","Data":"3b39ab1868e2712066f2053a2c1e95a95846738f1411afe9c6ba1cbfe8fed4c6"} Sep 18 21:51:09.612478 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.612456 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zv7xs" event={"ID":"f164b2da-3aca-442e-be9c-0d900172e351","Type":"ContainerStarted","Data":"856646ef00bc8cce06de303813b42bc852f4add3fe6ec93f50b858d5332a9e7b"} Sep 18 21:51:09.614230 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.614193 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jljlf" event={"ID":"4e10c295-0617-4e38-b7c8-9c47cd1f651d","Type":"ContainerStarted","Data":"fe7b345d951e97d5d5a3f7f31015777f9930021a7986b555af412784f1acc788"} Sep 18 21:51:09.615778 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.615758 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f6k4r" event={"ID":"87fb5366-a15a-419e-a7aa-0021e94f4ce9","Type":"ContainerStarted","Data":"5b812bba3010c4fce119e669dc34e5c1bbfc9b1a0d9dca8894ad22107cab918c"} Sep 18 21:51:09.617186 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.617164 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" event={"ID":"beb0775bf473807b2efdbafa25f20da9","Type":"ContainerStarted","Data":"d01b51f6bccb804c23d65e4dc40847cade2de5cbe14491d19994a8b9753543cb"} Sep 18 21:51:09.621309 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.621281 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"432d59561c3d9a06f26a3e378d12f8d51c2eb2786b6393a6ef28e62ddca71c57"} Sep 18 21:51:09.621432 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.621415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"09409781dfd1797c29706b6b91f56ddd708d669583e28f54e3d1cdf86ead454c"} Sep 18 21:51:09.621509 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.621495 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"9f4ea498cbb1fdf136bf9239f53dd353a21816bb1b9c56348eb6ae90f90c962b"} Sep 18 21:51:09.623692 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.623651 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" event={"ID":"773ea4a7-48e7-4058-b069-410810a4612a","Type":"ContainerStarted","Data":"51f21338da2c7026c58560ea52ff366035a74af0db0cec07ac65dc15b2301394"} Sep 18 21:51:09.625093 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.625073 2567 generic.go:356] "Generic (PLEG): container finished" podID="30d234e5-9e6e-4ef4-b7d8-bfee22756fbd" containerID="9a83fd726c6e10f443cc4816b87272007ebab30dba2abedcbcf9e174da440063" exitCode=0 Sep 18 21:51:09.625197 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.625095 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshmg" event={"ID":"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd","Type":"ContainerDied","Data":"9a83fd726c6e10f443cc4816b87272007ebab30dba2abedcbcf9e174da440063"} Sep 18 21:51:09.626534 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.626519 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-48g9m" event={"ID":"5bbc25d9-a502-4422-a9e7-65be602585e9","Type":"ContainerStarted","Data":"cab23e58713a39fc6a1e3d1743333a8d110ef695367c72b35a1986eeda471b86"} Sep 18 21:51:09.670574 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.670541 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zv7xs" podStartSLOduration=2.286369682 podStartE2EDuration="20.670529118s" totalImagesPullingTime="18.384159436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:09.645935006 +0000 UTC m=+22.348500369" watchObservedRunningTime="2026-09-18 21:51:09.670529118 +0000 UTC m=+22.373094481" Sep 18 21:51:09.670867 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.670847 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jljlf" podStartSLOduration=6.235848189 podStartE2EDuration="20.670841144s" totalImagesPullingTime="14.434992955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:09.670430977 +0000 UTC m=+22.372996341" watchObservedRunningTime="2026-09-18 21:51:09.670841144 +0000 UTC m=+22.373406498" Sep 18 21:51:09.715607 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.715547 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hlfnz" podStartSLOduration=2.215067543 podStartE2EDuration="20.715534318s" totalImagesPullingTime="18.500466775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:09.692915081 +0000 UTC m=+22.395480444" watchObservedRunningTime="2026-09-18 21:51:09.715534318 +0000 UTC m=+22.418099682" Sep 18 21:51:09.716008 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.715976 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f6k4r" podStartSLOduration=2.034403516 podStartE2EDuration="20.715965451s" totalImagesPullingTime="18.681561935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:09.715805865 +0000 UTC m=+22.418371227" watchObservedRunningTime="2026-09-18 21:51:09.715965451 +0000 UTC m=+22.418530818" Sep 18 21:51:09.735739 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:09.735709 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-48g9m" podStartSLOduration=2.2803211709999998 podStartE2EDuration="20.735698936s" totalImagesPullingTime="18.455377765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:09.735310962 +0000 UTC m=+22.437876325" watchObservedRunningTime="2026-09-18 21:51:09.735698936 +0000 UTC m=+22.438264344" Sep 18 21:51:10.264678 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.264645 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:51:10.265275 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.265251 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:51:10.283877 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.283833 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-249.ec2.internal" podStartSLOduration=20.283820687 podStartE2EDuration="20.283820687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:09.804876847 +0000 UTC m=+22.507442209" watchObservedRunningTime="2026-09-18 21:51:10.283820687 +0000 UTC m=+22.986386073" Sep 18 21:51:10.388498 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.388473 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:10.388642 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.388474 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:10.388642 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:10.388575 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:10.388726 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.388473 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:10.388726 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:10.388671 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:10.388795 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:10.388755 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:10.504463 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.504301 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 21:51:10.630558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.630518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" event={"ID":"f58cd2af-9385-476b-ac3d-53a5a14a384b","Type":"ContainerStarted","Data":"70c10eeead921f6e3ea2bf5c748903582881bbd07a15f6011570c16cdd232635"} Sep 18 21:51:10.632001 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.631976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mz6wf" event={"ID":"124f4987-4985-4cf1-8be9-b086f66d755f","Type":"ContainerStarted","Data":"0ba9ff366e037ebb26c728785a842889bc0e5f1284700fb0046ee1959f153484"} Sep 18 21:51:10.634908 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.634884 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"e8051d07400ead50b66958474b09480621e2c04136fafea08fb9c672dc9f2054"} Sep 18 21:51:10.635006 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.634962 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"23218d7c846e56098369fe84e0f24d7a2faf36e613b5b3d53af8ccdf4089cd69"} Sep 18 21:51:10.635074 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.635008 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"21e27974e17f72bad01d402a5f59a86f8e2e7c9f8c32df5e7256f13c62e0b7da"} Sep 18 21:51:10.635819 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.635799 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:51:10.635927 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.635878 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zv7xs" Sep 18 21:51:10.655907 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:10.655862 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mz6wf" podStartSLOduration=3.179889126 podStartE2EDuration="21.655850728s" totalImagesPullingTime="18.475961602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:10.655270336 +0000 UTC m=+23.357835699" watchObservedRunningTime="2026-09-18 21:51:10.655850728 +0000 UTC m=+23.358416091" Sep 18 21:51:11.323201 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:11.323072 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T21:51:10.504460599Z","UUID":"f0db0e12-d2c5-49b2-86f0-d60c43bce720","Handler":null,"Name":"","Endpoint":""} Sep 18 21:51:11.325183 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:11.324920 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 21:51:11.325183 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:11.324954 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 21:51:11.639484 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:11.639392 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" event={"ID":"f58cd2af-9385-476b-ac3d-53a5a14a384b","Type":"ContainerStarted","Data":"19325e043b53e7c01c16fc9a7429f99d7a19de18d4d80bf537a13c6d6829ff0f"} Sep 18 21:51:11.641608 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:11.641581 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" event={"ID":"2d0f63af6811757e41a790f4604e9861","Type":"ContainerStarted","Data":"5e66439d940e08734d3829fdb4c749b0611b24a0dc4f673e266854b1da09ec5c"} Sep 18 21:51:11.668463 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:11.668415 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6lktn" podStartSLOduration=2.281123176 podStartE2EDuration="22.668399422s" totalImagesPullingTime="20.387276246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:11.667924906 +0000 UTC m=+24.370490280" watchObservedRunningTime="2026-09-18 21:51:11.668399422 +0000 UTC m=+24.370964785" Sep 18 21:51:11.690993 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:11.688579 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-249.ec2.internal" podStartSLOduration=21.68855052 podStartE2EDuration="21.68855052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:11.687940811 +0000 UTC m=+24.390506175" watchObservedRunningTime="2026-09-18 21:51:11.68855052 +0000 UTC m=+24.391115882" Sep 18 21:51:12.388683 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:12.388600 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:12.388683 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:12.388642 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:12.388858 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:12.388705 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:12.388858 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:12.388716 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:12.388858 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:12.388774 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:12.388858 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:12.388836 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:12.648263 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:12.648170 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"e29d37d1d1c1ff058a426b28c5c34dacf6f064c3304b8451caf16fb9f0a48120"} Sep 18 21:51:14.388686 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:14.388620 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:14.389031 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:14.388622 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:14.389031 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:14.388714 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:14.389031 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:14.388622 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:14.389031 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:14.388782 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:14.389031 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:14.388855 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:14.660267 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:14.660073 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" event={"ID":"12d97d79-cce7-4ea4-8a28-b5b063c38de4","Type":"ContainerStarted","Data":"8142cd599a406bf009ad36c48f39279b01aaae05151d8c62e8941e7dc23875b1"} Sep 18 21:51:14.660427 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:14.660378 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:51:14.660500 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:14.660488 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:51:14.675337 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:14.675320 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:51:14.735447 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:14.735400 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" podStartSLOduration=7.236779993 podStartE2EDuration="25.735386585s" totalImagesPullingTime="18.498606592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:14.700964097 +0000 UTC m=+27.403529459" watchObservedRunningTime="2026-09-18 21:51:14.735386585 +0000 UTC m=+27.437951948" Sep 18 21:51:15.664680 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:15.664644 2567 generic.go:356] "Generic (PLEG): container finished" podID="30d234e5-9e6e-4ef4-b7d8-bfee22756fbd" containerID="56fc5650d4d9221700d7a8bc4ad0a69afe3eec33e3f79642ac20a10c1af43746" exitCode=0 Sep 18 21:51:15.665464 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:15.664732 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshmg" event={"ID":"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd","Type":"ContainerDied","Data":"56fc5650d4d9221700d7a8bc4ad0a69afe3eec33e3f79642ac20a10c1af43746"} Sep 18 21:51:15.666052 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:15.665780 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:51:15.684623 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:15.684596 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:51:16.373715 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:16.373687 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rv7js"] Sep 18 21:51:16.373879 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:16.373799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:16.373943 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:16.373896 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:16.376517 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:16.376460 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zmxqf"] Sep 18 21:51:16.376612 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:16.376546 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:16.376655 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:16.376613 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:16.379492 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:16.379470 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6wvwr"] Sep 18 21:51:16.379677 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:16.379564 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:16.379677 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:16.379658 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:17.670684 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:17.670650 2567 generic.go:356] "Generic (PLEG): container finished" podID="30d234e5-9e6e-4ef4-b7d8-bfee22756fbd" containerID="a1e0c405aa7cdc9a02d108daf8f6680b4f2b966a842c20c929ac7e5e1e7e0d22" exitCode=0 Sep 18 21:51:17.671211 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:17.670732 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshmg" event={"ID":"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd","Type":"ContainerDied","Data":"a1e0c405aa7cdc9a02d108daf8f6680b4f2b966a842c20c929ac7e5e1e7e0d22"} Sep 18 21:51:18.388524 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:18.388491 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:18.388524 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:18.388509 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:18.388684 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:18.388524 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:18.388684 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:18.388624 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:18.388785 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:18.388736 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:18.388862 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:18.388840 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:18.675932 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:18.675902 2567 generic.go:356] "Generic (PLEG): container finished" podID="30d234e5-9e6e-4ef4-b7d8-bfee22756fbd" containerID="a1d7ba367c8ca67380da8b396182d638bec2131157723a374404b0f83c89bc67" exitCode=0 Sep 18 21:51:18.676281 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:18.675965 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshmg" event={"ID":"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd","Type":"ContainerDied","Data":"a1d7ba367c8ca67380da8b396182d638bec2131157723a374404b0f83c89bc67"} Sep 18 21:51:20.388818 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:20.388663 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:20.388818 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:20.388732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:20.388818 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:20.388735 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:20.389400 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:20.388838 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rv7js" podUID="e1c73eff-6805-4948-8f4a-a517cdb0f814" Sep 18 21:51:20.389400 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:20.388918 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:51:20.389400 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:20.389002 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6wvwr" podUID="221a8ad9-e6c6-4986-bf4a-cdd50bad02f8" Sep 18 21:51:21.995403 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:21.995326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:21.995804 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:21.995447 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:51:21.995804 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:21.995499 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:53.995485403 +0000 UTC m=+66.698050745 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:51:22.071983 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.071952 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-249.ec2.internal" event="NodeReady" Sep 18 21:51:22.072142 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.072074 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 21:51:22.096165 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.096140 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:22.096339 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.096321 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:51:22.096405 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.096389 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret podName:221a8ad9-e6c6-4986-bf4a-cdd50bad02f8 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:54.096369186 +0000 UTC m=+66.798934534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret") pod "global-pull-secret-syncer-6wvwr" (UID: "221a8ad9-e6c6-4986-bf4a-cdd50bad02f8") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:51:22.177401 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.177375 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6p9zr"] Sep 18 21:51:22.197293 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.197264 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:22.197451 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.197432 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:51:22.197503 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.197458 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:51:22.197503 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.197472 2567 projected.go:196] Error preparing data for projected volume kube-api-access-f4jhc for pod openshift-network-diagnostics/network-check-target-rv7js: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:51:22.197578 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.197528 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc podName:e1c73eff-6805-4948-8f4a-a517cdb0f814 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:54.197513994 +0000 UTC m=+66.900079336 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4jhc" (UniqueName: "kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc") pod "network-check-target-rv7js" (UID: "e1c73eff-6805-4948-8f4a-a517cdb0f814") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:51:22.204384 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.204357 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-49dnr"] Sep 18 21:51:22.204477 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.204452 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.212258 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.212236 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 21:51:22.213164 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.213122 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 21:51:22.213277 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.213257 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-np4sp\"" Sep 18 21:51:22.221780 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.221759 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-49dnr"] Sep 18 21:51:22.221894 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.221837 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-49dnr" Sep 18 21:51:22.229431 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.229295 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6p9zr"] Sep 18 21:51:22.229431 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.229329 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 21:51:22.229578 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.229476 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 21:51:22.230348 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.230329 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 21:51:22.298390 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.298306 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad686e52-0160-4170-83f0-d800df399ba6-tmp-dir\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.298390 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.298377 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad686e52-0160-4170-83f0-d800df399ba6-config-volume\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.298589 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.298425 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49dd2dc5-0107-445c-b896-edfd7412d9e2-cert\") pod \"ingress-canary-49dnr\" (UID: \"49dd2dc5-0107-445c-b896-edfd7412d9e2\") " pod="openshift-ingress-canary/ingress-canary-49dnr" Sep 18 21:51:22.298589 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.298451 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.298589 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.298474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-777nq\" (UniqueName: \"kubernetes.io/projected/ad686e52-0160-4170-83f0-d800df399ba6-kube-api-access-777nq\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.298589 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.298507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn8w6\" (UniqueName: \"kubernetes.io/projected/49dd2dc5-0107-445c-b896-edfd7412d9e2-kube-api-access-wn8w6\") pod \"ingress-canary-49dnr\" (UID: \"49dd2dc5-0107-445c-b896-edfd7412d9e2\") " pod="openshift-ingress-canary/ingress-canary-49dnr" Sep 18 21:51:22.306145 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.306112 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xt9d9\"" Sep 18 21:51:22.389340 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.389302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:22.389340 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.389325 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:22.389564 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.389329 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:22.394691 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.394668 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 21:51:22.395459 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.395407 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-678rx\"" Sep 18 21:51:22.395571 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.395483 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 21:51:22.395670 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.395640 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5rt7r\"" Sep 18 21:51:22.395852 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.395836 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 21:51:22.396241 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.396221 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 21:51:22.398747 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.398726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.398864 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.398758 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-777nq\" (UniqueName: \"kubernetes.io/projected/ad686e52-0160-4170-83f0-d800df399ba6-kube-api-access-777nq\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.398864 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.398793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn8w6\" (UniqueName: \"kubernetes.io/projected/49dd2dc5-0107-445c-b896-edfd7412d9e2-kube-api-access-wn8w6\") pod \"ingress-canary-49dnr\" (UID: \"49dd2dc5-0107-445c-b896-edfd7412d9e2\") " pod="openshift-ingress-canary/ingress-canary-49dnr" Sep 18 21:51:22.398864 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.398825 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad686e52-0160-4170-83f0-d800df399ba6-tmp-dir\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.398864 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.398859 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:22.399086 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.398885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad686e52-0160-4170-83f0-d800df399ba6-config-volume\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.399086 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.398914 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls podName:ad686e52-0160-4170-83f0-d800df399ba6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:22.898897972 +0000 UTC m=+35.601463316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls") pod "dns-default-6p9zr" (UID: "ad686e52-0160-4170-83f0-d800df399ba6") : secret "dns-default-metrics-tls" not found Sep 18 21:51:22.399086 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.398963 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49dd2dc5-0107-445c-b896-edfd7412d9e2-cert\") pod \"ingress-canary-49dnr\" (UID: \"49dd2dc5-0107-445c-b896-edfd7412d9e2\") " pod="openshift-ingress-canary/ingress-canary-49dnr" Sep 18 21:51:22.399317 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.399251 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad686e52-0160-4170-83f0-d800df399ba6-tmp-dir\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.399607 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.399585 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad686e52-0160-4170-83f0-d800df399ba6-config-volume\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.404160 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.404117 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49dd2dc5-0107-445c-b896-edfd7412d9e2-cert\") pod \"ingress-canary-49dnr\" (UID: \"49dd2dc5-0107-445c-b896-edfd7412d9e2\") " pod="openshift-ingress-canary/ingress-canary-49dnr" Sep 18 21:51:22.410945 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.410906 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-777nq\" (UniqueName: \"kubernetes.io/projected/ad686e52-0160-4170-83f0-d800df399ba6-kube-api-access-777nq\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.412953 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.412930 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn8w6\" (UniqueName: \"kubernetes.io/projected/49dd2dc5-0107-445c-b896-edfd7412d9e2-kube-api-access-wn8w6\") pod \"ingress-canary-49dnr\" (UID: \"49dd2dc5-0107-445c-b896-edfd7412d9e2\") " pod="openshift-ingress-canary/ingress-canary-49dnr" Sep 18 21:51:22.531667 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.531628 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-49dnr" Sep 18 21:51:22.902911 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:22.902731 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:22.902911 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.902874 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:22.903092 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:22.902960 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls podName:ad686e52-0160-4170-83f0-d800df399ba6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:23.902940883 +0000 UTC m=+36.605506225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls") pod "dns-default-6p9zr" (UID: "ad686e52-0160-4170-83f0-d800df399ba6") : secret "dns-default-metrics-tls" not found Sep 18 21:51:23.010459 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:23.010436 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-49dnr"] Sep 18 21:51:23.016675 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:51:23.016652 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49dd2dc5_0107_445c_b896_edfd7412d9e2.slice/crio-6ca34726697d51abe137ceae63f71840c037b04e79c4b4a639a3b830f5efba21 WatchSource:0}: Error finding container 6ca34726697d51abe137ceae63f71840c037b04e79c4b4a639a3b830f5efba21: Status 404 returned error can't find the container with id 6ca34726697d51abe137ceae63f71840c037b04e79c4b4a639a3b830f5efba21 Sep 18 21:51:23.690948 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:23.690916 2567 generic.go:356] "Generic (PLEG): container finished" podID="30d234e5-9e6e-4ef4-b7d8-bfee22756fbd" containerID="15bbbb1422150000350de7a5ddaefc002cc567646310a3782ee418acb69142c3" exitCode=0 Sep 18 21:51:23.691184 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:23.691014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshmg" event={"ID":"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd","Type":"ContainerDied","Data":"15bbbb1422150000350de7a5ddaefc002cc567646310a3782ee418acb69142c3"} Sep 18 21:51:23.692375 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:23.692346 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-49dnr" event={"ID":"49dd2dc5-0107-445c-b896-edfd7412d9e2","Type":"ContainerStarted","Data":"6ca34726697d51abe137ceae63f71840c037b04e79c4b4a639a3b830f5efba21"} Sep 18 21:51:23.910352 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:23.910327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:23.910490 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:23.910471 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:23.910541 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:23.910528 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls podName:ad686e52-0160-4170-83f0-d800df399ba6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:25.910513782 +0000 UTC m=+38.613079123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls") pod "dns-default-6p9zr" (UID: "ad686e52-0160-4170-83f0-d800df399ba6") : secret "dns-default-metrics-tls" not found Sep 18 21:51:24.700895 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:24.700856 2567 generic.go:356] "Generic (PLEG): container finished" podID="30d234e5-9e6e-4ef4-b7d8-bfee22756fbd" containerID="d4595f982dfcc98797f09d7f5594e4e5769fc2b83e4e30393550b544f217c7f0" exitCode=0 Sep 18 21:51:24.701440 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:24.700922 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshmg" event={"ID":"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd","Type":"ContainerDied","Data":"d4595f982dfcc98797f09d7f5594e4e5769fc2b83e4e30393550b544f217c7f0"} Sep 18 21:51:25.706914 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:25.706725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dshmg" event={"ID":"30d234e5-9e6e-4ef4-b7d8-bfee22756fbd","Type":"ContainerStarted","Data":"4883374fe96edd4889fdf067f0496f53d80e3a411d0df6102a0af035b7cd545c"} Sep 18 21:51:25.708250 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:25.708228 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-49dnr" event={"ID":"49dd2dc5-0107-445c-b896-edfd7412d9e2","Type":"ContainerStarted","Data":"7076f1a25f4b12e9cba98e31d964df861fae85beeae6ca1d605324e3210fb036"} Sep 18 21:51:25.741427 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:25.741391 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dshmg" podStartSLOduration=7.579485264 podStartE2EDuration="36.741376788s" totalImagesPullingTime="29.161891524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:25.739828693 +0000 UTC m=+38.442394067" watchObservedRunningTime="2026-09-18 21:51:25.741376788 +0000 UTC m=+38.443942150" Sep 18 21:51:25.761430 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:25.761397 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-49dnr" podStartSLOduration=1.490616272 podStartE2EDuration="3.761386378s" totalImagesPullingTime="2.270770106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:25.761102238 +0000 UTC m=+38.463667601" watchObservedRunningTime="2026-09-18 21:51:25.761386378 +0000 UTC m=+38.463951741" Sep 18 21:51:25.925944 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:25.925920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:25.926027 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:25.926010 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:25.926063 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:25.926056 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls podName:ad686e52-0160-4170-83f0-d800df399ba6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:29.926043999 +0000 UTC m=+42.628609340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls") pod "dns-default-6p9zr" (UID: "ad686e52-0160-4170-83f0-d800df399ba6") : secret "dns-default-metrics-tls" not found Sep 18 21:51:29.951828 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:29.951783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:29.952260 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:29.951902 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:29.952260 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:29.951955 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls podName:ad686e52-0160-4170-83f0-d800df399ba6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:37.951940709 +0000 UTC m=+50.654506050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls") pod "dns-default-6p9zr" (UID: "ad686e52-0160-4170-83f0-d800df399ba6") : secret "dns-default-metrics-tls" not found Sep 18 21:51:38.011680 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:38.011640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:38.012119 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:38.011786 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:38.012119 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:38.011849 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls podName:ad686e52-0160-4170-83f0-d800df399ba6 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:54.011833004 +0000 UTC m=+66.714398345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls") pod "dns-default-6p9zr" (UID: "ad686e52-0160-4170-83f0-d800df399ba6") : secret "dns-default-metrics-tls" not found Sep 18 21:51:47.681628 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:47.681595 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wlv2" Sep 18 21:51:54.017703 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.017661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:51:54.018296 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.017718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:51:54.018296 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:54.017827 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:54.018296 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:54.017892 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls podName:ad686e52-0160-4170-83f0-d800df399ba6 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:26.017872774 +0000 UTC m=+98.720438133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls") pod "dns-default-6p9zr" (UID: "ad686e52-0160-4170-83f0-d800df399ba6") : secret "dns-default-metrics-tls" not found Sep 18 21:51:54.022851 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.022833 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 21:51:54.028270 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:54.028254 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 21:51:54.028335 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:51:54.028304 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:58.028291266 +0000 UTC m=+130.730856608 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : secret "metrics-daemon-secret" not found Sep 18 21:51:54.118995 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.118956 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:54.123395 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.123374 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 21:51:54.132436 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.132415 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/221a8ad9-e6c6-4986-bf4a-cdd50bad02f8-original-pull-secret\") pod \"global-pull-secret-syncer-6wvwr\" (UID: \"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8\") " pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:54.220229 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.220172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:54.225064 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.225045 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 21:51:54.227199 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.227173 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6wvwr" Sep 18 21:51:54.236182 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.236161 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 21:51:54.243298 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.243277 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4jhc\" (UniqueName: \"kubernetes.io/projected/e1c73eff-6805-4948-8f4a-a517cdb0f814-kube-api-access-f4jhc\") pod \"network-check-target-rv7js\" (UID: \"e1c73eff-6805-4948-8f4a-a517cdb0f814\") " pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:54.504873 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.504843 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6wvwr"] Sep 18 21:51:54.506049 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.506034 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-678rx\"" Sep 18 21:51:54.511864 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.511846 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:54.512595 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:51:54.512571 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221a8ad9_e6c6_4986_bf4a_cdd50bad02f8.slice/crio-a14305e81f6cb8e3807ab1952a3e5e934b23aba7b1b63ef153203964dd1b8bc1 WatchSource:0}: Error finding container a14305e81f6cb8e3807ab1952a3e5e934b23aba7b1b63ef153203964dd1b8bc1: Status 404 returned error can't find the container with id a14305e81f6cb8e3807ab1952a3e5e934b23aba7b1b63ef153203964dd1b8bc1 Sep 18 21:51:54.776186 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.776154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6wvwr" event={"ID":"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8","Type":"ContainerStarted","Data":"a14305e81f6cb8e3807ab1952a3e5e934b23aba7b1b63ef153203964dd1b8bc1"} Sep 18 21:51:54.780530 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:54.780497 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rv7js"] Sep 18 21:51:54.782368 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:51:54.782343 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c73eff_6805_4948_8f4a_a517cdb0f814.slice/crio-2dcff37333292746f0889b1077f1dee5789b3adda535695d56d73f7fdf0a9cab WatchSource:0}: Error finding container 2dcff37333292746f0889b1077f1dee5789b3adda535695d56d73f7fdf0a9cab: Status 404 returned error can't find the container with id 2dcff37333292746f0889b1077f1dee5789b3adda535695d56d73f7fdf0a9cab Sep 18 21:51:55.780427 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:55.780362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rv7js" event={"ID":"e1c73eff-6805-4948-8f4a-a517cdb0f814","Type":"ContainerStarted","Data":"2dcff37333292746f0889b1077f1dee5789b3adda535695d56d73f7fdf0a9cab"} Sep 18 21:51:59.793632 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:59.793595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6wvwr" event={"ID":"221a8ad9-e6c6-4986-bf4a-cdd50bad02f8","Type":"ContainerStarted","Data":"dbbb4310be7a7180e41cf2ea552dff8de6757039f5c5703fa77ef0c24bedeb54"} Sep 18 21:51:59.795223 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:59.795198 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rv7js" event={"ID":"e1c73eff-6805-4948-8f4a-a517cdb0f814","Type":"ContainerStarted","Data":"b410097ae5ecfd54b7d90eb6169b6574692e409d2e9a221a3a131a14ecf705c3"} Sep 18 21:51:59.795364 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:59.795255 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:51:59.812235 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:59.812186 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6wvwr" podStartSLOduration=66.42221312 podStartE2EDuration="1m10.812173657s" totalImagesPullingTime="4.389960537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:59.811426247 +0000 UTC m=+72.513991611" watchObservedRunningTime="2026-09-18 21:51:59.812173657 +0000 UTC m=+72.514739012" Sep 18 21:51:59.828540 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:51:59.828499 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rv7js" podStartSLOduration=66.720081122 podStartE2EDuration="1m10.828486925s" totalImagesPullingTime="4.108405803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:59.827966289 +0000 UTC m=+72.530531651" watchObservedRunningTime="2026-09-18 21:51:59.828486925 +0000 UTC m=+72.531052287" Sep 18 21:52:26.032092 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:26.032060 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:52:26.032471 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:26.032211 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:52:26.032471 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:26.032280 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls podName:ad686e52-0160-4170-83f0-d800df399ba6 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:30.032257036 +0000 UTC m=+162.734822378 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls") pod "dns-default-6p9zr" (UID: "ad686e52-0160-4170-83f0-d800df399ba6") : secret "dns-default-metrics-tls" not found Sep 18 21:52:30.800247 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:30.800209 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rv7js" Sep 18 21:52:47.113784 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.113745 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc"] Sep 18 21:52:47.116268 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.116246 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc" Sep 18 21:52:47.133048 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.133019 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7h4qj\"" Sep 18 21:52:47.142797 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.142773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc"] Sep 18 21:52:47.162913 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.162883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zfpc\" (UniqueName: \"kubernetes.io/projected/944ad95a-83fb-48a0-91fc-9a688fb90cfb-kube-api-access-4zfpc\") pod \"network-check-source-7cbc45fddc-cwwjc\" (UID: \"944ad95a-83fb-48a0-91fc-9a688fb90cfb\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc" Sep 18 21:52:47.227823 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.227800 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-6pmwb"] Sep 18 21:52:47.229408 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.229393 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8fc77fcf6-nn9ld"] Sep 18 21:52:47.229524 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.229508 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.230880 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.230863 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr"] Sep 18 21:52:47.231003 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.230984 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.232554 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.232533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.234686 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.234663 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 21:52:47.236069 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.236050 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 18 21:52:47.236303 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.236278 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 18 21:52:47.236406 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.236309 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 21:52:47.236849 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.236831 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 21:52:47.236925 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.236872 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 18 21:52:47.236925 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.236908 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 21:52:47.237031 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.236932 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:52:47.237031 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.236948 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-79n2p\"" Sep 18 21:52:47.237641 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.237616 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rcrbf\"" Sep 18 21:52:47.238369 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.238348 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 18 21:52:47.238509 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.238491 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 21:52:47.239251 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.239235 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 18 21:52:47.239927 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.239898 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qctj\"" Sep 18 21:52:47.247639 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.247612 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr"] Sep 18 21:52:47.248827 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.248803 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 18 21:52:47.251062 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.251041 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 21:52:47.252446 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.252423 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8fc77fcf6-nn9ld"] Sep 18 21:52:47.253418 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.253398 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-6pmwb"] Sep 18 21:52:47.263721 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-ca-trust-extracted\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.263809 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f89a5ef2-a724-4862-9b01-5fd8e982271e-trusted-ca\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.263809 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks9ss\" (UniqueName: \"kubernetes.io/projected/33de9d4a-7210-4bcf-9570-a06c3953db4d-kube-api-access-ks9ss\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.263896 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-installation-pull-secrets\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.263896 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-trusted-ca\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.263896 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-image-registry-private-configuration\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.263896 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89a5ef2-a724-4862-9b01-5fd8e982271e-serving-cert\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.264052 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33de9d4a-7210-4bcf-9570-a06c3953db4d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.264052 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.264052 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89a5ef2-a724-4862-9b01-5fd8e982271e-config\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.264052 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.263995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-bound-sa-token\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.264052 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.264038 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj9jb\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-kube-api-access-zj9jb\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.264319 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.264084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlkbj\" (UniqueName: \"kubernetes.io/projected/f89a5ef2-a724-4862-9b01-5fd8e982271e-kube-api-access-mlkbj\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.264319 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.264113 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-certificates\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.264319 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.264158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.264319 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.264191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zfpc\" (UniqueName: \"kubernetes.io/projected/944ad95a-83fb-48a0-91fc-9a688fb90cfb-kube-api-access-4zfpc\") pod \"network-check-source-7cbc45fddc-cwwjc\" (UID: \"944ad95a-83fb-48a0-91fc-9a688fb90cfb\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc" Sep 18 21:52:47.282486 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.282466 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zfpc\" (UniqueName: \"kubernetes.io/projected/944ad95a-83fb-48a0-91fc-9a688fb90cfb-kube-api-access-4zfpc\") pod \"network-check-source-7cbc45fddc-cwwjc\" (UID: \"944ad95a-83fb-48a0-91fc-9a688fb90cfb\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc" Sep 18 21:52:47.364428 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-bound-sa-token\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.364428 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj9jb\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-kube-api-access-zj9jb\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.364428 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlkbj\" (UniqueName: \"kubernetes.io/projected/f89a5ef2-a724-4862-9b01-5fd8e982271e-kube-api-access-mlkbj\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.364586 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364441 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-certificates\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.364586 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.364586 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-ca-trust-extracted\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.364586 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f89a5ef2-a724-4862-9b01-5fd8e982271e-trusted-ca\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.364586 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks9ss\" (UniqueName: \"kubernetes.io/projected/33de9d4a-7210-4bcf-9570-a06c3953db4d-kube-api-access-ks9ss\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.364586 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.364578 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.364597 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc77fcf6-nn9ld: secret "image-registry-tls" not found Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.364646 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls podName:7900b6fb-5bdc-4be4-835f-e593ecfc42a8 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:47.864629526 +0000 UTC m=+120.567194882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls") pod "image-registry-8fc77fcf6-nn9ld" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8") : secret "image-registry-tls" not found Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-installation-pull-secrets\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364714 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-trusted-ca\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-image-registry-private-configuration\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89a5ef2-a724-4862-9b01-5fd8e982271e-serving-cert\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364808 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33de9d4a-7210-4bcf-9570-a06c3953db4d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.364868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89a5ef2-a724-4862-9b01-5fd8e982271e-config\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.365339 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.364916 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-ca-trust-extracted\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.365339 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.365006 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:47.365339 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.365067 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls podName:33de9d4a-7210-4bcf-9570-a06c3953db4d nodeName:}" failed. No retries permitted until 2026-09-18 21:52:47.865049411 +0000 UTC m=+120.567614759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcfr" (UID: "33de9d4a-7210-4bcf-9570-a06c3953db4d") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:47.365339 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.365110 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-certificates\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.365552 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.365510 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89a5ef2-a724-4862-9b01-5fd8e982271e-config\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.365638 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.365618 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f89a5ef2-a724-4862-9b01-5fd8e982271e-trusted-ca\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.365689 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.365635 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/33de9d4a-7210-4bcf-9570-a06c3953db4d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.366173 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.366149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-trusted-ca\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.367331 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.367305 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-image-registry-private-configuration\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.367425 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.367334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-installation-pull-secrets\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.367425 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.367400 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89a5ef2-a724-4862-9b01-5fd8e982271e-serving-cert\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.375615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.375594 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlkbj\" (UniqueName: \"kubernetes.io/projected/f89a5ef2-a724-4862-9b01-5fd8e982271e-kube-api-access-mlkbj\") pod \"console-operator-fd4bb46c-6pmwb\" (UID: \"f89a5ef2-a724-4862-9b01-5fd8e982271e\") " pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.376228 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.376207 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks9ss\" (UniqueName: \"kubernetes.io/projected/33de9d4a-7210-4bcf-9570-a06c3953db4d-kube-api-access-ks9ss\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.376392 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.376374 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj9jb\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-kube-api-access-zj9jb\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.376650 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.376636 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-bound-sa-token\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.426223 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.426202 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc" Sep 18 21:52:47.539516 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.539488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:47.701397 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.701365 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc"] Sep 18 21:52:47.704713 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:52:47.704690 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944ad95a_83fb_48a0_91fc_9a688fb90cfb.slice/crio-9c05df12c1ddbf59349f46d274488aa15aaed81d9374f2f030569b264908ea94 WatchSource:0}: Error finding container 9c05df12c1ddbf59349f46d274488aa15aaed81d9374f2f030569b264908ea94: Status 404 returned error can't find the container with id 9c05df12c1ddbf59349f46d274488aa15aaed81d9374f2f030569b264908ea94 Sep 18 21:52:47.816083 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.816058 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-6pmwb"] Sep 18 21:52:47.818945 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:52:47.818922 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89a5ef2_a724_4862_9b01_5fd8e982271e.slice/crio-253e71eb33aec0e9fa24a20b6a25fbabba09d54a15d6671be92938f97ed8208b WatchSource:0}: Error finding container 253e71eb33aec0e9fa24a20b6a25fbabba09d54a15d6671be92938f97ed8208b: Status 404 returned error can't find the container with id 253e71eb33aec0e9fa24a20b6a25fbabba09d54a15d6671be92938f97ed8208b Sep 18 21:52:47.869434 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.869409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:47.869532 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.869466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:47.869578 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.869539 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:47.869578 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.869567 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:52:47.869642 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.869580 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc77fcf6-nn9ld: secret "image-registry-tls" not found Sep 18 21:52:47.869642 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.869592 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls podName:33de9d4a-7210-4bcf-9570-a06c3953db4d nodeName:}" failed. No retries permitted until 2026-09-18 21:52:48.869578303 +0000 UTC m=+121.572143659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcfr" (UID: "33de9d4a-7210-4bcf-9570-a06c3953db4d") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:47.869642 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:47.869628 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls podName:7900b6fb-5bdc-4be4-835f-e593ecfc42a8 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:48.869611072 +0000 UTC m=+121.572176417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls") pod "image-registry-8fc77fcf6-nn9ld" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8") : secret "image-registry-tls" not found Sep 18 21:52:47.911992 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.911969 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" event={"ID":"f89a5ef2-a724-4862-9b01-5fd8e982271e","Type":"ContainerStarted","Data":"253e71eb33aec0e9fa24a20b6a25fbabba09d54a15d6671be92938f97ed8208b"} Sep 18 21:52:47.913459 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.913439 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc" event={"ID":"944ad95a-83fb-48a0-91fc-9a688fb90cfb","Type":"ContainerStarted","Data":"5b001f50ca1c111534206883d7263d2fb4f61524b7fa8e3ee7aeb8c2629978c6"} Sep 18 21:52:47.913533 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.913474 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc" event={"ID":"944ad95a-83fb-48a0-91fc-9a688fb90cfb","Type":"ContainerStarted","Data":"9c05df12c1ddbf59349f46d274488aa15aaed81d9374f2f030569b264908ea94"} Sep 18 21:52:47.940876 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:47.940831 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cwwjc" podStartSLOduration=0.94081395 podStartE2EDuration="940.81395ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:47.940740618 +0000 UTC m=+120.643305983" watchObservedRunningTime="2026-09-18 21:52:47.94081395 +0000 UTC m=+120.643379314" Sep 18 21:52:48.877262 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:48.877228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:48.877682 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:48.877326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:48.877682 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:48.877396 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:52:48.877682 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:48.877414 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:48.877682 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:48.877418 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc77fcf6-nn9ld: secret "image-registry-tls" not found Sep 18 21:52:48.877682 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:48.877472 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls podName:7900b6fb-5bdc-4be4-835f-e593ecfc42a8 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:50.87745391 +0000 UTC m=+123.580019258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls") pod "image-registry-8fc77fcf6-nn9ld" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8") : secret "image-registry-tls" not found Sep 18 21:52:48.877682 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:48.877490 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls podName:33de9d4a-7210-4bcf-9570-a06c3953db4d nodeName:}" failed. No retries permitted until 2026-09-18 21:52:50.877480311 +0000 UTC m=+123.580045653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcfr" (UID: "33de9d4a-7210-4bcf-9570-a06c3953db4d") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:49.920472 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:49.920444 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/0.log" Sep 18 21:52:49.920790 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:49.920490 2567 generic.go:356] "Generic (PLEG): container finished" podID="f89a5ef2-a724-4862-9b01-5fd8e982271e" containerID="d2fc706396d365717fa1f24ccf4773189d8a35bec9949ed59966eef7ab35d22d" exitCode=255 Sep 18 21:52:49.920790 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:49.920542 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" event={"ID":"f89a5ef2-a724-4862-9b01-5fd8e982271e","Type":"ContainerDied","Data":"d2fc706396d365717fa1f24ccf4773189d8a35bec9949ed59966eef7ab35d22d"} Sep 18 21:52:49.920790 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:49.920756 2567 scope.go:117] "RemoveContainer" containerID="d2fc706396d365717fa1f24ccf4773189d8a35bec9949ed59966eef7ab35d22d" Sep 18 21:52:50.892241 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:50.892200 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:50.892437 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:50.892270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:50.892437 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:50.892366 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:50.892437 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:50.892427 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:52:50.892593 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:50.892445 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc77fcf6-nn9ld: secret "image-registry-tls" not found Sep 18 21:52:50.892593 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:50.892449 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls podName:33de9d4a-7210-4bcf-9570-a06c3953db4d nodeName:}" failed. No retries permitted until 2026-09-18 21:52:54.892432661 +0000 UTC m=+127.594998002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcfr" (UID: "33de9d4a-7210-4bcf-9570-a06c3953db4d") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:50.892593 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:50.892503 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls podName:7900b6fb-5bdc-4be4-835f-e593ecfc42a8 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:54.892483793 +0000 UTC m=+127.595049142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls") pod "image-registry-8fc77fcf6-nn9ld" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8") : secret "image-registry-tls" not found Sep 18 21:52:50.925268 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:50.925245 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/1.log" Sep 18 21:52:50.925814 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:50.925795 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/0.log" Sep 18 21:52:50.925875 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:50.925834 2567 generic.go:356] "Generic (PLEG): container finished" podID="f89a5ef2-a724-4862-9b01-5fd8e982271e" containerID="36bf71ce44aa542d4d3d75c19eb60861b3ecf24b7b95f32c538d0eebf2d7a293" exitCode=255 Sep 18 21:52:50.925875 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:50.925863 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" event={"ID":"f89a5ef2-a724-4862-9b01-5fd8e982271e","Type":"ContainerDied","Data":"36bf71ce44aa542d4d3d75c19eb60861b3ecf24b7b95f32c538d0eebf2d7a293"} Sep 18 21:52:50.925940 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:50.925933 2567 scope.go:117] "RemoveContainer" containerID="d2fc706396d365717fa1f24ccf4773189d8a35bec9949ed59966eef7ab35d22d" Sep 18 21:52:50.926175 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:50.926154 2567 scope.go:117] "RemoveContainer" containerID="36bf71ce44aa542d4d3d75c19eb60861b3ecf24b7b95f32c538d0eebf2d7a293" Sep 18 21:52:50.926365 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:50.926341 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-6pmwb_openshift-console-operator(f89a5ef2-a724-4862-9b01-5fd8e982271e)\"" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" podUID="f89a5ef2-a724-4862-9b01-5fd8e982271e" Sep 18 21:52:51.030552 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.030525 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z6rz5"] Sep 18 21:52:51.032683 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.032668 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.035526 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.035503 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 21:52:51.035526 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.035522 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9mnft\"" Sep 18 21:52:51.035684 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.035505 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 21:52:51.035684 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.035648 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 21:52:51.035764 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.035750 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 21:52:51.044114 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.044091 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z6rz5"] Sep 18 21:52:51.093734 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.093714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.093826 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.093743 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwvxf\" (UniqueName: \"kubernetes.io/projected/01224773-326a-42f9-bc4f-db6fb68d2339-kube-api-access-bwvxf\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.093874 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.093823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.093911 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.093890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01224773-326a-42f9-bc4f-db6fb68d2339-crio-socket\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.093911 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.093907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01224773-326a-42f9-bc4f-db6fb68d2339-data-volume\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.163026 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.162975 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9"] Sep 18 21:52:51.164495 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.164480 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:51.168664 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.168640 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 18 21:52:51.168758 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.168671 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5g8mb\"" Sep 18 21:52:51.168758 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.168692 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 18 21:52:51.175695 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.175674 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9"] Sep 18 21:52:51.195176 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.195152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01224773-326a-42f9-bc4f-db6fb68d2339-crio-socket\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.195273 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.195178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01224773-326a-42f9-bc4f-db6fb68d2339-data-volume\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.195273 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.195199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.195273 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.195215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwvxf\" (UniqueName: \"kubernetes.io/projected/01224773-326a-42f9-bc4f-db6fb68d2339-kube-api-access-bwvxf\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.195411 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.195290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.195411 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.195298 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01224773-326a-42f9-bc4f-db6fb68d2339-crio-socket\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.195411 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.195382 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:51.195531 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.195409 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:51.195531 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.195459 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:51.695440806 +0000 UTC m=+124.398006150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : configmap "kube-rbac-proxy" not found Sep 18 21:52:51.195531 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.195478 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:51.695468743 +0000 UTC m=+124.398034090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:51.195531 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.195494 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01224773-326a-42f9-bc4f-db6fb68d2339-data-volume\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.218206 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.218184 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwvxf\" (UniqueName: \"kubernetes.io/projected/01224773-326a-42f9-bc4f-db6fb68d2339-kube-api-access-bwvxf\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.296438 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.296412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d658fc54-2b1d-4c13-9550-b3932bb8b10a-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:51.296537 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.296446 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:51.396705 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.396674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d658fc54-2b1d-4c13-9550-b3932bb8b10a-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:51.396806 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.396717 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:51.396853 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.396843 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 21:52:51.396906 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.396893 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert podName:d658fc54-2b1d-4c13-9550-b3932bb8b10a nodeName:}" failed. No retries permitted until 2026-09-18 21:52:51.89687983 +0000 UTC m=+124.599445170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-h7wj9" (UID: "d658fc54-2b1d-4c13-9550-b3932bb8b10a") : secret "networking-console-plugin-cert" not found Sep 18 21:52:51.397292 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.397273 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d658fc54-2b1d-4c13-9550-b3932bb8b10a-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:51.698505 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.698475 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.698617 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.698530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:51.698617 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.698588 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:51.698713 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.698641 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:52.698628121 +0000 UTC m=+125.401193468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : configmap "kube-rbac-proxy" not found Sep 18 21:52:51.698713 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.698654 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:51.698713 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.698700 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:52.698682723 +0000 UTC m=+125.401248119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:51.899558 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.899527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:51.899660 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.899624 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 21:52:51.899705 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.899667 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert podName:d658fc54-2b1d-4c13-9550-b3932bb8b10a nodeName:}" failed. No retries permitted until 2026-09-18 21:52:52.899655161 +0000 UTC m=+125.602220502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-h7wj9" (UID: "d658fc54-2b1d-4c13-9550-b3932bb8b10a") : secret "networking-console-plugin-cert" not found Sep 18 21:52:51.930255 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.930232 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/1.log" Sep 18 21:52:51.930631 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:51.930524 2567 scope.go:117] "RemoveContainer" containerID="36bf71ce44aa542d4d3d75c19eb60861b3ecf24b7b95f32c538d0eebf2d7a293" Sep 18 21:52:51.930682 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:51.930664 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-6pmwb_openshift-console-operator(f89a5ef2-a724-4862-9b01-5fd8e982271e)\"" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" podUID="f89a5ef2-a724-4862-9b01-5fd8e982271e" Sep 18 21:52:52.705191 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:52.705161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:52.705321 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:52.705264 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:52.705321 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:52.705310 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:52.705411 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:52.705354 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:52.705411 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:52.705368 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:54.705349576 +0000 UTC m=+127.407914934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:52.705411 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:52.705393 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:54.705380625 +0000 UTC m=+127.407945965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : configmap "kube-rbac-proxy" not found Sep 18 21:52:52.906878 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:52.906838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:52.907031 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:52.907004 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 21:52:52.907103 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:52.907084 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert podName:d658fc54-2b1d-4c13-9550-b3932bb8b10a nodeName:}" failed. No retries permitted until 2026-09-18 21:52:54.907064935 +0000 UTC m=+127.609630278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-h7wj9" (UID: "d658fc54-2b1d-4c13-9550-b3932bb8b10a") : secret "networking-console-plugin-cert" not found Sep 18 21:52:53.172000 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.171976 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jljlf_4e10c295-0617-4e38-b7c8-9c47cd1f651d/dns-node-resolver/0.log" Sep 18 21:52:53.787711 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.787688 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-48g9m_5bbc25d9-a502-4422-a9e7-65be602585e9/node-ca/0.log" Sep 18 21:52:53.798168 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.798139 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c"] Sep 18 21:52:53.800219 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.800203 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" Sep 18 21:52:53.805697 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.805607 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8h8w4\"" Sep 18 21:52:53.805791 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.805761 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 21:52:53.807007 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.806986 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 21:52:53.813167 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.813143 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c"] Sep 18 21:52:53.913496 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:53.913468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8zjb\" (UniqueName: \"kubernetes.io/projected/caadd732-802f-4efb-ab11-20d7c45ec9bc-kube-api-access-n8zjb\") pod \"migrator-76794cbd6c-hs52c\" (UID: \"caadd732-802f-4efb-ab11-20d7c45ec9bc\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" Sep 18 21:52:54.014701 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.014662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8zjb\" (UniqueName: \"kubernetes.io/projected/caadd732-802f-4efb-ab11-20d7c45ec9bc-kube-api-access-n8zjb\") pod \"migrator-76794cbd6c-hs52c\" (UID: \"caadd732-802f-4efb-ab11-20d7c45ec9bc\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" Sep 18 21:52:54.024241 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.024216 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8zjb\" (UniqueName: \"kubernetes.io/projected/caadd732-802f-4efb-ab11-20d7c45ec9bc-kube-api-access-n8zjb\") pod \"migrator-76794cbd6c-hs52c\" (UID: \"caadd732-802f-4efb-ab11-20d7c45ec9bc\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" Sep 18 21:52:54.113848 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.113791 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" Sep 18 21:52:54.389247 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.389051 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c"] Sep 18 21:52:54.391805 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:52:54.391777 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaadd732_802f_4efb_ab11_20d7c45ec9bc.slice/crio-2d8a03285a21501a4af8c5539171b11f7340b01a1c4b3a314d4c379fca696bb5 WatchSource:0}: Error finding container 2d8a03285a21501a4af8c5539171b11f7340b01a1c4b3a314d4c379fca696bb5: Status 404 returned error can't find the container with id 2d8a03285a21501a4af8c5539171b11f7340b01a1c4b3a314d4c379fca696bb5 Sep 18 21:52:54.573269 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.573246 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-49dnr_49dd2dc5-0107-445c-b896-edfd7412d9e2/serve-healthcheck-canary/0.log" Sep 18 21:52:54.720523 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.720495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:54.720629 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.720548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:54.720629 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.720619 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:54.720698 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.720678 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:58.72066293 +0000 UTC m=+131.423228272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : configmap "kube-rbac-proxy" not found Sep 18 21:52:54.720742 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.720702 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:54.720784 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.720773 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:58.720758966 +0000 UTC m=+131.423324329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:54.921427 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.921399 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:54.921564 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.921461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:52:54.921564 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.921556 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 21:52:54.921648 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.921568 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc77fcf6-nn9ld: secret "image-registry-tls" not found Sep 18 21:52:54.921648 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.921601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:52:54.921648 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.921616 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls podName:7900b6fb-5bdc-4be4-835f-e593ecfc42a8 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:02.921599808 +0000 UTC m=+135.624165155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls") pod "image-registry-8fc77fcf6-nn9ld" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8") : secret "image-registry-tls" not found Sep 18 21:52:54.921648 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.921555 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 21:52:54.921833 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.921668 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:54.921833 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.921686 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert podName:d658fc54-2b1d-4c13-9550-b3932bb8b10a nodeName:}" failed. No retries permitted until 2026-09-18 21:52:58.92167095 +0000 UTC m=+131.624236292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-h7wj9" (UID: "d658fc54-2b1d-4c13-9550-b3932bb8b10a") : secret "networking-console-plugin-cert" not found Sep 18 21:52:54.921833 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:54.921705 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls podName:33de9d4a-7210-4bcf-9570-a06c3953db4d nodeName:}" failed. No retries permitted until 2026-09-18 21:53:02.921693847 +0000 UTC m=+135.624259197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-bvcfr" (UID: "33de9d4a-7210-4bcf-9570-a06c3953db4d") : secret "cluster-monitoring-operator-tls" not found Sep 18 21:52:54.939381 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:54.939355 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" event={"ID":"caadd732-802f-4efb-ab11-20d7c45ec9bc","Type":"ContainerStarted","Data":"2d8a03285a21501a4af8c5539171b11f7340b01a1c4b3a314d4c379fca696bb5"} Sep 18 21:52:55.944676 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:55.944636 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" event={"ID":"caadd732-802f-4efb-ab11-20d7c45ec9bc","Type":"ContainerStarted","Data":"c69cbf63ed5511a9195025ece5eb721f7ab703558c2d1d3cb2fb3cb736255a93"} Sep 18 21:52:55.945097 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:55.944700 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" event={"ID":"caadd732-802f-4efb-ab11-20d7c45ec9bc","Type":"ContainerStarted","Data":"489427f588a44aebb4331fd82d872f546b520e8ffe5e9a26b2b34af0baf87977"} Sep 18 21:52:55.964527 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:55.964478 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hs52c" podStartSLOduration=2.053658378 podStartE2EDuration="2.964462685s" totalImagesPullingTime="910.804307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:55.963604383 +0000 UTC m=+128.666169745" watchObservedRunningTime="2026-09-18 21:52:55.964462685 +0000 UTC m=+128.667028114" Sep 18 21:52:57.539853 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:57.539809 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:57.540241 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:57.539881 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:52:57.540296 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:57.540247 2567 scope.go:117] "RemoveContainer" containerID="36bf71ce44aa542d4d3d75c19eb60861b3ecf24b7b95f32c538d0eebf2d7a293" Sep 18 21:52:57.540421 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:57.540397 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-6pmwb_openshift-console-operator(f89a5ef2-a724-4862-9b01-5fd8e982271e)\"" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" podUID="f89a5ef2-a724-4862-9b01-5fd8e982271e" Sep 18 21:52:58.044484 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:58.044452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:52:58.044641 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:58.044609 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 21:52:58.044694 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:58.044670 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs podName:64e7f8a7-840d-487b-a8fd-2bec3675c1a6 nodeName:}" failed. No retries permitted until 2026-09-18 21:55:00.044651836 +0000 UTC m=+252.747217201 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs") pod "network-metrics-daemon-zmxqf" (UID: "64e7f8a7-840d-487b-a8fd-2bec3675c1a6") : secret "metrics-daemon-secret" not found Sep 18 21:52:58.748792 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:58.748763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:58.749194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:58.748850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:52:58.749194 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:58.748914 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:58.749194 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:58.748980 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:06.748963999 +0000 UTC m=+139.451529341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:58.749194 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:58.748919 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:58.749194 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:58.749065 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm podName:01224773-326a-42f9-bc4f-db6fb68d2339 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:06.749051824 +0000 UTC m=+139.451617165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6rz5" (UID: "01224773-326a-42f9-bc4f-db6fb68d2339") : configmap "kube-rbac-proxy" not found Sep 18 21:52:58.949923 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:52:58.949893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:52:58.950067 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:58.950048 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 21:52:58.950149 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:52:58.950119 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert podName:d658fc54-2b1d-4c13-9550-b3932bb8b10a nodeName:}" failed. No retries permitted until 2026-09-18 21:53:06.950105914 +0000 UTC m=+139.652671255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-h7wj9" (UID: "d658fc54-2b1d-4c13-9550-b3932bb8b10a") : secret "networking-console-plugin-cert" not found Sep 18 21:53:02.979214 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:02.979177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:53:02.979709 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:02.979233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:53:02.981973 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:02.981941 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/33de9d4a-7210-4bcf-9570-a06c3953db4d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-bvcfr\" (UID: \"33de9d4a-7210-4bcf-9570-a06c3953db4d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:53:02.982100 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:02.981992 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"image-registry-8fc77fcf6-nn9ld\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:53:03.152195 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.152164 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qctj\"" Sep 18 21:53:03.159735 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.159710 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:53:03.160004 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.159985 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rcrbf\"" Sep 18 21:53:03.165999 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.165972 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" Sep 18 21:53:03.463951 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.463924 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr"] Sep 18 21:53:03.464402 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:03.464372 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33de9d4a_7210_4bcf_9570_a06c3953db4d.slice/crio-d325c74df7076cf386cac72cd5d53622c7c9f6baf0d34c17e7d126ff8d38d0e2 WatchSource:0}: Error finding container d325c74df7076cf386cac72cd5d53622c7c9f6baf0d34c17e7d126ff8d38d0e2: Status 404 returned error can't find the container with id d325c74df7076cf386cac72cd5d53622c7c9f6baf0d34c17e7d126ff8d38d0e2 Sep 18 21:53:03.465113 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.465092 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8fc77fcf6-nn9ld"] Sep 18 21:53:03.465279 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:03.465255 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7900b6fb_5bdc_4be4_835f_e593ecfc42a8.slice/crio-8e382af26b946609bd2538dafe35f0b8030ad7eacda581103d656e229f190c35 WatchSource:0}: Error finding container 8e382af26b946609bd2538dafe35f0b8030ad7eacda581103d656e229f190c35: Status 404 returned error can't find the container with id 8e382af26b946609bd2538dafe35f0b8030ad7eacda581103d656e229f190c35 Sep 18 21:53:03.973830 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.973796 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" event={"ID":"33de9d4a-7210-4bcf-9570-a06c3953db4d","Type":"ContainerStarted","Data":"d325c74df7076cf386cac72cd5d53622c7c9f6baf0d34c17e7d126ff8d38d0e2"} Sep 18 21:53:03.975462 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.975426 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" event={"ID":"7900b6fb-5bdc-4be4-835f-e593ecfc42a8","Type":"ContainerStarted","Data":"56fa66c7133e3d35851fb9b2ff1b987f2d6175575027393e7473e65b8abd8947"} Sep 18 21:53:03.975602 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.975478 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" event={"ID":"7900b6fb-5bdc-4be4-835f-e593ecfc42a8","Type":"ContainerStarted","Data":"8e382af26b946609bd2538dafe35f0b8030ad7eacda581103d656e229f190c35"} Sep 18 21:53:03.975669 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:03.975644 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:53:04.003921 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:04.003881 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" podStartSLOduration=17.003868568 podStartE2EDuration="17.003868568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:04.003096697 +0000 UTC m=+136.705662063" watchObservedRunningTime="2026-09-18 21:53:04.003868568 +0000 UTC m=+136.706433931" Sep 18 21:53:05.985893 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:05.985851 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" event={"ID":"33de9d4a-7210-4bcf-9570-a06c3953db4d","Type":"ContainerStarted","Data":"cc1f973c4c98c11a321f18fcd93a7753790148fd974534698c9e90bdacd1ce0e"} Sep 18 21:53:06.006737 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:06.006685 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-bvcfr" podStartSLOduration=17.420544488 podStartE2EDuration="19.006667229s" totalImagesPullingTime="1.586122741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:06.005408189 +0000 UTC m=+138.707973553" watchObservedRunningTime="2026-09-18 21:53:06.006667229 +0000 UTC m=+138.709232673" Sep 18 21:53:06.808026 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:06.807988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:53:06.808213 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:06.808043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:53:06.808542 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:06.808519 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01224773-326a-42f9-bc4f-db6fb68d2339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:53:06.810681 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:06.810654 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01224773-326a-42f9-bc4f-db6fb68d2339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6rz5\" (UID: \"01224773-326a-42f9-bc4f-db6fb68d2339\") " pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:53:06.942106 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:06.942068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z6rz5" Sep 18 21:53:07.009638 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.009604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:53:07.012110 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.012088 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d658fc54-2b1d-4c13-9550-b3932bb8b10a-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-h7wj9\" (UID: \"d658fc54-2b1d-4c13-9550-b3932bb8b10a\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:53:07.076090 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.076041 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" Sep 18 21:53:07.221708 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.221678 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z6rz5"] Sep 18 21:53:07.225683 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:07.225660 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01224773_326a_42f9_bc4f_db6fb68d2339.slice/crio-4083615ce34ae35a0c6e4e9145d6f6e18196a68ea6f19aa92df69bec43370739 WatchSource:0}: Error finding container 4083615ce34ae35a0c6e4e9145d6f6e18196a68ea6f19aa92df69bec43370739: Status 404 returned error can't find the container with id 4083615ce34ae35a0c6e4e9145d6f6e18196a68ea6f19aa92df69bec43370739 Sep 18 21:53:07.345317 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.345262 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9"] Sep 18 21:53:07.347766 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:07.347743 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd658fc54_2b1d_4c13_9550_b3932bb8b10a.slice/crio-b04452aada74b69c300bdbb2eb855c931aac56e0079186f87bb74f14e0512b53 WatchSource:0}: Error finding container b04452aada74b69c300bdbb2eb855c931aac56e0079186f87bb74f14e0512b53: Status 404 returned error can't find the container with id b04452aada74b69c300bdbb2eb855c931aac56e0079186f87bb74f14e0512b53 Sep 18 21:53:07.996272 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.996238 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z6rz5" event={"ID":"01224773-326a-42f9-bc4f-db6fb68d2339","Type":"ContainerStarted","Data":"6ec5ee33a7a7b0fdb90ff91fcffb205bc785e2762d9a29aa28b348692a79b063"} Sep 18 21:53:07.996400 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.996303 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z6rz5" event={"ID":"01224773-326a-42f9-bc4f-db6fb68d2339","Type":"ContainerStarted","Data":"12d953066f7b8eab68818b119fed4db6514344de4fbb6c669f90f0dcf669d491"} Sep 18 21:53:07.996400 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.996334 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z6rz5" event={"ID":"01224773-326a-42f9-bc4f-db6fb68d2339","Type":"ContainerStarted","Data":"4083615ce34ae35a0c6e4e9145d6f6e18196a68ea6f19aa92df69bec43370739"} Sep 18 21:53:07.997496 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:07.997474 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" event={"ID":"d658fc54-2b1d-4c13-9550-b3932bb8b10a","Type":"ContainerStarted","Data":"b04452aada74b69c300bdbb2eb855c931aac56e0079186f87bb74f14e0512b53"} Sep 18 21:53:09.002853 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:09.002822 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" event={"ID":"d658fc54-2b1d-4c13-9550-b3932bb8b10a","Type":"ContainerStarted","Data":"ff370686a5e8ecb98efc792cddce3def5095ec60d90191481032608426819e8a"} Sep 18 21:53:09.020153 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:09.020069 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-h7wj9" podStartSLOduration=17.00070818 podStartE2EDuration="18.020052413s" totalImagesPullingTime="1.019344233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:09.019848936 +0000 UTC m=+141.722414302" watchObservedRunningTime="2026-09-18 21:53:09.020052413 +0000 UTC m=+141.722617777" Sep 18 21:53:09.390679 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:09.390654 2567 scope.go:117] "RemoveContainer" containerID="36bf71ce44aa542d4d3d75c19eb60861b3ecf24b7b95f32c538d0eebf2d7a293" Sep 18 21:53:10.009167 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:10.009145 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/2.log" Sep 18 21:53:10.009607 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:10.009563 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/1.log" Sep 18 21:53:10.009678 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:10.009601 2567 generic.go:356] "Generic (PLEG): container finished" podID="f89a5ef2-a724-4862-9b01-5fd8e982271e" containerID="f69cfb4fb02a069f51a131df9547dee0a8312521e5f7ba18fe9f009eccbea333" exitCode=255 Sep 18 21:53:10.009678 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:10.009669 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" event={"ID":"f89a5ef2-a724-4862-9b01-5fd8e982271e","Type":"ContainerDied","Data":"f69cfb4fb02a069f51a131df9547dee0a8312521e5f7ba18fe9f009eccbea333"} Sep 18 21:53:10.009779 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:10.009741 2567 scope.go:117] "RemoveContainer" containerID="36bf71ce44aa542d4d3d75c19eb60861b3ecf24b7b95f32c538d0eebf2d7a293" Sep 18 21:53:10.010062 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:10.010037 2567 scope.go:117] "RemoveContainer" containerID="f69cfb4fb02a069f51a131df9547dee0a8312521e5f7ba18fe9f009eccbea333" Sep 18 21:53:10.010254 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:10.010230 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-6pmwb_openshift-console-operator(f89a5ef2-a724-4862-9b01-5fd8e982271e)\"" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" podUID="f89a5ef2-a724-4862-9b01-5fd8e982271e" Sep 18 21:53:10.011991 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:10.011964 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z6rz5" event={"ID":"01224773-326a-42f9-bc4f-db6fb68d2339","Type":"ContainerStarted","Data":"c1885184d07f89a64cf3ec445415c69460986fdcf71e42b3953d2fe41a0c1748"} Sep 18 21:53:10.053545 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:10.053507 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z6rz5" podStartSLOduration=17.188155272 podStartE2EDuration="19.053493513s" totalImagesPullingTime="1.865338241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:52:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:10.052291051 +0000 UTC m=+142.754856414" watchObservedRunningTime="2026-09-18 21:53:10.053493513 +0000 UTC m=+142.756058873" Sep 18 21:53:11.016359 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:11.016335 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/2.log" Sep 18 21:53:12.927239 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:12.927205 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm"] Sep 18 21:53:12.931597 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:12.931579 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" Sep 18 21:53:12.939403 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:12.939383 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 21:53:12.939403 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:12.939395 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zkf7f\"" Sep 18 21:53:12.949615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:12.949588 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm"] Sep 18 21:53:12.971093 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:12.971064 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8fc77fcf6-nn9ld"] Sep 18 21:53:13.030590 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.030568 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76f5df994f-rqfbr"] Sep 18 21:53:13.033345 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.033332 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.055208 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.055187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97dd2c53-253d-44e5-b79b-21cab36892c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-phllm\" (UID: \"97dd2c53-253d-44e5-b79b-21cab36892c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" Sep 18 21:53:13.082083 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.082061 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76f5df994f-rqfbr"] Sep 18 21:53:13.156301 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b38ac3-a6e2-4bbd-a850-3537f1d67696-installation-pull-secrets\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.156396 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156329 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b38ac3-a6e2-4bbd-a850-3537f1d67696-image-registry-private-configuration\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.156396 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-bound-sa-token\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.156396 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b38ac3-a6e2-4bbd-a850-3537f1d67696-ca-trust-extracted\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.156396 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156389 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b38ac3-a6e2-4bbd-a850-3537f1d67696-registry-certificates\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.156594 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156405 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b38ac3-a6e2-4bbd-a850-3537f1d67696-trusted-ca\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.156594 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bldjp\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-kube-api-access-bldjp\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.156594 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-registry-tls\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.156594 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.156543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97dd2c53-253d-44e5-b79b-21cab36892c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-phllm\" (UID: \"97dd2c53-253d-44e5-b79b-21cab36892c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" Sep 18 21:53:13.158896 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.158874 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97dd2c53-253d-44e5-b79b-21cab36892c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-phllm\" (UID: \"97dd2c53-253d-44e5-b79b-21cab36892c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" Sep 18 21:53:13.239816 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.239765 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" Sep 18 21:53:13.257868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.257842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b38ac3-a6e2-4bbd-a850-3537f1d67696-installation-pull-secrets\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.257957 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.257911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b38ac3-a6e2-4bbd-a850-3537f1d67696-image-registry-private-configuration\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.257957 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.257944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-bound-sa-token\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.258041 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.257974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b38ac3-a6e2-4bbd-a850-3537f1d67696-ca-trust-extracted\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.258041 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.257999 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b38ac3-a6e2-4bbd-a850-3537f1d67696-registry-certificates\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.258041 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.258025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b38ac3-a6e2-4bbd-a850-3537f1d67696-trusted-ca\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.258218 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.258054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bldjp\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-kube-api-access-bldjp\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.258218 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.258097 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-registry-tls\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.258845 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.258663 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b38ac3-a6e2-4bbd-a850-3537f1d67696-ca-trust-extracted\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.258988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.258966 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b38ac3-a6e2-4bbd-a850-3537f1d67696-registry-certificates\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.259062 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.259041 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b38ac3-a6e2-4bbd-a850-3537f1d67696-trusted-ca\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.260703 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.260679 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-registry-tls\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.260981 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.260956 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b38ac3-a6e2-4bbd-a850-3537f1d67696-image-registry-private-configuration\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.260981 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.260975 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b38ac3-a6e2-4bbd-a850-3537f1d67696-installation-pull-secrets\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.276382 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.276355 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-bound-sa-token\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.277367 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.277350 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bldjp\" (UniqueName: \"kubernetes.io/projected/77b38ac3-a6e2-4bbd-a850-3537f1d67696-kube-api-access-bldjp\") pod \"image-registry-76f5df994f-rqfbr\" (UID: \"77b38ac3-a6e2-4bbd-a850-3537f1d67696\") " pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.341005 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.340974 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:13.550946 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.550922 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm"] Sep 18 21:53:13.553016 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:13.552991 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97dd2c53_253d_44e5_b79b_21cab36892c7.slice/crio-2828ccb236cfe7b41033f6a4cd860fb07e156e419ed882083fd9e64efaa21c49 WatchSource:0}: Error finding container 2828ccb236cfe7b41033f6a4cd860fb07e156e419ed882083fd9e64efaa21c49: Status 404 returned error can't find the container with id 2828ccb236cfe7b41033f6a4cd860fb07e156e419ed882083fd9e64efaa21c49 Sep 18 21:53:13.627159 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:13.627118 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76f5df994f-rqfbr"] Sep 18 21:53:13.629496 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:13.629472 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b38ac3_a6e2_4bbd_a850_3537f1d67696.slice/crio-bc0e3b004e4dc3c1ed9be548e4fbd7d8281f414490400ddaa5a223e7324a2f2c WatchSource:0}: Error finding container bc0e3b004e4dc3c1ed9be548e4fbd7d8281f414490400ddaa5a223e7324a2f2c: Status 404 returned error can't find the container with id bc0e3b004e4dc3c1ed9be548e4fbd7d8281f414490400ddaa5a223e7324a2f2c Sep 18 21:53:14.028198 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:14.028156 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" event={"ID":"97dd2c53-253d-44e5-b79b-21cab36892c7","Type":"ContainerStarted","Data":"2828ccb236cfe7b41033f6a4cd860fb07e156e419ed882083fd9e64efaa21c49"} Sep 18 21:53:14.029950 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:14.029922 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" event={"ID":"77b38ac3-a6e2-4bbd-a850-3537f1d67696","Type":"ContainerStarted","Data":"2ae4c20743304ace1caceec3fe6672428975488e5c4b4915a5b0e2da58b115fc"} Sep 18 21:53:14.030083 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:14.029965 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" event={"ID":"77b38ac3-a6e2-4bbd-a850-3537f1d67696","Type":"ContainerStarted","Data":"bc0e3b004e4dc3c1ed9be548e4fbd7d8281f414490400ddaa5a223e7324a2f2c"} Sep 18 21:53:14.030083 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:14.030058 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:14.090450 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:14.090403 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" podStartSLOduration=1.09038476 podStartE2EDuration="1.09038476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:14.089952338 +0000 UTC m=+146.792517700" watchObservedRunningTime="2026-09-18 21:53:14.09038476 +0000 UTC m=+146.792950123" Sep 18 21:53:15.035615 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:15.035575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" event={"ID":"97dd2c53-253d-44e5-b79b-21cab36892c7","Type":"ContainerStarted","Data":"c584719dd38094e34c01358d945890fb96bf362fc5864a6535f06d6f7d74982e"} Sep 18 21:53:15.036100 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:15.035656 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" Sep 18 21:53:15.040924 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:15.040894 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" Sep 18 21:53:15.091244 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:15.091196 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-phllm" podStartSLOduration=2.121031382 podStartE2EDuration="3.091180598s" totalImagesPullingTime="970.149216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:15.065276286 +0000 UTC m=+147.767841649" watchObservedRunningTime="2026-09-18 21:53:15.091180598 +0000 UTC m=+147.793745960" Sep 18 21:53:17.540452 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:17.540412 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:53:17.540876 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:17.540493 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:53:17.540876 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:17.540774 2567 scope.go:117] "RemoveContainer" containerID="f69cfb4fb02a069f51a131df9547dee0a8312521e5f7ba18fe9f009eccbea333" Sep 18 21:53:17.540944 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:17.540925 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-6pmwb_openshift-console-operator(f89a5ef2-a724-4862-9b01-5fd8e982271e)\"" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" podUID="f89a5ef2-a724-4862-9b01-5fd8e982271e" Sep 18 21:53:22.147373 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.147341 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kmwqr"] Sep 18 21:53:22.152494 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.152474 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.156098 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.156062 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 21:53:22.156229 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.156205 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 21:53:22.157381 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.157305 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 21:53:22.157490 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.157316 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 21:53:22.157490 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.157340 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m626z\"" Sep 18 21:53:22.219518 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219495 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-accelerators-collector-config\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.219605 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-tls\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.219605 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw9hs\" (UniqueName: \"kubernetes.io/projected/223f9dd9-608b-4e28-962e-938e14cb5229-kube-api-access-zw9hs\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.219605 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219557 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-wtmp\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.219605 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-sys\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.219762 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-textfile\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.219762 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.219762 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/223f9dd9-608b-4e28-962e-938e14cb5229-metrics-client-ca\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.219762 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.219732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-root\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.320837 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.320811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/223f9dd9-608b-4e28-962e-938e14cb5229-metrics-client-ca\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.320974 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.320957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-root\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321038 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.320996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-accelerators-collector-config\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321038 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-tls\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321163 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw9hs\" (UniqueName: \"kubernetes.io/projected/223f9dd9-608b-4e28-962e-938e14cb5229-kube-api-access-zw9hs\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321163 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321067 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-root\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321163 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321079 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-wtmp\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321163 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-sys\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321348 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321170 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-textfile\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321348 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321200 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321348 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321231 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-wtmp\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321348 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321290 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/223f9dd9-608b-4e28-962e-938e14cb5229-sys\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321518 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321495 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-textfile\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321591 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321568 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-accelerators-collector-config\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.321724 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.321709 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/223f9dd9-608b-4e28-962e-938e14cb5229-metrics-client-ca\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.323425 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.323407 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-tls\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.323560 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.323541 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/223f9dd9-608b-4e28-962e-938e14cb5229-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.335996 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.335969 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw9hs\" (UniqueName: \"kubernetes.io/projected/223f9dd9-608b-4e28-962e-938e14cb5229-kube-api-access-zw9hs\") pod \"node-exporter-kmwqr\" (UID: \"223f9dd9-608b-4e28-962e-938e14cb5229\") " pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.461602 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.461577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kmwqr" Sep 18 21:53:22.473110 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:22.473088 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223f9dd9_608b_4e28_962e_938e14cb5229.slice/crio-714dabda2ee865c1b50b52d3f38d3e9e297592421306a252db686b456610c0e0 WatchSource:0}: Error finding container 714dabda2ee865c1b50b52d3f38d3e9e297592421306a252db686b456610c0e0: Status 404 returned error can't find the container with id 714dabda2ee865c1b50b52d3f38d3e9e297592421306a252db686b456610c0e0 Sep 18 21:53:22.977383 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.977344 2567 patch_prober.go:28] interesting pod/image-registry-8fc77fcf6-nn9ld container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 21:53:22.977519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:22.977403 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" podUID="7900b6fb-5bdc-4be4-835f-e593ecfc42a8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 21:53:23.066486 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.066449 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kmwqr" event={"ID":"223f9dd9-608b-4e28-962e-938e14cb5229","Type":"ContainerStarted","Data":"714dabda2ee865c1b50b52d3f38d3e9e297592421306a252db686b456610c0e0"} Sep 18 21:53:23.341052 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.340974 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:53:23.344696 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.344674 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.348201 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.348180 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 21:53:23.348390 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.348300 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 21:53:23.348503 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.348418 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 21:53:23.348503 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.348432 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 21:53:23.348503 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.348425 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 21:53:23.349084 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.349063 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 21:53:23.349084 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.349077 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 21:53:23.349242 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.349112 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 21:53:23.349242 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.349112 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 21:53:23.349242 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.349067 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x8svv\"" Sep 18 21:53:23.384838 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.384813 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:53:23.429346 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429322 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-config-out\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429456 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429456 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429456 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92vfg\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-kube-api-access-92vfg\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429616 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429616 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429616 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429855 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429855 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429855 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429855 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429855 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.429855 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.429790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-web-config\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.530950 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.530926 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531065 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.530962 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531065 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.530992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531065 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531250 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531314 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531254 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531314 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-web-config\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531422 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531339 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-config-out\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531422 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.531526 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:23.531462 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 18 21:53:23.531580 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:23.531530 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls podName:4a52754c-3460-410b-8ab2-a44a7dae966c nodeName:}" failed. No retries permitted until 2026-09-18 21:53:24.031498794 +0000 UTC m=+156.734064152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c") : secret "alertmanager-main-tls" not found Sep 18 21:53:23.533451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.533451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531768 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92vfg\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-kube-api-access-92vfg\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.533451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.533451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.533451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.531992 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.533451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.532222 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.533451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.533337 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.533825 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.533700 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.533825 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.533742 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.534149 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.534106 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.534803 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.534784 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.535084 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.535060 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-web-config\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.535673 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.535656 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.535744 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.535684 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-config-out\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.535984 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.535970 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:23.542861 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:23.542840 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92vfg\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-kube-api-access-92vfg\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:24.037003 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:24.036974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:24.039069 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:24.039043 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:24.071858 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:24.071832 2567 generic.go:356] "Generic (PLEG): container finished" podID="223f9dd9-608b-4e28-962e-938e14cb5229" containerID="bdb51671af1a12b2f6daa3dbbfc7835738f166c7d812e6fe734895bba8888291" exitCode=0 Sep 18 21:53:24.071936 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:24.071883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kmwqr" event={"ID":"223f9dd9-608b-4e28-962e-938e14cb5229","Type":"ContainerDied","Data":"bdb51671af1a12b2f6daa3dbbfc7835738f166c7d812e6fe734895bba8888291"} Sep 18 21:53:24.254979 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:24.254953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:53:24.538294 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:24.538272 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:53:24.540310 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:24.540279 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a52754c_3460_410b_8ab2_a44a7dae966c.slice/crio-c8d5dec37f07eec03449d74d1c24f4365f3a369a90454fd66486e77366861275 WatchSource:0}: Error finding container c8d5dec37f07eec03449d74d1c24f4365f3a369a90454fd66486e77366861275: Status 404 returned error can't find the container with id c8d5dec37f07eec03449d74d1c24f4365f3a369a90454fd66486e77366861275 Sep 18 21:53:25.079308 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:25.079214 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kmwqr" event={"ID":"223f9dd9-608b-4e28-962e-938e14cb5229","Type":"ContainerStarted","Data":"39504377c2a04016caa5baae54baaf49c2b3049d0ff6a4d6dccbd7f1c534a446"} Sep 18 21:53:25.079308 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:25.079276 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kmwqr" event={"ID":"223f9dd9-608b-4e28-962e-938e14cb5229","Type":"ContainerStarted","Data":"46cbc3cd36f184f77ca0129a9032e8ef202763118907ad4b1e07919936362707"} Sep 18 21:53:25.081008 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:25.080975 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerStarted","Data":"c8d5dec37f07eec03449d74d1c24f4365f3a369a90454fd66486e77366861275"} Sep 18 21:53:25.219061 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:25.219027 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6p9zr" podUID="ad686e52-0160-4170-83f0-d800df399ba6" Sep 18 21:53:25.422769 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:25.422733 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zmxqf" podUID="64e7f8a7-840d-487b-a8fd-2bec3675c1a6" Sep 18 21:53:26.086815 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.086782 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerID="d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6" exitCode=0 Sep 18 21:53:26.087178 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.086889 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerDied","Data":"d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6"} Sep 18 21:53:26.087178 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.086940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p9zr" Sep 18 21:53:26.123663 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.123620 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kmwqr" podStartSLOduration=3.145578111 podStartE2EDuration="4.123607204s" totalImagesPullingTime="917.964082ms" totalInitContainerRuntime="60.065011ms" isStatefulPod=true podCreationTimestamp="2026-09-18 21:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:25.108938701 +0000 UTC m=+157.811504065" watchObservedRunningTime="2026-09-18 21:53:26.123607204 +0000 UTC m=+158.826172565" Sep 18 21:53:26.484460 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.484437 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d7474ddc7-rjmr8"] Sep 18 21:53:26.487977 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.487963 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.491312 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.491238 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 21:53:26.491312 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.491238 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 21:53:26.491312 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.491274 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cdb5m\"" Sep 18 21:53:26.491312 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.491238 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 21:53:26.491601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.491573 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1dc18vgdnqet5\"" Sep 18 21:53:26.492289 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.492265 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 21:53:26.499950 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.499927 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d7474ddc7-rjmr8"] Sep 18 21:53:26.659383 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.659357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gp6q\" (UniqueName: \"kubernetes.io/projected/4d4a1abb-d264-4618-abad-2cf6f3517fc5-kube-api-access-5gp6q\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.659519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.659401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-secret-metrics-server-client-certs\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.659519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.659475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d4a1abb-d264-4618-abad-2cf6f3517fc5-audit-log\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.659627 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.659533 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d4a1abb-d264-4618-abad-2cf6f3517fc5-metrics-server-audit-profiles\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.659627 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.659573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-secret-metrics-server-tls\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.659627 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.659602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d4a1abb-d264-4618-abad-2cf6f3517fc5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.659780 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.659631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-client-ca-bundle\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.760573 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.760516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-secret-metrics-server-client-certs\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.760573 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.760559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d4a1abb-d264-4618-abad-2cf6f3517fc5-audit-log\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.760714 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.760582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d4a1abb-d264-4618-abad-2cf6f3517fc5-metrics-server-audit-profiles\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.760714 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.760611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-secret-metrics-server-tls\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.760714 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.760637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d4a1abb-d264-4618-abad-2cf6f3517fc5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.760714 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.760661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-client-ca-bundle\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.760914 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.760790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gp6q\" (UniqueName: \"kubernetes.io/projected/4d4a1abb-d264-4618-abad-2cf6f3517fc5-kube-api-access-5gp6q\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.760992 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.760971 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d4a1abb-d264-4618-abad-2cf6f3517fc5-audit-log\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.761439 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.761417 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d4a1abb-d264-4618-abad-2cf6f3517fc5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.761741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.761720 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d4a1abb-d264-4618-abad-2cf6f3517fc5-metrics-server-audit-profiles\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.763012 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.762989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-secret-metrics-server-client-certs\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.763118 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.763097 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-client-ca-bundle\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.763362 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.763346 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d4a1abb-d264-4618-abad-2cf6f3517fc5-secret-metrics-server-tls\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.776063 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.776041 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gp6q\" (UniqueName: \"kubernetes.io/projected/4d4a1abb-d264-4618-abad-2cf6f3517fc5-kube-api-access-5gp6q\") pod \"metrics-server-6d7474ddc7-rjmr8\" (UID: \"4d4a1abb-d264-4618-abad-2cf6f3517fc5\") " pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.798572 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.798549 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:26.831195 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.831167 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2"] Sep 18 21:53:26.835410 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.835393 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:26.838939 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.838917 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-v4n7x\"" Sep 18 21:53:26.840456 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.839341 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 21:53:26.846167 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.846084 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2"] Sep 18 21:53:26.962214 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.962191 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2cff06c-ca17-406d-b4c2-802e81913a03-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-hh2r2\" (UID: \"c2cff06c-ca17-406d-b4c2-802e81913a03\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:26.962346 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:26.962291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bfz\" (UniqueName: \"kubernetes.io/projected/c2cff06c-ca17-406d-b4c2-802e81913a03-kube-api-access-s2bfz\") pod \"monitoring-plugin-5984459ff8-hh2r2\" (UID: \"c2cff06c-ca17-406d-b4c2-802e81913a03\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:27.063671 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:27.063605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2cff06c-ca17-406d-b4c2-802e81913a03-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-hh2r2\" (UID: \"c2cff06c-ca17-406d-b4c2-802e81913a03\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:27.063862 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:27.063836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bfz\" (UniqueName: \"kubernetes.io/projected/c2cff06c-ca17-406d-b4c2-802e81913a03-kube-api-access-s2bfz\") pod \"monitoring-plugin-5984459ff8-hh2r2\" (UID: \"c2cff06c-ca17-406d-b4c2-802e81913a03\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:27.063862 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:27.063853 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 18 21:53:27.064016 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:27.063924 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2cff06c-ca17-406d-b4c2-802e81913a03-monitoring-plugin-cert podName:c2cff06c-ca17-406d-b4c2-802e81913a03 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:27.563904176 +0000 UTC m=+160.266469532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c2cff06c-ca17-406d-b4c2-802e81913a03-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-hh2r2" (UID: "c2cff06c-ca17-406d-b4c2-802e81913a03") : secret "monitoring-plugin-cert" not found Sep 18 21:53:27.080472 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:27.080447 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bfz\" (UniqueName: \"kubernetes.io/projected/c2cff06c-ca17-406d-b4c2-802e81913a03-kube-api-access-s2bfz\") pod \"monitoring-plugin-5984459ff8-hh2r2\" (UID: \"c2cff06c-ca17-406d-b4c2-802e81913a03\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:27.085158 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:27.085119 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d7474ddc7-rjmr8"] Sep 18 21:53:27.391920 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:27.391855 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4a1abb_d264_4618_abad_2cf6f3517fc5.slice/crio-a31d54d3ab796d82c7aa00780cf3c31ccc32d76247b241478af47b33db01e4ee WatchSource:0}: Error finding container a31d54d3ab796d82c7aa00780cf3c31ccc32d76247b241478af47b33db01e4ee: Status 404 returned error can't find the container with id a31d54d3ab796d82c7aa00780cf3c31ccc32d76247b241478af47b33db01e4ee Sep 18 21:53:27.567990 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:27.567963 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2cff06c-ca17-406d-b4c2-802e81913a03-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-hh2r2\" (UID: \"c2cff06c-ca17-406d-b4c2-802e81913a03\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:27.570053 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:27.570031 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c2cff06c-ca17-406d-b4c2-802e81913a03-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-hh2r2\" (UID: \"c2cff06c-ca17-406d-b4c2-802e81913a03\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:27.749712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:27.749691 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:28.033301 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:28.033264 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2"] Sep 18 21:53:28.035399 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:28.035370 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2cff06c_ca17_406d_b4c2_802e81913a03.slice/crio-0f412fc00952489fcc7ae6fe395157dc8da9ca04a98beafa80b5d2e69f466c55 WatchSource:0}: Error finding container 0f412fc00952489fcc7ae6fe395157dc8da9ca04a98beafa80b5d2e69f466c55: Status 404 returned error can't find the container with id 0f412fc00952489fcc7ae6fe395157dc8da9ca04a98beafa80b5d2e69f466c55 Sep 18 21:53:28.098017 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:28.097984 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerStarted","Data":"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06"} Sep 18 21:53:28.098144 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:28.098066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerStarted","Data":"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11"} Sep 18 21:53:28.098144 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:28.098109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerStarted","Data":"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c"} Sep 18 21:53:28.098233 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:28.098166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerStarted","Data":"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5"} Sep 18 21:53:28.098233 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:28.098204 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerStarted","Data":"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d"} Sep 18 21:53:28.099322 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:28.099298 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" event={"ID":"c2cff06c-ca17-406d-b4c2-802e81913a03","Type":"ContainerStarted","Data":"0f412fc00952489fcc7ae6fe395157dc8da9ca04a98beafa80b5d2e69f466c55"} Sep 18 21:53:28.100590 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:28.100565 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" event={"ID":"4d4a1abb-d264-4618-abad-2cf6f3517fc5","Type":"ContainerStarted","Data":"a31d54d3ab796d82c7aa00780cf3c31ccc32d76247b241478af47b33db01e4ee"} Sep 18 21:53:29.111833 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:29.111751 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerStarted","Data":"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501"} Sep 18 21:53:29.113442 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:29.113416 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" event={"ID":"4d4a1abb-d264-4618-abad-2cf6f3517fc5","Type":"ContainerStarted","Data":"f93f175fe87322683a7e69391bd8d68a5f83ef179d0a692bf548ab33d859422c"} Sep 18 21:53:29.149018 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:29.148755 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.799979723 podStartE2EDuration="6.148737593s" totalImagesPullingTime="3.333740442s" totalInitContainerRuntime="15.017428ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:29.146467169 +0000 UTC m=+161.849032531" watchObservedRunningTime="2026-09-18 21:53:29.148737593 +0000 UTC m=+161.851302957" Sep 18 21:53:29.172418 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:29.172356 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" podStartSLOduration=1.77681986 podStartE2EDuration="3.172337489s" totalImagesPullingTime="1.395517629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:29.170858133 +0000 UTC m=+161.873423494" watchObservedRunningTime="2026-09-18 21:53:29.172337489 +0000 UTC m=+161.874902852" Sep 18 21:53:29.390928 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:29.390853 2567 scope.go:117] "RemoveContainer" containerID="f69cfb4fb02a069f51a131df9547dee0a8312521e5f7ba18fe9f009eccbea333" Sep 18 21:53:29.391083 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:53:29.391023 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-6pmwb_openshift-console-operator(f89a5ef2-a724-4862-9b01-5fd8e982271e)\"" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" podUID="f89a5ef2-a724-4862-9b01-5fd8e982271e" Sep 18 21:53:30.092656 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.092623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:53:30.094852 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.094833 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad686e52-0160-4170-83f0-d800df399ba6-metrics-tls\") pod \"dns-default-6p9zr\" (UID: \"ad686e52-0160-4170-83f0-d800df399ba6\") " pod="openshift-dns/dns-default-6p9zr" Sep 18 21:53:30.120823 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.120789 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" event={"ID":"c2cff06c-ca17-406d-b4c2-802e81913a03","Type":"ContainerStarted","Data":"2e0b20b424bd61de92f23976eaa11498545109245ca81ed30e8d5b6d605356a0"} Sep 18 21:53:30.121203 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.121152 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:30.125471 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.125449 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" Sep 18 21:53:30.140257 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.140214 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hh2r2" podStartSLOduration=2.596439825 podStartE2EDuration="4.140199336s" totalImagesPullingTime="1.543759511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:30.139340126 +0000 UTC m=+162.841905500" watchObservedRunningTime="2026-09-18 21:53:30.140199336 +0000 UTC m=+162.842764697" Sep 18 21:53:30.291237 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.291211 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-np4sp\"" Sep 18 21:53:30.299004 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.298984 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6p9zr" Sep 18 21:53:30.567750 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:30.567718 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6p9zr"] Sep 18 21:53:30.570544 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:30.570502 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad686e52_0160_4170_83f0_d800df399ba6.slice/crio-c0acd3a36427a44d5b74bff146c23ae74a1dd1d63e9af61d4551c2225fe5548f WatchSource:0}: Error finding container c0acd3a36427a44d5b74bff146c23ae74a1dd1d63e9af61d4551c2225fe5548f: Status 404 returned error can't find the container with id c0acd3a36427a44d5b74bff146c23ae74a1dd1d63e9af61d4551c2225fe5548f Sep 18 21:53:31.126567 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:31.126490 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p9zr" event={"ID":"ad686e52-0160-4170-83f0-d800df399ba6","Type":"ContainerStarted","Data":"c0acd3a36427a44d5b74bff146c23ae74a1dd1d63e9af61d4551c2225fe5548f"} Sep 18 21:53:32.976295 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:32.976266 2567 patch_prober.go:28] interesting pod/image-registry-8fc77fcf6-nn9ld container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 21:53:32.976702 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:32.976314 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" podUID="7900b6fb-5bdc-4be4-835f-e593ecfc42a8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 21:53:33.137716 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:33.137681 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p9zr" event={"ID":"ad686e52-0160-4170-83f0-d800df399ba6","Type":"ContainerStarted","Data":"d396ddc08a8853b0fc347e9b3f182a9f1db22f267cc18c0aa0e64ba0d5f3d3ae"} Sep 18 21:53:33.137834 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:33.137736 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6p9zr" event={"ID":"ad686e52-0160-4170-83f0-d800df399ba6","Type":"ContainerStarted","Data":"37066e8b1bc2db1185cdece6dbe3cb51870448ca348ba4b1064d88f1007d545d"} Sep 18 21:53:33.137834 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:33.137797 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6p9zr" Sep 18 21:53:33.344847 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:33.344783 2567 patch_prober.go:28] interesting pod/image-registry-76f5df994f-rqfbr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 21:53:33.344847 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:33.344829 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" podUID="77b38ac3-a6e2-4bbd-a850-3537f1d67696" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 21:53:35.040445 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:35.040413 2567 patch_prober.go:28] interesting pod/image-registry-76f5df994f-rqfbr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 21:53:35.040808 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:35.040461 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" podUID="77b38ac3-a6e2-4bbd-a850-3537f1d67696" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 21:53:36.389241 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:36.389212 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:53:37.988906 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:37.988869 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" podUID="7900b6fb-5bdc-4be4-835f-e593ecfc42a8" containerName="registry" containerID="cri-o://56fa66c7133e3d35851fb9b2ff1b987f2d6175575027393e7473e65b8abd8947" gracePeriod=30 Sep 18 21:53:38.160699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.160667 2567 generic.go:356] "Generic (PLEG): container finished" podID="7900b6fb-5bdc-4be4-835f-e593ecfc42a8" containerID="56fa66c7133e3d35851fb9b2ff1b987f2d6175575027393e7473e65b8abd8947" exitCode=0 Sep 18 21:53:38.160806 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.160738 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" event={"ID":"7900b6fb-5bdc-4be4-835f-e593ecfc42a8","Type":"ContainerDied","Data":"56fa66c7133e3d35851fb9b2ff1b987f2d6175575027393e7473e65b8abd8947"} Sep 18 21:53:38.225798 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.225776 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:53:38.252360 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.252279 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6p9zr" podStartSLOduration=134.723134765 podStartE2EDuration="2m16.252262556s" totalImagesPullingTime="1.529127791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:33.168900788 +0000 UTC m=+165.871466151" watchObservedRunningTime="2026-09-18 21:53:38.252262556 +0000 UTC m=+170.954827919" Sep 18 21:53:38.347596 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.347568 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-bound-sa-token\") pod \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " Sep 18 21:53:38.347690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.347603 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-trusted-ca\") pod \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " Sep 18 21:53:38.347690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.347629 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj9jb\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-kube-api-access-zj9jb\") pod \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " Sep 18 21:53:38.347690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.347670 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-certificates\") pod \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " Sep 18 21:53:38.347826 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.347696 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-image-registry-private-configuration\") pod \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " Sep 18 21:53:38.347826 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.347723 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") pod \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " Sep 18 21:53:38.347826 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.347772 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-ca-trust-extracted\") pod \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " Sep 18 21:53:38.348018 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.347826 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-installation-pull-secrets\") pod \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\" (UID: \"7900b6fb-5bdc-4be4-835f-e593ecfc42a8\") " Sep 18 21:53:38.348197 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.348111 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7900b6fb-5bdc-4be4-835f-e593ecfc42a8" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:53:38.348197 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.348158 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7900b6fb-5bdc-4be4-835f-e593ecfc42a8" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:53:38.348817 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.348799 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-certificates\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:53:38.348817 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.348820 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-trusted-ca\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:53:38.350381 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.350355 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-kube-api-access-zj9jb" (OuterVolumeSpecName: "kube-api-access-zj9jb") pod "7900b6fb-5bdc-4be4-835f-e593ecfc42a8" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8"). InnerVolumeSpecName "kube-api-access-zj9jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:53:38.350468 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.350374 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7900b6fb-5bdc-4be4-835f-e593ecfc42a8" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:53:38.350468 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.350375 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7900b6fb-5bdc-4be4-835f-e593ecfc42a8" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:53:38.350468 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.350417 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7900b6fb-5bdc-4be4-835f-e593ecfc42a8" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:53:38.350565 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.350471 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7900b6fb-5bdc-4be4-835f-e593ecfc42a8" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:53:38.356385 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.356364 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7900b6fb-5bdc-4be4-835f-e593ecfc42a8" (UID: "7900b6fb-5bdc-4be4-835f-e593ecfc42a8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:53:38.450085 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.450064 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-ca-trust-extracted\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:53:38.450085 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.450082 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-installation-pull-secrets\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:53:38.450194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.450093 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-bound-sa-token\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:53:38.450194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.450101 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj9jb\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-kube-api-access-zj9jb\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:53:38.450194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.450110 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-image-registry-private-configuration\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:53:38.450194 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:38.450120 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7900b6fb-5bdc-4be4-835f-e593ecfc42a8-registry-tls\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:53:39.165618 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:39.165594 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" event={"ID":"7900b6fb-5bdc-4be4-835f-e593ecfc42a8","Type":"ContainerDied","Data":"8e382af26b946609bd2538dafe35f0b8030ad7eacda581103d656e229f190c35"} Sep 18 21:53:39.165890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:39.165621 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fc77fcf6-nn9ld" Sep 18 21:53:39.165890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:39.165676 2567 scope.go:117] "RemoveContainer" containerID="56fa66c7133e3d35851fb9b2ff1b987f2d6175575027393e7473e65b8abd8947" Sep 18 21:53:39.190790 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:39.190769 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8fc77fcf6-nn9ld"] Sep 18 21:53:39.197715 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:39.197679 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8fc77fcf6-nn9ld"] Sep 18 21:53:39.393585 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:39.393560 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7900b6fb-5bdc-4be4-835f-e593ecfc42a8" path="/var/lib/kubelet/pods/7900b6fb-5bdc-4be4-835f-e593ecfc42a8/volumes" Sep 18 21:53:43.144252 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:43.144215 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6p9zr" Sep 18 21:53:43.345244 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:43.345215 2567 patch_prober.go:28] interesting pod/image-registry-76f5df994f-rqfbr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 21:53:43.345386 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:43.345259 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" podUID="77b38ac3-a6e2-4bbd-a850-3537f1d67696" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 21:53:44.389011 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:44.388977 2567 scope.go:117] "RemoveContainer" containerID="f69cfb4fb02a069f51a131df9547dee0a8312521e5f7ba18fe9f009eccbea333" Sep 18 21:53:45.040994 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.040972 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76f5df994f-rqfbr" Sep 18 21:53:45.194081 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.194060 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/2.log" Sep 18 21:53:45.194212 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.194114 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" event={"ID":"f89a5ef2-a724-4862-9b01-5fd8e982271e","Type":"ContainerStarted","Data":"c3e47dc24d8303c6423f75ebea369c1baa315e117cde9b0ba4fbedc88d0348ec"} Sep 18 21:53:45.194555 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.194538 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:53:45.224387 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.224348 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" podStartSLOduration=56.396219716 podStartE2EDuration="58.224334288s" totalImagesPullingTime="1.828114572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:45.223243362 +0000 UTC m=+177.925808717" watchObservedRunningTime="2026-09-18 21:53:45.224334288 +0000 UTC m=+177.926899648" Sep 18 21:53:45.413917 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.413858 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-6pmwb" Sep 18 21:53:45.585225 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.585193 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-c8dkf"] Sep 18 21:53:45.585567 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.585547 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7900b6fb-5bdc-4be4-835f-e593ecfc42a8" containerName="registry" Sep 18 21:53:45.585611 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.585571 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7900b6fb-5bdc-4be4-835f-e593ecfc42a8" containerName="registry" Sep 18 21:53:45.585658 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.585649 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7900b6fb-5bdc-4be4-835f-e593ecfc42a8" containerName="registry" Sep 18 21:53:45.589353 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.589337 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-c8dkf" Sep 18 21:53:45.592231 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.592206 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 21:53:45.592231 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.592233 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sf2nw\"" Sep 18 21:53:45.592402 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.592273 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 21:53:45.600845 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.600821 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-c8dkf"] Sep 18 21:53:45.600957 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.600934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlhrn\" (UniqueName: \"kubernetes.io/projected/1c84b284-a5d7-48a9-bc1f-71741d9ace1e-kube-api-access-mlhrn\") pod \"downloads-6594f4c75-c8dkf\" (UID: \"1c84b284-a5d7-48a9-bc1f-71741d9ace1e\") " pod="openshift-console/downloads-6594f4c75-c8dkf" Sep 18 21:53:45.701836 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.701816 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlhrn\" (UniqueName: \"kubernetes.io/projected/1c84b284-a5d7-48a9-bc1f-71741d9ace1e-kube-api-access-mlhrn\") pod \"downloads-6594f4c75-c8dkf\" (UID: \"1c84b284-a5d7-48a9-bc1f-71741d9ace1e\") " pod="openshift-console/downloads-6594f4c75-c8dkf" Sep 18 21:53:45.711541 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.711515 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlhrn\" (UniqueName: \"kubernetes.io/projected/1c84b284-a5d7-48a9-bc1f-71741d9ace1e-kube-api-access-mlhrn\") pod \"downloads-6594f4c75-c8dkf\" (UID: \"1c84b284-a5d7-48a9-bc1f-71741d9ace1e\") " pod="openshift-console/downloads-6594f4c75-c8dkf" Sep 18 21:53:45.897530 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:45.897506 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-c8dkf" Sep 18 21:53:46.173751 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:46.173727 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-c8dkf"] Sep 18 21:53:46.176063 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:46.176037 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c84b284_a5d7_48a9_bc1f_71741d9ace1e.slice/crio-40a8032216accaaaada093e74679d456c3984edfe1728fd374dd7fbad27a3326 WatchSource:0}: Error finding container 40a8032216accaaaada093e74679d456c3984edfe1728fd374dd7fbad27a3326: Status 404 returned error can't find the container with id 40a8032216accaaaada093e74679d456c3984edfe1728fd374dd7fbad27a3326 Sep 18 21:53:46.198921 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:46.198897 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-c8dkf" event={"ID":"1c84b284-a5d7-48a9-bc1f-71741d9ace1e","Type":"ContainerStarted","Data":"40a8032216accaaaada093e74679d456c3984edfe1728fd374dd7fbad27a3326"} Sep 18 21:53:46.799079 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:46.799049 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:46.799481 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:46.799116 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:53:53.550081 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.550046 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-df6567454-mt6bj"] Sep 18 21:53:53.555123 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.555100 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.558124 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.558098 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 21:53:53.558355 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.558338 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 21:53:53.559548 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.559510 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 21:53:53.559548 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.559523 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 21:53:53.559755 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.559570 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 21:53:53.559755 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.559526 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ffrpj\"" Sep 18 21:53:53.567560 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.567537 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df6567454-mt6bj"] Sep 18 21:53:53.664346 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.664319 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-oauth-serving-cert\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.664480 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.664377 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-console-config\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.664480 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.664405 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmg4x\" (UniqueName: \"kubernetes.io/projected/8552087b-a845-459f-b838-cf03a9309b0c-kube-api-access-mmg4x\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.664480 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.664431 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-serving-cert\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.664480 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.664465 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-oauth-config\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.664770 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.664525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-service-ca\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.765497 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.765471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-oauth-serving-cert\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.765613 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.765512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-console-config\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.765613 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.765529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmg4x\" (UniqueName: \"kubernetes.io/projected/8552087b-a845-459f-b838-cf03a9309b0c-kube-api-access-mmg4x\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.765613 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.765553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-serving-cert\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.765613 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.765588 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-oauth-config\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.765800 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.765618 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-service-ca\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.766325 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.766275 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-oauth-serving-cert\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.766482 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.766461 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-service-ca\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.766570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.766484 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-console-config\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.768294 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.768271 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-serving-cert\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.768815 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.768797 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-oauth-config\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.779422 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.779400 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmg4x\" (UniqueName: \"kubernetes.io/projected/8552087b-a845-459f-b838-cf03a9309b0c-kube-api-access-mmg4x\") pod \"console-df6567454-mt6bj\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:53.866741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:53.866674 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:53:54.173601 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:54.173572 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-df6567454-mt6bj"] Sep 18 21:53:54.176062 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:53:54.176035 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8552087b_a845_459f_b838_cf03a9309b0c.slice/crio-1b67878a2aebea1daef1cd884601b2462ff20d2b5f1b539bab782176a3df9643 WatchSource:0}: Error finding container 1b67878a2aebea1daef1cd884601b2462ff20d2b5f1b539bab782176a3df9643: Status 404 returned error can't find the container with id 1b67878a2aebea1daef1cd884601b2462ff20d2b5f1b539bab782176a3df9643 Sep 18 21:53:54.231804 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:53:54.231777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df6567454-mt6bj" event={"ID":"8552087b-a845-459f-b838-cf03a9309b0c","Type":"ContainerStarted","Data":"1b67878a2aebea1daef1cd884601b2462ff20d2b5f1b539bab782176a3df9643"} Sep 18 21:54:00.315361 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.315186 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cd7c6c449-crb9f"] Sep 18 21:54:00.318616 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.318596 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.328559 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.328537 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 21:54:00.334603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.334582 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd7c6c449-crb9f"] Sep 18 21:54:00.425235 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.425198 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bdlr\" (UniqueName: \"kubernetes.io/projected/8b565a61-2442-44b4-89a6-077d4e03a6bd-kube-api-access-4bdlr\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.425407 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.425267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-oauth-serving-cert\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.425407 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.425296 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-serving-cert\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.425407 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.425326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-config\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.425407 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.425368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-oauth-config\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.425580 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.425414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-trusted-ca-bundle\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.425580 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.425456 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-service-ca\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.526552 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.526518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-oauth-serving-cert\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.526727 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.526563 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-serving-cert\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.526727 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.526586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-config\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.526727 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.526629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-oauth-config\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.526727 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.526667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-trusted-ca-bundle\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.526727 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.526707 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-service-ca\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.527048 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.526762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdlr\" (UniqueName: \"kubernetes.io/projected/8b565a61-2442-44b4-89a6-077d4e03a6bd-kube-api-access-4bdlr\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.527520 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.527457 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-oauth-serving-cert\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.527636 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.527527 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-config\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.527636 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.527540 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-trusted-ca-bundle\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.527811 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.527788 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-service-ca\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.529377 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.529351 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-oauth-config\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.529572 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.529546 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-serving-cert\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.536309 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.536283 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bdlr\" (UniqueName: \"kubernetes.io/projected/8b565a61-2442-44b4-89a6-077d4e03a6bd-kube-api-access-4bdlr\") pod \"console-5cd7c6c449-crb9f\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:00.629570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:00.629464 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:04.929653 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:04.929604 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd7c6c449-crb9f"] Sep 18 21:54:05.284060 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.283969 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df6567454-mt6bj" event={"ID":"8552087b-a845-459f-b838-cf03a9309b0c","Type":"ContainerStarted","Data":"972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4"} Sep 18 21:54:05.286011 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.285973 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd7c6c449-crb9f" event={"ID":"8b565a61-2442-44b4-89a6-077d4e03a6bd","Type":"ContainerStarted","Data":"35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7"} Sep 18 21:54:05.286162 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.286024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd7c6c449-crb9f" event={"ID":"8b565a61-2442-44b4-89a6-077d4e03a6bd","Type":"ContainerStarted","Data":"c3a5ce214d3b33428f10e0d13fc3403d5ef62b5ceaed7d6896ad1c44f1d294b4"} Sep 18 21:54:05.287802 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.287765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-c8dkf" event={"ID":"1c84b284-a5d7-48a9-bc1f-71741d9ace1e","Type":"ContainerStarted","Data":"edf65153291fb4c304e1a66d28755222cb1b4952db86bed6e57b363e1a118c88"} Sep 18 21:54:05.287988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.287966 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-c8dkf" Sep 18 21:54:05.304652 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.304604 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-df6567454-mt6bj" podStartSLOduration=1.76200077 podStartE2EDuration="12.304588356s" totalImagesPullingTime="10.542587586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:54:05.304347328 +0000 UTC m=+198.006912694" watchObservedRunningTime="2026-09-18 21:54:05.304588356 +0000 UTC m=+198.007153719" Sep 18 21:54:05.307653 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.307629 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-c8dkf" Sep 18 21:54:05.325338 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.325287 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cd7c6c449-crb9f" podStartSLOduration=5.325276135 podStartE2EDuration="5.325276135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:54:05.323735384 +0000 UTC m=+198.026300747" watchObservedRunningTime="2026-09-18 21:54:05.325276135 +0000 UTC m=+198.027841500" Sep 18 21:54:05.349218 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:05.349170 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-c8dkf" podStartSLOduration=1.870216418 podStartE2EDuration="20.34914984s" totalImagesPullingTime="18.478933422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:54:05.348369664 +0000 UTC m=+198.050935029" watchObservedRunningTime="2026-09-18 21:54:05.34914984 +0000 UTC m=+198.051715196" Sep 18 21:54:06.805580 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:06.805549 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:54:06.811353 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:06.811325 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d7474ddc7-rjmr8" Sep 18 21:54:10.630386 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:10.630344 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:10.630861 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:10.630425 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:10.635994 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:10.635961 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:11.319209 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:11.319177 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:54:11.409334 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:11.409302 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-df6567454-mt6bj"] Sep 18 21:54:13.867362 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:13.867329 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:54:36.432551 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.432497 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-df6567454-mt6bj" podUID="8552087b-a845-459f-b838-cf03a9309b0c" containerName="console" containerID="cri-o://972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4" gracePeriod=15 Sep 18 21:54:36.714802 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.714740 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:54:36.742798 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.742777 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-serving-cert\") pod \"8552087b-a845-459f-b838-cf03a9309b0c\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " Sep 18 21:54:36.742914 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.742813 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-oauth-config\") pod \"8552087b-a845-459f-b838-cf03a9309b0c\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " Sep 18 21:54:36.742914 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.742834 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-service-ca\") pod \"8552087b-a845-459f-b838-cf03a9309b0c\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " Sep 18 21:54:36.742914 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.742856 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmg4x\" (UniqueName: \"kubernetes.io/projected/8552087b-a845-459f-b838-cf03a9309b0c-kube-api-access-mmg4x\") pod \"8552087b-a845-459f-b838-cf03a9309b0c\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " Sep 18 21:54:36.743067 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.742910 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-console-config\") pod \"8552087b-a845-459f-b838-cf03a9309b0c\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " Sep 18 21:54:36.743067 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.742953 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-oauth-serving-cert\") pod \"8552087b-a845-459f-b838-cf03a9309b0c\" (UID: \"8552087b-a845-459f-b838-cf03a9309b0c\") " Sep 18 21:54:36.743570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.743257 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-service-ca" (OuterVolumeSpecName: "service-ca") pod "8552087b-a845-459f-b838-cf03a9309b0c" (UID: "8552087b-a845-459f-b838-cf03a9309b0c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:36.743570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.743309 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-console-config" (OuterVolumeSpecName: "console-config") pod "8552087b-a845-459f-b838-cf03a9309b0c" (UID: "8552087b-a845-459f-b838-cf03a9309b0c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:36.743570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.743534 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8552087b-a845-459f-b838-cf03a9309b0c" (UID: "8552087b-a845-459f-b838-cf03a9309b0c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:36.745244 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.745105 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8552087b-a845-459f-b838-cf03a9309b0c-kube-api-access-mmg4x" (OuterVolumeSpecName: "kube-api-access-mmg4x") pod "8552087b-a845-459f-b838-cf03a9309b0c" (UID: "8552087b-a845-459f-b838-cf03a9309b0c"). InnerVolumeSpecName "kube-api-access-mmg4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:54:36.745244 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.745184 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8552087b-a845-459f-b838-cf03a9309b0c" (UID: "8552087b-a845-459f-b838-cf03a9309b0c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:36.745378 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.745266 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8552087b-a845-459f-b838-cf03a9309b0c" (UID: "8552087b-a845-459f-b838-cf03a9309b0c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:36.844515 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.844490 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-serving-cert\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:36.844515 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.844511 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8552087b-a845-459f-b838-cf03a9309b0c-console-oauth-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:36.844655 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.844520 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-service-ca\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:36.844655 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.844529 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmg4x\" (UniqueName: \"kubernetes.io/projected/8552087b-a845-459f-b838-cf03a9309b0c-kube-api-access-mmg4x\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:36.844655 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.844537 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-console-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:36.844655 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:36.844545 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8552087b-a845-459f-b838-cf03a9309b0c-oauth-serving-cert\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:37.419043 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.419014 2567 generic.go:356] "Generic (PLEG): container finished" podID="8552087b-a845-459f-b838-cf03a9309b0c" containerID="972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4" exitCode=0 Sep 18 21:54:37.419187 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.419059 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df6567454-mt6bj" event={"ID":"8552087b-a845-459f-b838-cf03a9309b0c","Type":"ContainerDied","Data":"972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4"} Sep 18 21:54:37.419187 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.419075 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-df6567454-mt6bj" Sep 18 21:54:37.419187 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.419096 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-df6567454-mt6bj" event={"ID":"8552087b-a845-459f-b838-cf03a9309b0c","Type":"ContainerDied","Data":"1b67878a2aebea1daef1cd884601b2462ff20d2b5f1b539bab782176a3df9643"} Sep 18 21:54:37.419187 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.419120 2567 scope.go:117] "RemoveContainer" containerID="972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4" Sep 18 21:54:37.427052 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.427036 2567 scope.go:117] "RemoveContainer" containerID="972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4" Sep 18 21:54:37.427369 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:54:37.427349 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4\": container with ID starting with 972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4 not found: ID does not exist" containerID="972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4" Sep 18 21:54:37.427426 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.427378 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4"} err="failed to get container status \"972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4\": rpc error: code = NotFound desc = could not find container \"972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4\": container with ID starting with 972be237edfa307f1c7c27aa271cff3cc6890b1f9c0ca8e0b5818d1a4425dec4 not found: ID does not exist" Sep 18 21:54:37.435886 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.435864 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-df6567454-mt6bj"] Sep 18 21:54:37.439610 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:37.439590 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-df6567454-mt6bj"] Sep 18 21:54:39.393356 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:39.393327 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8552087b-a845-459f-b838-cf03a9309b0c" path="/var/lib/kubelet/pods/8552087b-a845-459f-b838-cf03a9309b0c/volumes" Sep 18 21:54:42.494177 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:42.494141 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:54:42.494690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:42.494433 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="alertmanager" containerID="cri-o://b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d" gracePeriod=120 Sep 18 21:54:42.494690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:42.494456 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy-metric" containerID="cri-o://3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06" gracePeriod=120 Sep 18 21:54:42.494690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:42.494493 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="config-reloader" containerID="cri-o://5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5" gracePeriod=120 Sep 18 21:54:42.494690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:42.494433 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy" containerID="cri-o://e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11" gracePeriod=120 Sep 18 21:54:42.494690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:42.494513 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy-web" containerID="cri-o://ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c" gracePeriod=120 Sep 18 21:54:42.494690 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:42.494453 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="prom-label-proxy" containerID="cri-o://0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501" gracePeriod=120 Sep 18 21:54:43.446196 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:43.446163 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerID="0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501" exitCode=0 Sep 18 21:54:43.446196 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:43.446190 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerID="e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11" exitCode=0 Sep 18 21:54:43.446196 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:43.446197 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerID="5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5" exitCode=0 Sep 18 21:54:43.446196 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:43.446202 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerID="b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d" exitCode=0 Sep 18 21:54:43.446478 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:43.446227 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerDied","Data":"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501"} Sep 18 21:54:43.446478 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:43.446274 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerDied","Data":"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11"} Sep 18 21:54:43.446478 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:43.446299 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerDied","Data":"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5"} Sep 18 21:54:43.446478 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:43.446325 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerDied","Data":"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d"} Sep 18 21:54:44.277046 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.277023 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.304636 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304606 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-metrics-client-ca\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304648 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304674 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-config-out\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304714 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304756 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-cluster-tls-config\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304959 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304788 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-tls-assets\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304959 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304810 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-web-config\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304959 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304843 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-web\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304959 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304878 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92vfg\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-kube-api-access-92vfg\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304959 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304901 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-config-volume\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.304959 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304930 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.305286 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.304964 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-trusted-ca-bundle\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.305286 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.305015 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-main-db\") pod \"4a52754c-3460-410b-8ab2-a44a7dae966c\" (UID: \"4a52754c-3460-410b-8ab2-a44a7dae966c\") " Sep 18 21:54:44.305286 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.305036 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:44.305442 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.305286 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-metrics-client-ca\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.305788 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.305585 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:54:44.306413 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.306376 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:44.307880 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.307849 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-kube-api-access-92vfg" (OuterVolumeSpecName: "kube-api-access-92vfg") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "kube-api-access-92vfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:54:44.308087 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.308066 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:54:44.308895 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.308868 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:44.308980 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.308901 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-config-out" (OuterVolumeSpecName: "config-out") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:54:44.308980 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.308952 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:44.309273 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.309252 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-config-volume" (OuterVolumeSpecName: "config-volume") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:44.309360 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.309275 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:44.309741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.309720 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:44.312666 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.312641 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:44.318984 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.318957 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-web-config" (OuterVolumeSpecName: "web-config") pod "4a52754c-3460-410b-8ab2-a44a7dae966c" (UID: "4a52754c-3460-410b-8ab2-a44a7dae966c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406652 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-cluster-tls-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406683 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-tls-assets\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406693 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-web-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406702 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406714 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92vfg\" (UniqueName: \"kubernetes.io/projected/4a52754c-3460-410b-8ab2-a44a7dae966c-kube-api-access-92vfg\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406722 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-config-volume\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406730 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406739 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.406741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406748 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-alertmanager-main-db\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.407109 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406756 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.407109 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406765 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a52754c-3460-410b-8ab2-a44a7dae966c-config-out\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.407109 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.406774 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a52754c-3460-410b-8ab2-a44a7dae966c-secret-alertmanager-main-tls\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:54:44.453354 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.453315 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerID="3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06" exitCode=0 Sep 18 21:54:44.453354 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.453341 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerID="ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c" exitCode=0 Sep 18 21:54:44.453554 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.453369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerDied","Data":"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06"} Sep 18 21:54:44.453554 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.453408 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.453554 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.453423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerDied","Data":"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c"} Sep 18 21:54:44.453554 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.453450 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a52754c-3460-410b-8ab2-a44a7dae966c","Type":"ContainerDied","Data":"c8d5dec37f07eec03449d74d1c24f4365f3a369a90454fd66486e77366861275"} Sep 18 21:54:44.453554 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.453480 2567 scope.go:117] "RemoveContainer" containerID="0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501" Sep 18 21:54:44.461408 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.461384 2567 scope.go:117] "RemoveContainer" containerID="3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06" Sep 18 21:54:44.468394 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.468378 2567 scope.go:117] "RemoveContainer" containerID="e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11" Sep 18 21:54:44.474898 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.474879 2567 scope.go:117] "RemoveContainer" containerID="ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c" Sep 18 21:54:44.481478 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.481460 2567 scope.go:117] "RemoveContainer" containerID="5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5" Sep 18 21:54:44.483050 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.483031 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:54:44.485922 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.485901 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:54:44.489090 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.489072 2567 scope.go:117] "RemoveContainer" containerID="b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d" Sep 18 21:54:44.496577 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.496560 2567 scope.go:117] "RemoveContainer" containerID="d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6" Sep 18 21:54:44.503411 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.503390 2567 scope.go:117] "RemoveContainer" containerID="0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501" Sep 18 21:54:44.503697 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:54:44.503678 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501\": container with ID starting with 0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501 not found: ID does not exist" containerID="0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501" Sep 18 21:54:44.503746 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.503707 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501"} err="failed to get container status \"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501\": rpc error: code = NotFound desc = could not find container \"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501\": container with ID starting with 0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501 not found: ID does not exist" Sep 18 21:54:44.503746 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.503727 2567 scope.go:117] "RemoveContainer" containerID="3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06" Sep 18 21:54:44.503951 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:54:44.503937 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06\": container with ID starting with 3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06 not found: ID does not exist" containerID="3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06" Sep 18 21:54:44.503996 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.503956 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06"} err="failed to get container status \"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06\": rpc error: code = NotFound desc = could not find container \"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06\": container with ID starting with 3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06 not found: ID does not exist" Sep 18 21:54:44.503996 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.503968 2567 scope.go:117] "RemoveContainer" containerID="e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11" Sep 18 21:54:44.504202 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:54:44.504187 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11\": container with ID starting with e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11 not found: ID does not exist" containerID="e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11" Sep 18 21:54:44.504247 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.504205 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11"} err="failed to get container status \"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11\": rpc error: code = NotFound desc = could not find container \"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11\": container with ID starting with e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11 not found: ID does not exist" Sep 18 21:54:44.504247 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.504217 2567 scope.go:117] "RemoveContainer" containerID="ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c" Sep 18 21:54:44.504477 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:54:44.504460 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c\": container with ID starting with ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c not found: ID does not exist" containerID="ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c" Sep 18 21:54:44.504521 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.504483 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c"} err="failed to get container status \"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c\": rpc error: code = NotFound desc = could not find container \"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c\": container with ID starting with ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c not found: ID does not exist" Sep 18 21:54:44.504521 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.504498 2567 scope.go:117] "RemoveContainer" containerID="5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5" Sep 18 21:54:44.504751 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:54:44.504736 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5\": container with ID starting with 5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5 not found: ID does not exist" containerID="5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5" Sep 18 21:54:44.504801 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.504755 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5"} err="failed to get container status \"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5\": rpc error: code = NotFound desc = could not find container \"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5\": container with ID starting with 5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5 not found: ID does not exist" Sep 18 21:54:44.504801 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.504769 2567 scope.go:117] "RemoveContainer" containerID="b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d" Sep 18 21:54:44.504957 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:54:44.504937 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d\": container with ID starting with b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d not found: ID does not exist" containerID="b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d" Sep 18 21:54:44.504997 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.504960 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d"} err="failed to get container status \"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d\": rpc error: code = NotFound desc = could not find container \"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d\": container with ID starting with b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d not found: ID does not exist" Sep 18 21:54:44.504997 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.504972 2567 scope.go:117] "RemoveContainer" containerID="d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6" Sep 18 21:54:44.505221 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:54:44.505204 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6\": container with ID starting with d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6 not found: ID does not exist" containerID="d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6" Sep 18 21:54:44.505276 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.505225 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6"} err="failed to get container status \"d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6\": rpc error: code = NotFound desc = could not find container \"d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6\": container with ID starting with d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6 not found: ID does not exist" Sep 18 21:54:44.505276 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.505238 2567 scope.go:117] "RemoveContainer" containerID="0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501" Sep 18 21:54:44.505451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.505430 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501"} err="failed to get container status \"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501\": rpc error: code = NotFound desc = could not find container \"0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501\": container with ID starting with 0df8c3dfcd1425e1da5988bfd7fff5512a877d84babd8ce49ae25eb68557f501 not found: ID does not exist" Sep 18 21:54:44.505521 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.505452 2567 scope.go:117] "RemoveContainer" containerID="3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06" Sep 18 21:54:44.505669 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.505653 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06"} err="failed to get container status \"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06\": rpc error: code = NotFound desc = could not find container \"3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06\": container with ID starting with 3decc1af626bf7cc62e6c12e6f55ed10224b99dc0992b1f2dd6a6efe075b0d06 not found: ID does not exist" Sep 18 21:54:44.505711 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.505669 2567 scope.go:117] "RemoveContainer" containerID="e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11" Sep 18 21:54:44.505895 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.505878 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11"} err="failed to get container status \"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11\": rpc error: code = NotFound desc = could not find container \"e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11\": container with ID starting with e7e35881c51940ecd184bcbdc307944e874f51884748ef9bb205a22d5d0cdd11 not found: ID does not exist" Sep 18 21:54:44.505966 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.505898 2567 scope.go:117] "RemoveContainer" containerID="ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c" Sep 18 21:54:44.506104 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.506085 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c"} err="failed to get container status \"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c\": rpc error: code = NotFound desc = could not find container \"ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c\": container with ID starting with ba673b9b1c4cfb59a93311a46ce34dbd9f8cef1cd0b83120372a315d9de37e3c not found: ID does not exist" Sep 18 21:54:44.506174 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.506104 2567 scope.go:117] "RemoveContainer" containerID="5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5" Sep 18 21:54:44.506358 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.506340 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5"} err="failed to get container status \"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5\": rpc error: code = NotFound desc = could not find container \"5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5\": container with ID starting with 5f0aceba433907e045bc00982074f4ec4f28c5fb12825944e39f0068a87c16d5 not found: ID does not exist" Sep 18 21:54:44.506425 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.506360 2567 scope.go:117] "RemoveContainer" containerID="b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d" Sep 18 21:54:44.506564 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.506545 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d"} err="failed to get container status \"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d\": rpc error: code = NotFound desc = could not find container \"b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d\": container with ID starting with b20eade4e4976706277f3f413c96bd6bbadc629ec02c060caad4475b43a75f6d not found: ID does not exist" Sep 18 21:54:44.506610 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.506565 2567 scope.go:117] "RemoveContainer" containerID="d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6" Sep 18 21:54:44.506753 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.506736 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6"} err="failed to get container status \"d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6\": rpc error: code = NotFound desc = could not find container \"d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6\": container with ID starting with d461f44dbb94ce69178e57fb1e24e3a44705f869e3a6752970b2974ad1fe45f6 not found: ID does not exist" Sep 18 21:54:44.542287 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542241 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:54:44.542527 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542515 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="alertmanager" Sep 18 21:54:44.542527 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542528 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="alertmanager" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542534 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy-metric" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542540 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy-metric" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542550 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="prom-label-proxy" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542555 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="prom-label-proxy" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542565 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="init-config-reloader" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542570 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="init-config-reloader" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542577 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy-web" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542582 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy-web" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542592 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="config-reloader" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542597 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="config-reloader" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542604 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8552087b-a845-459f-b838-cf03a9309b0c" containerName="console" Sep 18 21:54:44.542603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542609 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8552087b-a845-459f-b838-cf03a9309b0c" containerName="console" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542618 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542623 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542666 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542671 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy-metric" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542678 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="kube-rbac-proxy-web" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542683 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="prom-label-proxy" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542690 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="alertmanager" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542695 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" containerName="config-reloader" Sep 18 21:54:44.542988 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.542700 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8552087b-a845-459f-b838-cf03a9309b0c" containerName="console" Sep 18 21:54:44.577846 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.577817 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.579661 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.579621 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:54:44.582535 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.582512 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 21:54:44.582790 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.582773 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 21:54:44.583328 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.583303 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 21:54:44.583423 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.583370 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 21:54:44.583544 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.583496 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 21:54:44.583694 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.583679 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 21:54:44.583884 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.583863 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 21:54:44.583968 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.583892 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 21:54:44.584234 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.584217 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x8svv\"" Sep 18 21:54:44.591593 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.591568 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 21:54:44.608881 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.608858 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06bfeb3a-48e6-4038-8ec3-c66271d51932-config-out\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609000 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.608889 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-web-config\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609000 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.608935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609000 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.608988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609156 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06bfeb3a-48e6-4038-8ec3-c66271d51932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609156 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bfeb3a-48e6-4038-8ec3-c66271d51932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609156 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609086 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbml2\" (UniqueName: \"kubernetes.io/projected/06bfeb3a-48e6-4038-8ec3-c66271d51932-kube-api-access-qbml2\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609156 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609107 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06bfeb3a-48e6-4038-8ec3-c66271d51932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609156 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609314 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609314 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-config-volume\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609314 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.609314 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.609261 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bfeb3a-48e6-4038-8ec3-c66271d51932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709677 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709644 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-config-volume\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709741 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bfeb3a-48e6-4038-8ec3-c66271d51932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709775 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06bfeb3a-48e6-4038-8ec3-c66271d51932-config-out\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-web-config\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.709890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06bfeb3a-48e6-4038-8ec3-c66271d51932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.710374 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bfeb3a-48e6-4038-8ec3-c66271d51932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.710374 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbml2\" (UniqueName: \"kubernetes.io/projected/06bfeb3a-48e6-4038-8ec3-c66271d51932-kube-api-access-qbml2\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.710374 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06bfeb3a-48e6-4038-8ec3-c66271d51932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.710374 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.709983 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.710664 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.710639 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06bfeb3a-48e6-4038-8ec3-c66271d51932-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.710844 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.710810 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bfeb3a-48e6-4038-8ec3-c66271d51932-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.711387 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.711347 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06bfeb3a-48e6-4038-8ec3-c66271d51932-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.712898 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.712870 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.712992 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.712921 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06bfeb3a-48e6-4038-8ec3-c66271d51932-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.713071 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.713044 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-config-volume\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.713201 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.713120 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06bfeb3a-48e6-4038-8ec3-c66271d51932-config-out\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.713688 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.713668 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.713872 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.713843 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.714086 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.714070 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-web-config\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.714382 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.714362 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.714447 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.714414 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06bfeb3a-48e6-4038-8ec3-c66271d51932-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.719361 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.719334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbml2\" (UniqueName: \"kubernetes.io/projected/06bfeb3a-48e6-4038-8ec3-c66271d51932-kube-api-access-qbml2\") pod \"alertmanager-main-0\" (UID: \"06bfeb3a-48e6-4038-8ec3-c66271d51932\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:44.888668 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:44.888632 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:54:45.202620 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:45.202597 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:54:45.204057 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:54:45.204033 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bfeb3a_48e6_4038_8ec3_c66271d51932.slice/crio-348167afe46bcb48163ba04ec59882140ed54236c81223ed735f5fee1a69faa0 WatchSource:0}: Error finding container 348167afe46bcb48163ba04ec59882140ed54236c81223ed735f5fee1a69faa0: Status 404 returned error can't find the container with id 348167afe46bcb48163ba04ec59882140ed54236c81223ed735f5fee1a69faa0 Sep 18 21:54:45.393649 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:45.393618 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a52754c-3460-410b-8ab2-a44a7dae966c" path="/var/lib/kubelet/pods/4a52754c-3460-410b-8ab2-a44a7dae966c/volumes" Sep 18 21:54:45.458909 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:45.458872 2567 generic.go:356] "Generic (PLEG): container finished" podID="06bfeb3a-48e6-4038-8ec3-c66271d51932" containerID="a3b6f9db826d336a102ef1662c7eb484780b361c66ff35f273c462be00f3e71f" exitCode=0 Sep 18 21:54:45.459115 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:45.458961 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06bfeb3a-48e6-4038-8ec3-c66271d51932","Type":"ContainerDied","Data":"a3b6f9db826d336a102ef1662c7eb484780b361c66ff35f273c462be00f3e71f"} Sep 18 21:54:45.459115 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:45.459039 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06bfeb3a-48e6-4038-8ec3-c66271d51932","Type":"ContainerStarted","Data":"348167afe46bcb48163ba04ec59882140ed54236c81223ed735f5fee1a69faa0"} Sep 18 21:54:46.466139 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.466096 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06bfeb3a-48e6-4038-8ec3-c66271d51932","Type":"ContainerStarted","Data":"b0cf8789470bd0aab8b465353f6fdb41fd3225b98f88352d5fca124b4842bee9"} Sep 18 21:54:46.466523 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.466173 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06bfeb3a-48e6-4038-8ec3-c66271d51932","Type":"ContainerStarted","Data":"68f4165e226989361b5a7859f12e7507dd84084d0708d3a5ce9ce2d9297f305d"} Sep 18 21:54:46.466523 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.466206 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06bfeb3a-48e6-4038-8ec3-c66271d51932","Type":"ContainerStarted","Data":"c398c52c95b3c4ac3cedfe8b88aef1cb5b499097b33aa8923de55c98aaa2e06e"} Sep 18 21:54:46.466523 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.466230 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06bfeb3a-48e6-4038-8ec3-c66271d51932","Type":"ContainerStarted","Data":"7ff2df6dec76861237ab03e58eb63fef31a1d75da8c509bdbac56ab684914655"} Sep 18 21:54:46.466523 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.466254 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06bfeb3a-48e6-4038-8ec3-c66271d51932","Type":"ContainerStarted","Data":"5dd3c81cb285f344c7fb16a32fb062dff6f2e4fc91a8b4a26881c457eccdaccf"} Sep 18 21:54:46.466523 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.466279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06bfeb3a-48e6-4038-8ec3-c66271d51932","Type":"ContainerStarted","Data":"e51fc641549bc55a2d67f07279527a4db0bc9152c99260a4ca294b020ae010c9"} Sep 18 21:54:46.498175 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.498112 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.483321917 podStartE2EDuration="2.498096415s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.774498ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:54:46.497700294 +0000 UTC m=+239.200265657" watchObservedRunningTime="2026-09-18 21:54:46.498096415 +0000 UTC m=+239.200661778" Sep 18 21:54:46.522026 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.521994 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-77d677d89d-k2xnz"] Sep 18 21:54:46.542573 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.542546 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.545685 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.545653 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 21:54:46.545685 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.545664 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 21:54:46.545976 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.545948 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cpxpl\"" Sep 18 21:54:46.546158 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.546142 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 21:54:46.546298 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.546281 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 21:54:46.546446 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.546432 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 21:54:46.550066 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.549515 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77d677d89d-k2xnz"] Sep 18 21:54:46.551305 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.550909 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 21:54:46.627290 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.627253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.627290 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.627295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-telemeter-client-tls\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.627491 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.627371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-secret-telemeter-client\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.627491 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.627424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.627552 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.627497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-metrics-client-ca\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.627552 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.627533 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-serving-certs-ca-bundle\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.627620 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.627558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-federate-client-tls\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.627620 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.627610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f26cw\" (UniqueName: \"kubernetes.io/projected/6301c1b5-81fc-4029-b021-91e2ece4acc3-kube-api-access-f26cw\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729102 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-secret-telemeter-client\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729102 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729102 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-metrics-client-ca\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729409 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729150 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-serving-certs-ca-bundle\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729409 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-federate-client-tls\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729409 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f26cw\" (UniqueName: \"kubernetes.io/projected/6301c1b5-81fc-4029-b021-91e2ece4acc3-kube-api-access-f26cw\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729409 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729284 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729409 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729312 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-telemeter-client-tls\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.729987 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.729959 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-serving-certs-ca-bundle\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.730107 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.730060 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-metrics-client-ca\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.730310 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.730288 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6301c1b5-81fc-4029-b021-91e2ece4acc3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.731811 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.731792 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-federate-client-tls\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.731965 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.731818 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-telemeter-client-tls\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.732082 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.732059 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.732152 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.732067 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6301c1b5-81fc-4029-b021-91e2ece4acc3-secret-telemeter-client\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.738199 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.738178 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f26cw\" (UniqueName: \"kubernetes.io/projected/6301c1b5-81fc-4029-b021-91e2ece4acc3-kube-api-access-f26cw\") pod \"telemeter-client-77d677d89d-k2xnz\" (UID: \"6301c1b5-81fc-4029-b021-91e2ece4acc3\") " pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:46.853614 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:46.853577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" Sep 18 21:54:47.170205 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:47.170178 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77d677d89d-k2xnz"] Sep 18 21:54:47.171320 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:54:47.171294 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6301c1b5_81fc_4029_b021_91e2ece4acc3.slice/crio-ef74c81a6979d192d40891797dee1702050c5588141d2ed474c50cb30b02316b WatchSource:0}: Error finding container ef74c81a6979d192d40891797dee1702050c5588141d2ed474c50cb30b02316b: Status 404 returned error can't find the container with id ef74c81a6979d192d40891797dee1702050c5588141d2ed474c50cb30b02316b Sep 18 21:54:47.470921 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:47.470841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" event={"ID":"6301c1b5-81fc-4029-b021-91e2ece4acc3","Type":"ContainerStarted","Data":"ef74c81a6979d192d40891797dee1702050c5588141d2ed474c50cb30b02316b"} Sep 18 21:54:50.487791 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.487748 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" event={"ID":"6301c1b5-81fc-4029-b021-91e2ece4acc3","Type":"ContainerStarted","Data":"5771e50dec39a0af912efb2406c55de3c9ce59eae35e43ac533a8b072b090942"} Sep 18 21:54:50.488256 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.487812 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" event={"ID":"6301c1b5-81fc-4029-b021-91e2ece4acc3","Type":"ContainerStarted","Data":"738e42a161484f5ec58703a231e2e4d6eee98f937a599ce0a59bdde915116f5f"} Sep 18 21:54:50.488256 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.487839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" event={"ID":"6301c1b5-81fc-4029-b021-91e2ece4acc3","Type":"ContainerStarted","Data":"f5c6bb2f67aacb3999bb1933518e0e561831b94453e3ef921f93aaa0aec995e4"} Sep 18 21:54:50.532439 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.532385 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-77d677d89d-k2xnz" podStartSLOduration=2.33873088 podStartE2EDuration="4.532351228s" totalImagesPullingTime="2.193620348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:54:50.530059849 +0000 UTC m=+243.232625228" watchObservedRunningTime="2026-09-18 21:54:50.532351228 +0000 UTC m=+243.234916593" Sep 18 21:54:50.674485 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.674457 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d9f4849b-hrwqk"] Sep 18 21:54:50.693941 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.693917 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.696711 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.696691 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d9f4849b-hrwqk"] Sep 18 21:54:50.767716 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.767665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-service-ca\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.767716 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.767696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-trusted-ca-bundle\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.767848 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.767726 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtrt9\" (UniqueName: \"kubernetes.io/projected/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-kube-api-access-dtrt9\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.767848 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.767766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-oauth-config\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.767848 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.767782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-config\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.767848 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.767796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-oauth-serving-cert\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.767978 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.767898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-serving-cert\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.868237 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.868214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-serving-cert\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.868328 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.868258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-service-ca\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.868328 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.868277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-trusted-ca-bundle\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.868328 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.868322 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrt9\" (UniqueName: \"kubernetes.io/projected/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-kube-api-access-dtrt9\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.868502 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.868352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-oauth-config\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.868502 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.868376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-config\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.868502 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.868398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-oauth-serving-cert\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.869096 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.869071 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-config\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.869223 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.869106 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-oauth-serving-cert\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.869223 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.869106 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-service-ca\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.869323 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.869246 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-trusted-ca-bundle\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.870701 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.870683 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-serving-cert\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.870796 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.870768 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-oauth-config\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:50.884924 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:50.884899 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtrt9\" (UniqueName: \"kubernetes.io/projected/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-kube-api-access-dtrt9\") pod \"console-86d9f4849b-hrwqk\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:51.003768 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:51.003744 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:54:51.321066 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:51.321004 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d9f4849b-hrwqk"] Sep 18 21:54:51.323792 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:54:51.323765 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3b0bc6_58d8_4492_aaa4_88984c0eb024.slice/crio-8f3450b9788177a2fc5d366df1f81bee20e4e810861376569b42a6415ec05b3a WatchSource:0}: Error finding container 8f3450b9788177a2fc5d366df1f81bee20e4e810861376569b42a6415ec05b3a: Status 404 returned error can't find the container with id 8f3450b9788177a2fc5d366df1f81bee20e4e810861376569b42a6415ec05b3a Sep 18 21:54:51.492889 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:51.492849 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d9f4849b-hrwqk" event={"ID":"9a3b0bc6-58d8-4492-aaa4-88984c0eb024","Type":"ContainerStarted","Data":"154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9"} Sep 18 21:54:51.493236 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:51.492909 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d9f4849b-hrwqk" event={"ID":"9a3b0bc6-58d8-4492-aaa4-88984c0eb024","Type":"ContainerStarted","Data":"8f3450b9788177a2fc5d366df1f81bee20e4e810861376569b42a6415ec05b3a"} Sep 18 21:54:51.522722 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:54:51.522683 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d9f4849b-hrwqk" podStartSLOduration=1.522669965 podStartE2EDuration="1.522669965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:54:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:54:51.521630493 +0000 UTC m=+244.224195855" watchObservedRunningTime="2026-09-18 21:54:51.522669965 +0000 UTC m=+244.225235328" Sep 18 21:55:00.138284 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:00.138244 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:55:00.140676 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:00.140654 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64e7f8a7-840d-487b-a8fd-2bec3675c1a6-metrics-certs\") pod \"network-metrics-daemon-zmxqf\" (UID: \"64e7f8a7-840d-487b-a8fd-2bec3675c1a6\") " pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:55:00.393369 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:00.393289 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5rt7r\"" Sep 18 21:55:00.400910 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:00.400885 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmxqf" Sep 18 21:55:00.679362 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:00.679340 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zmxqf"] Sep 18 21:55:00.681405 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:55:00.681376 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e7f8a7_840d_487b_a8fd_2bec3675c1a6.slice/crio-d8b4668a13068655262db3e3b7ef6fb0d77e28d1f6bca507cf768253d66a318d WatchSource:0}: Error finding container d8b4668a13068655262db3e3b7ef6fb0d77e28d1f6bca507cf768253d66a318d: Status 404 returned error can't find the container with id d8b4668a13068655262db3e3b7ef6fb0d77e28d1f6bca507cf768253d66a318d Sep 18 21:55:01.004766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:01.004674 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:55:01.004766 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:01.004741 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:55:01.013636 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:01.013607 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:55:01.533407 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:01.533369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmxqf" event={"ID":"64e7f8a7-840d-487b-a8fd-2bec3675c1a6","Type":"ContainerStarted","Data":"d8b4668a13068655262db3e3b7ef6fb0d77e28d1f6bca507cf768253d66a318d"} Sep 18 21:55:01.538805 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:01.538777 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:55:01.604423 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:01.604395 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd7c6c449-crb9f"] Sep 18 21:55:02.539990 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:02.539951 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmxqf" event={"ID":"64e7f8a7-840d-487b-a8fd-2bec3675c1a6","Type":"ContainerStarted","Data":"05d63451c0d96f864a05094fbff09718b2465c37de3639bfed3843a54423ac8b"} Sep 18 21:55:02.540455 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:02.540021 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmxqf" event={"ID":"64e7f8a7-840d-487b-a8fd-2bec3675c1a6","Type":"ContainerStarted","Data":"bfa0a9a586002b86c4a303891ced6192988abcf0e52b7d52c9fcd88b1a64a356"} Sep 18 21:55:02.567836 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:02.567782 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zmxqf" podStartSLOduration=252.628390488 podStartE2EDuration="4m13.567765592s" totalImagesPullingTime="939.375104ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:55:02.567281815 +0000 UTC m=+255.269847178" watchObservedRunningTime="2026-09-18 21:55:02.567765592 +0000 UTC m=+255.270330955" Sep 18 21:55:26.624314 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:26.624248 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cd7c6c449-crb9f" podUID="8b565a61-2442-44b4-89a6-077d4e03a6bd" containerName="console" containerID="cri-o://35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7" gracePeriod=15 Sep 18 21:55:26.866398 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:26.866376 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:55:27.042031 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.041998 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-trusted-ca-bundle\") pod \"8b565a61-2442-44b4-89a6-077d4e03a6bd\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " Sep 18 21:55:27.042183 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042043 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-oauth-serving-cert\") pod \"8b565a61-2442-44b4-89a6-077d4e03a6bd\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " Sep 18 21:55:27.042183 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042061 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-serving-cert\") pod \"8b565a61-2442-44b4-89a6-077d4e03a6bd\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " Sep 18 21:55:27.042183 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042102 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-service-ca\") pod \"8b565a61-2442-44b4-89a6-077d4e03a6bd\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " Sep 18 21:55:27.042183 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042119 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-oauth-config\") pod \"8b565a61-2442-44b4-89a6-077d4e03a6bd\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " Sep 18 21:55:27.042183 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042156 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bdlr\" (UniqueName: \"kubernetes.io/projected/8b565a61-2442-44b4-89a6-077d4e03a6bd-kube-api-access-4bdlr\") pod \"8b565a61-2442-44b4-89a6-077d4e03a6bd\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " Sep 18 21:55:27.042451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042199 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-config\") pod \"8b565a61-2442-44b4-89a6-077d4e03a6bd\" (UID: \"8b565a61-2442-44b4-89a6-077d4e03a6bd\") " Sep 18 21:55:27.042505 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042448 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8b565a61-2442-44b4-89a6-077d4e03a6bd" (UID: "8b565a61-2442-44b4-89a6-077d4e03a6bd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:55:27.042505 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042457 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8b565a61-2442-44b4-89a6-077d4e03a6bd" (UID: "8b565a61-2442-44b4-89a6-077d4e03a6bd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:55:27.042609 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042578 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-service-ca" (OuterVolumeSpecName: "service-ca") pod "8b565a61-2442-44b4-89a6-077d4e03a6bd" (UID: "8b565a61-2442-44b4-89a6-077d4e03a6bd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:55:27.042718 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.042698 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-config" (OuterVolumeSpecName: "console-config") pod "8b565a61-2442-44b4-89a6-077d4e03a6bd" (UID: "8b565a61-2442-44b4-89a6-077d4e03a6bd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:55:27.044392 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.044363 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b565a61-2442-44b4-89a6-077d4e03a6bd-kube-api-access-4bdlr" (OuterVolumeSpecName: "kube-api-access-4bdlr") pod "8b565a61-2442-44b4-89a6-077d4e03a6bd" (UID: "8b565a61-2442-44b4-89a6-077d4e03a6bd"). InnerVolumeSpecName "kube-api-access-4bdlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:55:27.044825 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.044799 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8b565a61-2442-44b4-89a6-077d4e03a6bd" (UID: "8b565a61-2442-44b4-89a6-077d4e03a6bd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:55:27.044825 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.044814 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8b565a61-2442-44b4-89a6-077d4e03a6bd" (UID: "8b565a61-2442-44b4-89a6-077d4e03a6bd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:55:27.142827 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.142792 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-service-ca\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:55:27.142827 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.142823 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-oauth-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:55:27.142827 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.142834 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bdlr\" (UniqueName: \"kubernetes.io/projected/8b565a61-2442-44b4-89a6-077d4e03a6bd-kube-api-access-4bdlr\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:55:27.142992 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.142844 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:55:27.142992 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.142853 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-trusted-ca-bundle\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:55:27.142992 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.142862 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b565a61-2442-44b4-89a6-077d4e03a6bd-oauth-serving-cert\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:55:27.142992 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.142871 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b565a61-2442-44b4-89a6-077d4e03a6bd-console-serving-cert\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:55:27.640485 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.640455 2567 generic.go:356] "Generic (PLEG): container finished" podID="8b565a61-2442-44b4-89a6-077d4e03a6bd" containerID="35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7" exitCode=0 Sep 18 21:55:27.640926 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.640522 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd7c6c449-crb9f" event={"ID":"8b565a61-2442-44b4-89a6-077d4e03a6bd","Type":"ContainerDied","Data":"35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7"} Sep 18 21:55:27.640926 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.640532 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd7c6c449-crb9f" Sep 18 21:55:27.640926 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.640566 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd7c6c449-crb9f" event={"ID":"8b565a61-2442-44b4-89a6-077d4e03a6bd","Type":"ContainerDied","Data":"c3a5ce214d3b33428f10e0d13fc3403d5ef62b5ceaed7d6896ad1c44f1d294b4"} Sep 18 21:55:27.640926 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.640595 2567 scope.go:117] "RemoveContainer" containerID="35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7" Sep 18 21:55:27.650058 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.650037 2567 scope.go:117] "RemoveContainer" containerID="35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7" Sep 18 21:55:27.650410 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:55:27.650392 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7\": container with ID starting with 35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7 not found: ID does not exist" containerID="35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7" Sep 18 21:55:27.650477 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.650418 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7"} err="failed to get container status \"35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7\": rpc error: code = NotFound desc = could not find container \"35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7\": container with ID starting with 35fbbcebd45bdbf7d4a24fce5b05b0b9d61f3a43b824f8f6bf64855836a286c7 not found: ID does not exist" Sep 18 21:55:27.663728 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.663667 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd7c6c449-crb9f"] Sep 18 21:55:27.668147 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:27.668107 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cd7c6c449-crb9f"] Sep 18 21:55:29.394016 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:29.393981 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b565a61-2442-44b4-89a6-077d4e03a6bd" path="/var/lib/kubelet/pods/8b565a61-2442-44b4-89a6-077d4e03a6bd/volumes" Sep 18 21:55:49.259629 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:49.259600 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/2.log" Sep 18 21:55:49.262093 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:49.262072 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/2.log" Sep 18 21:55:49.270306 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:55:49.270290 2567 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 21:56:06.317915 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.317880 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689667b9f5-98bp4"] Sep 18 21:56:06.318415 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.318186 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b565a61-2442-44b4-89a6-077d4e03a6bd" containerName="console" Sep 18 21:56:06.318415 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.318199 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b565a61-2442-44b4-89a6-077d4e03a6bd" containerName="console" Sep 18 21:56:06.318415 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.318269 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b565a61-2442-44b4-89a6-077d4e03a6bd" containerName="console" Sep 18 21:56:06.321793 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.321762 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.347176 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.347152 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689667b9f5-98bp4"] Sep 18 21:56:06.416329 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.416308 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-oauth-serving-cert\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.416452 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.416337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-serving-cert\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.416452 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.416355 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-trusted-ca-bundle\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.416452 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.416371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-service-ca\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.416635 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.416487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-console-config\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.416635 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.416538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-oauth-config\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.416635 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.416567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjvf\" (UniqueName: \"kubernetes.io/projected/0a2f7ac3-0664-4054-85c8-e764e3340540-kube-api-access-wjjvf\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.517541 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.517516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-oauth-serving-cert\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.517641 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.517547 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-serving-cert\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.517641 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.517562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-trusted-ca-bundle\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.517641 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.517580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-service-ca\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.517641 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.517626 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-console-config\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.517853 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.517779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-oauth-config\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.517853 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.517820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjvf\" (UniqueName: \"kubernetes.io/projected/0a2f7ac3-0664-4054-85c8-e764e3340540-kube-api-access-wjjvf\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.518303 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.518273 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-service-ca\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.518401 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.518302 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-oauth-serving-cert\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.518401 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.518342 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-console-config\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.518591 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.518573 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-trusted-ca-bundle\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.520199 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.520173 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-serving-cert\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.520303 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.520287 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-oauth-config\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.527327 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.527309 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjvf\" (UniqueName: \"kubernetes.io/projected/0a2f7ac3-0664-4054-85c8-e764e3340540-kube-api-access-wjjvf\") pod \"console-689667b9f5-98bp4\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.633423 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.633360 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:06.919516 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:06.919494 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689667b9f5-98bp4"] Sep 18 21:56:06.921942 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:56:06.921917 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2f7ac3_0664_4054_85c8_e764e3340540.slice/crio-2a6dc2663bb78bca27e39c2341de1cc1fa3ae0e2ed590a2faaee03fda36756b3 WatchSource:0}: Error finding container 2a6dc2663bb78bca27e39c2341de1cc1fa3ae0e2ed590a2faaee03fda36756b3: Status 404 returned error can't find the container with id 2a6dc2663bb78bca27e39c2341de1cc1fa3ae0e2ed590a2faaee03fda36756b3 Sep 18 21:56:07.800572 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:07.800529 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689667b9f5-98bp4" event={"ID":"0a2f7ac3-0664-4054-85c8-e764e3340540","Type":"ContainerStarted","Data":"2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab"} Sep 18 21:56:07.800976 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:07.800594 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689667b9f5-98bp4" event={"ID":"0a2f7ac3-0664-4054-85c8-e764e3340540","Type":"ContainerStarted","Data":"2a6dc2663bb78bca27e39c2341de1cc1fa3ae0e2ed590a2faaee03fda36756b3"} Sep 18 21:56:07.824684 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:07.824633 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689667b9f5-98bp4" podStartSLOduration=1.82461768 podStartE2EDuration="1.82461768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:56:07.823376911 +0000 UTC m=+320.525942276" watchObservedRunningTime="2026-09-18 21:56:07.82461768 +0000 UTC m=+320.527183043" Sep 18 21:56:16.634270 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:16.634232 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:16.634712 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:16.634337 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:16.639553 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:16.639523 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:16.839600 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:16.839566 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:56:16.916911 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:16.916889 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d9f4849b-hrwqk"] Sep 18 21:56:41.940639 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:41.940539 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d9f4849b-hrwqk" podUID="9a3b0bc6-58d8-4492-aaa4-88984c0eb024" containerName="console" containerID="cri-o://154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9" gracePeriod=15 Sep 18 21:56:42.185207 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.185182 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:56:42.280187 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280100 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-trusted-ca-bundle\") pod \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " Sep 18 21:56:42.280187 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280162 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-config\") pod \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " Sep 18 21:56:42.280389 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280209 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-serving-cert\") pod \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " Sep 18 21:56:42.280389 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280242 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtrt9\" (UniqueName: \"kubernetes.io/projected/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-kube-api-access-dtrt9\") pod \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " Sep 18 21:56:42.280389 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280287 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-oauth-config\") pod \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " Sep 18 21:56:42.280389 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280320 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-oauth-serving-cert\") pod \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " Sep 18 21:56:42.280389 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280356 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-service-ca\") pod \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\" (UID: \"9a3b0bc6-58d8-4492-aaa4-88984c0eb024\") " Sep 18 21:56:42.280642 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280595 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-config" (OuterVolumeSpecName: "console-config") pod "9a3b0bc6-58d8-4492-aaa4-88984c0eb024" (UID: "9a3b0bc6-58d8-4492-aaa4-88984c0eb024"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:56:42.280642 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280624 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a3b0bc6-58d8-4492-aaa4-88984c0eb024" (UID: "9a3b0bc6-58d8-4492-aaa4-88984c0eb024"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:56:42.280791 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280768 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a3b0bc6-58d8-4492-aaa4-88984c0eb024" (UID: "9a3b0bc6-58d8-4492-aaa4-88984c0eb024"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:56:42.280885 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.280863 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a3b0bc6-58d8-4492-aaa4-88984c0eb024" (UID: "9a3b0bc6-58d8-4492-aaa4-88984c0eb024"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:56:42.282496 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.282472 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a3b0bc6-58d8-4492-aaa4-88984c0eb024" (UID: "9a3b0bc6-58d8-4492-aaa4-88984c0eb024"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:56:42.282875 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.282848 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a3b0bc6-58d8-4492-aaa4-88984c0eb024" (UID: "9a3b0bc6-58d8-4492-aaa4-88984c0eb024"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:56:42.282967 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.282890 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-kube-api-access-dtrt9" (OuterVolumeSpecName: "kube-api-access-dtrt9") pod "9a3b0bc6-58d8-4492-aaa4-88984c0eb024" (UID: "9a3b0bc6-58d8-4492-aaa4-88984c0eb024"). InnerVolumeSpecName "kube-api-access-dtrt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:56:42.381469 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.381432 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-oauth-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:56:42.381469 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.381468 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-oauth-serving-cert\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:56:42.381669 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.381484 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-service-ca\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:56:42.381669 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.381498 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-trusted-ca-bundle\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:56:42.381669 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.381511 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:56:42.381669 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.381524 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-console-serving-cert\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:56:42.381669 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.381536 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtrt9\" (UniqueName: \"kubernetes.io/projected/9a3b0bc6-58d8-4492-aaa4-88984c0eb024-kube-api-access-dtrt9\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:56:42.946424 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.946388 2567 generic.go:356] "Generic (PLEG): container finished" podID="9a3b0bc6-58d8-4492-aaa4-88984c0eb024" containerID="154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9" exitCode=0 Sep 18 21:56:42.946819 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.946436 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d9f4849b-hrwqk" event={"ID":"9a3b0bc6-58d8-4492-aaa4-88984c0eb024","Type":"ContainerDied","Data":"154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9"} Sep 18 21:56:42.946819 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.946444 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d9f4849b-hrwqk" Sep 18 21:56:42.946819 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.946481 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d9f4849b-hrwqk" event={"ID":"9a3b0bc6-58d8-4492-aaa4-88984c0eb024","Type":"ContainerDied","Data":"8f3450b9788177a2fc5d366df1f81bee20e4e810861376569b42a6415ec05b3a"} Sep 18 21:56:42.946819 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.946503 2567 scope.go:117] "RemoveContainer" containerID="154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9" Sep 18 21:56:42.955406 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.955390 2567 scope.go:117] "RemoveContainer" containerID="154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9" Sep 18 21:56:42.955664 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:56:42.955646 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9\": container with ID starting with 154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9 not found: ID does not exist" containerID="154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9" Sep 18 21:56:42.955705 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.955674 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9"} err="failed to get container status \"154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9\": rpc error: code = NotFound desc = could not find container \"154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9\": container with ID starting with 154552f8c37d1dbd0d92001e4c5a58de8b4368aaa89d4b8262febd488eacc0b9 not found: ID does not exist" Sep 18 21:56:42.970982 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.970960 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d9f4849b-hrwqk"] Sep 18 21:56:42.974823 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:42.974804 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d9f4849b-hrwqk"] Sep 18 21:56:43.399482 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:56:43.399406 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a3b0bc6-58d8-4492-aaa4-88984c0eb024" path="/var/lib/kubelet/pods/9a3b0bc6-58d8-4492-aaa4-88984c0eb024/volumes" Sep 18 21:57:00.589631 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.589599 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn"] Sep 18 21:57:00.589997 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.589890 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a3b0bc6-58d8-4492-aaa4-88984c0eb024" containerName="console" Sep 18 21:57:00.589997 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.589901 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a3b0bc6-58d8-4492-aaa4-88984c0eb024" containerName="console" Sep 18 21:57:00.589997 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.589959 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a3b0bc6-58d8-4492-aaa4-88984c0eb024" containerName="console" Sep 18 21:57:00.594353 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.594336 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.597379 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.597359 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 21:57:00.598676 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.598661 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 21:57:00.598738 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.598699 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pf5gv\"" Sep 18 21:57:00.602494 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.602473 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn"] Sep 18 21:57:00.626390 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.626366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgpq7\" (UniqueName: \"kubernetes.io/projected/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-kube-api-access-qgpq7\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.626489 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.626402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.626489 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.626427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.727170 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.727145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.727243 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.727221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgpq7\" (UniqueName: \"kubernetes.io/projected/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-kube-api-access-qgpq7\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.727281 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.727252 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.727408 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.727391 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.727556 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.727536 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.736910 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.736886 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgpq7\" (UniqueName: \"kubernetes.io/projected/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-kube-api-access-qgpq7\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:00.903424 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:00.903341 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:01.178570 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:01.178542 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn"] Sep 18 21:57:01.180881 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:57:01.180856 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cb787a_df7e_4b4b_bb8c_8fb596fe7be0.slice/crio-38a2287fca3216680e27a20aea6ec5d1c79da54e67b626a9768f82a11155a7d8 WatchSource:0}: Error finding container 38a2287fca3216680e27a20aea6ec5d1c79da54e67b626a9768f82a11155a7d8: Status 404 returned error can't find the container with id 38a2287fca3216680e27a20aea6ec5d1c79da54e67b626a9768f82a11155a7d8 Sep 18 21:57:01.182867 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:01.182846 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 21:57:02.020412 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:02.020369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" event={"ID":"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0","Type":"ContainerStarted","Data":"38a2287fca3216680e27a20aea6ec5d1c79da54e67b626a9768f82a11155a7d8"} Sep 18 21:57:08.047035 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:08.046996 2567 generic.go:356] "Generic (PLEG): container finished" podID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerID="31fb1129b9c0acbfffeae962622dd5ec58aeca4f05d733b07c54fd674f56e440" exitCode=0 Sep 18 21:57:08.047401 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:08.047081 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" event={"ID":"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0","Type":"ContainerDied","Data":"31fb1129b9c0acbfffeae962622dd5ec58aeca4f05d733b07c54fd674f56e440"} Sep 18 21:57:10.057566 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:10.057473 2567 generic.go:356] "Generic (PLEG): container finished" podID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerID="74e932511e7e7907878868f69781190696bb58ef15dfe3a819e6a18ca22c52c4" exitCode=0 Sep 18 21:57:10.057931 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:10.057557 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" event={"ID":"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0","Type":"ContainerDied","Data":"74e932511e7e7907878868f69781190696bb58ef15dfe3a819e6a18ca22c52c4"} Sep 18 21:57:17.090038 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:17.090005 2567 generic.go:356] "Generic (PLEG): container finished" podID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerID="8b30979d6cc40263a330958c253babadbb560679e202ba957c7c361d058a5408" exitCode=0 Sep 18 21:57:17.090460 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:17.090064 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" event={"ID":"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0","Type":"ContainerDied","Data":"8b30979d6cc40263a330958c253babadbb560679e202ba957c7c361d058a5408"} Sep 18 21:57:18.217352 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.217326 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:18.249351 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.249326 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-bundle\") pod \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " Sep 18 21:57:18.249458 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.249360 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-util\") pod \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " Sep 18 21:57:18.249458 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.249381 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgpq7\" (UniqueName: \"kubernetes.io/projected/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-kube-api-access-qgpq7\") pod \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\" (UID: \"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0\") " Sep 18 21:57:18.249946 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.249924 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-bundle" (OuterVolumeSpecName: "bundle") pod "f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" (UID: "f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:57:18.251607 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.251583 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-kube-api-access-qgpq7" (OuterVolumeSpecName: "kube-api-access-qgpq7") pod "f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" (UID: "f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0"). InnerVolumeSpecName "kube-api-access-qgpq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:57:18.253986 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.253962 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-util" (OuterVolumeSpecName: "util") pod "f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" (UID: "f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:57:18.350519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.350443 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-bundle\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:57:18.350519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.350469 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-util\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:57:18.350519 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:18.350479 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgpq7\" (UniqueName: \"kubernetes.io/projected/f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0-kube-api-access-qgpq7\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:57:19.101033 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:19.100991 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" event={"ID":"f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0","Type":"ContainerDied","Data":"38a2287fca3216680e27a20aea6ec5d1c79da54e67b626a9768f82a11155a7d8"} Sep 18 21:57:19.101244 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:19.101054 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38a2287fca3216680e27a20aea6ec5d1c79da54e67b626a9768f82a11155a7d8" Sep 18 21:57:19.101244 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:19.101002 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ancjtn" Sep 18 21:57:25.303447 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.303413 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d"] Sep 18 21:57:25.303816 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.303700 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerName="pull" Sep 18 21:57:25.303816 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.303710 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerName="pull" Sep 18 21:57:25.303816 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.303720 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerName="util" Sep 18 21:57:25.303816 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.303726 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerName="util" Sep 18 21:57:25.303816 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.303733 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerName="extract" Sep 18 21:57:25.303816 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.303739 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerName="extract" Sep 18 21:57:25.303816 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.303798 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4cb787a-df7e-4b4b-bb8c-8fb596fe7be0" containerName="extract" Sep 18 21:57:25.348678 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.348651 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d"] Sep 18 21:57:25.348799 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.348731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:25.353890 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.353866 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 18 21:57:25.354001 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.353892 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Sep 18 21:57:25.354001 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.353923 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 18 21:57:25.357543 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.357525 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-vxvjj\"" Sep 18 21:57:25.400613 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.400587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2605b07c-4e09-4776-96e7-c1117575cbd0-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-sxt4d\" (UID: \"2605b07c-4e09-4776-96e7-c1117575cbd0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:25.400738 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.400625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsvlb\" (UniqueName: \"kubernetes.io/projected/2605b07c-4e09-4776-96e7-c1117575cbd0-kube-api-access-rsvlb\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-sxt4d\" (UID: \"2605b07c-4e09-4776-96e7-c1117575cbd0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:25.501837 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.501803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2605b07c-4e09-4776-96e7-c1117575cbd0-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-sxt4d\" (UID: \"2605b07c-4e09-4776-96e7-c1117575cbd0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:25.502002 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.501844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsvlb\" (UniqueName: \"kubernetes.io/projected/2605b07c-4e09-4776-96e7-c1117575cbd0-kube-api-access-rsvlb\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-sxt4d\" (UID: \"2605b07c-4e09-4776-96e7-c1117575cbd0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:25.504092 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.504072 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/2605b07c-4e09-4776-96e7-c1117575cbd0-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-sxt4d\" (UID: \"2605b07c-4e09-4776-96e7-c1117575cbd0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:25.525835 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.525804 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsvlb\" (UniqueName: \"kubernetes.io/projected/2605b07c-4e09-4776-96e7-c1117575cbd0-kube-api-access-rsvlb\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-sxt4d\" (UID: \"2605b07c-4e09-4776-96e7-c1117575cbd0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:25.658858 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.658771 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:25.992268 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:25.992238 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d"] Sep 18 21:57:25.995722 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:57:25.995696 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2605b07c_4e09_4776_96e7_c1117575cbd0.slice/crio-851df073caa94c76efd1b4cbc47750070d8f2369b0fea4f95b1afd2a1f56a3a6 WatchSource:0}: Error finding container 851df073caa94c76efd1b4cbc47750070d8f2369b0fea4f95b1afd2a1f56a3a6: Status 404 returned error can't find the container with id 851df073caa94c76efd1b4cbc47750070d8f2369b0fea4f95b1afd2a1f56a3a6 Sep 18 21:57:26.129427 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:26.129384 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" event={"ID":"2605b07c-4e09-4776-96e7-c1117575cbd0","Type":"ContainerStarted","Data":"851df073caa94c76efd1b4cbc47750070d8f2369b0fea4f95b1afd2a1f56a3a6"} Sep 18 21:57:30.058418 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.058376 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-xsj4j"] Sep 18 21:57:30.076566 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.076534 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.080528 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.080258 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Sep 18 21:57:30.080528 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.080288 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Sep 18 21:57:30.080528 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.080265 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-fv4h6\"" Sep 18 21:57:30.081415 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.081389 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-xsj4j"] Sep 18 21:57:30.144853 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.144823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5be521a8-4da2-4867-8359-8fa4608e7e25-cabundle0\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.145027 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.144866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.145027 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.144965 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgtgz\" (UniqueName: \"kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-kube-api-access-hgtgz\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.149392 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.149359 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" event={"ID":"2605b07c-4e09-4776-96e7-c1117575cbd0","Type":"ContainerStarted","Data":"bc78c6d37b95d3555efaaa8fe37225c3da24b35f12a23e9ceabe00f9ec3fa450"} Sep 18 21:57:30.149535 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.149452 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:30.179592 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.179538 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" podStartSLOduration=2.033130279 podStartE2EDuration="5.179521701s" totalImagesPullingTime="3.146391422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:57:30.177296749 +0000 UTC m=+402.879862113" watchObservedRunningTime="2026-09-18 21:57:30.179521701 +0000 UTC m=+402.882087065" Sep 18 21:57:30.246290 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.246257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgtgz\" (UniqueName: \"kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-kube-api-access-hgtgz\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.246476 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.246352 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5be521a8-4da2-4867-8359-8fa4608e7e25-cabundle0\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.246476 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.246384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.246596 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.246482 2567 secret.go:281] references non-existent secret key: ca.crt Sep 18 21:57:30.246596 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.246499 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 18 21:57:30.246596 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.246509 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-xsj4j: references non-existent secret key: ca.crt Sep 18 21:57:30.246596 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.246574 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates podName:5be521a8-4da2-4867-8359-8fa4608e7e25 nodeName:}" failed. No retries permitted until 2026-09-18 21:57:30.74655697 +0000 UTC m=+403.449122311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates") pod "keda-operator-579c8958f7-xsj4j" (UID: "5be521a8-4da2-4867-8359-8fa4608e7e25") : references non-existent secret key: ca.crt Sep 18 21:57:30.247039 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.247015 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5be521a8-4da2-4867-8359-8fa4608e7e25-cabundle0\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.261025 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.260995 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgtgz\" (UniqueName: \"kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-kube-api-access-hgtgz\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.277530 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.277497 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb"] Sep 18 21:57:30.295410 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.295385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.298706 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.298652 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Sep 18 21:57:30.299818 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.299793 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb"] Sep 18 21:57:30.346811 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.346718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.346811 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.346766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb6cq\" (UniqueName: \"kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-kube-api-access-sb6cq\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.346995 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.346845 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d54512dd-9777-45cd-a0fe-234e73de2c5d-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.448332 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.448287 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.448504 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.448345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb6cq\" (UniqueName: \"kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-kube-api-access-sb6cq\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.448504 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.448431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d54512dd-9777-45cd-a0fe-234e73de2c5d-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.448504 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.448452 2567 secret.go:281] references non-existent secret key: tls.crt Sep 18 21:57:30.448504 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.448488 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Sep 18 21:57:30.448636 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.448511 2567 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Sep 18 21:57:30.448636 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.448533 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Sep 18 21:57:30.448636 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.448597 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates podName:d54512dd-9777-45cd-a0fe-234e73de2c5d nodeName:}" failed. No retries permitted until 2026-09-18 21:57:30.948576788 +0000 UTC m=+403.651142142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates") pod "keda-metrics-apiserver-77857b7b98-x9xpb" (UID: "d54512dd-9777-45cd-a0fe-234e73de2c5d") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Sep 18 21:57:30.448876 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.448859 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d54512dd-9777-45cd-a0fe-234e73de2c5d-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.462643 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.462613 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb6cq\" (UniqueName: \"kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-kube-api-access-sb6cq\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.752056 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.752014 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:30.752254 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.752174 2567 secret.go:281] references non-existent secret key: ca.crt Sep 18 21:57:30.752254 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.752195 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 18 21:57:30.752254 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.752204 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-xsj4j: references non-existent secret key: ca.crt Sep 18 21:57:30.752358 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.752262 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates podName:5be521a8-4da2-4867-8359-8fa4608e7e25 nodeName:}" failed. No retries permitted until 2026-09-18 21:57:31.752245678 +0000 UTC m=+404.454811018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates") pod "keda-operator-579c8958f7-xsj4j" (UID: "5be521a8-4da2-4867-8359-8fa4608e7e25") : references non-existent secret key: ca.crt Sep 18 21:57:30.953838 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:30.953801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:30.954039 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.953964 2567 secret.go:281] references non-existent secret key: tls.crt Sep 18 21:57:30.954039 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.953991 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Sep 18 21:57:30.954039 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.954015 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb: references non-existent secret key: tls.crt Sep 18 21:57:30.954236 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:57:30.954105 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates podName:d54512dd-9777-45cd-a0fe-234e73de2c5d nodeName:}" failed. No retries permitted until 2026-09-18 21:57:31.954083983 +0000 UTC m=+404.656649329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates") pod "keda-metrics-apiserver-77857b7b98-x9xpb" (UID: "d54512dd-9777-45cd-a0fe-234e73de2c5d") : references non-existent secret key: tls.crt Sep 18 21:57:31.272019 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.271982 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-krxq8"] Sep 18 21:57:31.293886 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.293850 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:31.297743 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.297715 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Sep 18 21:57:31.308631 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.308600 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-krxq8"] Sep 18 21:57:31.357869 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.357828 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/786199e0-6aa4-4f5f-9d40-012fc72f0cd4-certificates\") pod \"keda-admission-6c4d864b86-krxq8\" (UID: \"786199e0-6aa4-4f5f-9d40-012fc72f0cd4\") " pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:31.358042 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.358004 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr4qz\" (UniqueName: \"kubernetes.io/projected/786199e0-6aa4-4f5f-9d40-012fc72f0cd4-kube-api-access-kr4qz\") pod \"keda-admission-6c4d864b86-krxq8\" (UID: \"786199e0-6aa4-4f5f-9d40-012fc72f0cd4\") " pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:31.459399 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.459363 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/786199e0-6aa4-4f5f-9d40-012fc72f0cd4-certificates\") pod \"keda-admission-6c4d864b86-krxq8\" (UID: \"786199e0-6aa4-4f5f-9d40-012fc72f0cd4\") " pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:31.459720 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.459693 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr4qz\" (UniqueName: \"kubernetes.io/projected/786199e0-6aa4-4f5f-9d40-012fc72f0cd4-kube-api-access-kr4qz\") pod \"keda-admission-6c4d864b86-krxq8\" (UID: \"786199e0-6aa4-4f5f-9d40-012fc72f0cd4\") " pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:31.462416 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.462398 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/786199e0-6aa4-4f5f-9d40-012fc72f0cd4-certificates\") pod \"keda-admission-6c4d864b86-krxq8\" (UID: \"786199e0-6aa4-4f5f-9d40-012fc72f0cd4\") " pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:31.472547 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.472522 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr4qz\" (UniqueName: \"kubernetes.io/projected/786199e0-6aa4-4f5f-9d40-012fc72f0cd4-kube-api-access-kr4qz\") pod \"keda-admission-6c4d864b86-krxq8\" (UID: \"786199e0-6aa4-4f5f-9d40-012fc72f0cd4\") " pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:31.604417 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.604341 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:31.762652 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.762614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:31.765151 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.765108 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5be521a8-4da2-4867-8359-8fa4608e7e25-certificates\") pod \"keda-operator-579c8958f7-xsj4j\" (UID: \"5be521a8-4da2-4867-8359-8fa4608e7e25\") " pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:31.888822 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.888717 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:31.909171 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:57:31.909097 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786199e0_6aa4_4f5f_9d40_012fc72f0cd4.slice/crio-8ac2195c3b26d881920978d93caca5e265f26357ed203ebea3ee56a9ecd9f0d7 WatchSource:0}: Error finding container 8ac2195c3b26d881920978d93caca5e265f26357ed203ebea3ee56a9ecd9f0d7: Status 404 returned error can't find the container with id 8ac2195c3b26d881920978d93caca5e265f26357ed203ebea3ee56a9ecd9f0d7 Sep 18 21:57:31.909413 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.909389 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-krxq8"] Sep 18 21:57:31.964662 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.964625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:31.967243 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:31.967219 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d54512dd-9777-45cd-a0fe-234e73de2c5d-certificates\") pod \"keda-metrics-apiserver-77857b7b98-x9xpb\" (UID: \"d54512dd-9777-45cd-a0fe-234e73de2c5d\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:32.107349 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:32.107310 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:32.161828 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:32.161779 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-krxq8" event={"ID":"786199e0-6aa4-4f5f-9d40-012fc72f0cd4","Type":"ContainerStarted","Data":"8ac2195c3b26d881920978d93caca5e265f26357ed203ebea3ee56a9ecd9f0d7"} Sep 18 21:57:32.179652 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:32.179492 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-xsj4j"] Sep 18 21:57:32.181706 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:57:32.181677 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be521a8_4da2_4867_8359_8fa4608e7e25.slice/crio-a5fb27b88834668a2bcf154a7e0a2d385ba177a096283f508a64574207959e09 WatchSource:0}: Error finding container a5fb27b88834668a2bcf154a7e0a2d385ba177a096283f508a64574207959e09: Status 404 returned error can't find the container with id a5fb27b88834668a2bcf154a7e0a2d385ba177a096283f508a64574207959e09 Sep 18 21:57:32.381015 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:32.380988 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb"] Sep 18 21:57:32.382909 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:57:32.382879 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54512dd_9777_45cd_a0fe_234e73de2c5d.slice/crio-77275f49ec4e7177b1810a7294ddb4f24f05d68912b5eaeeeb0bb76d42b8252a WatchSource:0}: Error finding container 77275f49ec4e7177b1810a7294ddb4f24f05d68912b5eaeeeb0bb76d42b8252a: Status 404 returned error can't find the container with id 77275f49ec4e7177b1810a7294ddb4f24f05d68912b5eaeeeb0bb76d42b8252a Sep 18 21:57:33.169340 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:33.169261 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-xsj4j" event={"ID":"5be521a8-4da2-4867-8359-8fa4608e7e25","Type":"ContainerStarted","Data":"a5fb27b88834668a2bcf154a7e0a2d385ba177a096283f508a64574207959e09"} Sep 18 21:57:33.170892 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:33.170859 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" event={"ID":"d54512dd-9777-45cd-a0fe-234e73de2c5d","Type":"ContainerStarted","Data":"77275f49ec4e7177b1810a7294ddb4f24f05d68912b5eaeeeb0bb76d42b8252a"} Sep 18 21:57:34.178709 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:34.178666 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-krxq8" event={"ID":"786199e0-6aa4-4f5f-9d40-012fc72f0cd4","Type":"ContainerStarted","Data":"ab814324f2e64dbeaf862f9238caa89e0d4e9339218f42508061fe0604c37e60"} Sep 18 21:57:34.179197 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:34.178750 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:34.206429 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:34.206373 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-krxq8" podStartSLOduration=1.768420616 podStartE2EDuration="3.206356563s" totalImagesPullingTime="1.437935947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:57:34.203891451 +0000 UTC m=+406.906456812" watchObservedRunningTime="2026-09-18 21:57:34.206356563 +0000 UTC m=+406.908921929" Sep 18 21:57:36.195953 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:36.195909 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-xsj4j" event={"ID":"5be521a8-4da2-4867-8359-8fa4608e7e25","Type":"ContainerStarted","Data":"77c81820bb3311736b860145a5f7974b3e6794c156e800fab1fd6887817514dd"} Sep 18 21:57:36.196450 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:36.196026 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:57:36.197976 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:36.197947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" event={"ID":"d54512dd-9777-45cd-a0fe-234e73de2c5d","Type":"ContainerStarted","Data":"d8f8ed018fe24ef59e3bf51f4dcd8e349efcb4b6eb0613a56c8a41350c79af90"} Sep 18 21:57:36.198142 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:36.198113 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:36.228764 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:36.228692 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-xsj4j" podStartSLOduration=2.497173858 podStartE2EDuration="6.228676757s" totalImagesPullingTime="3.731502899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:57:36.227219528 +0000 UTC m=+408.929784890" watchObservedRunningTime="2026-09-18 21:57:36.228676757 +0000 UTC m=+408.931242120" Sep 18 21:57:36.264407 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:36.264352 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" podStartSLOduration=2.734163313 podStartE2EDuration="6.264337318s" totalImagesPullingTime="3.530174005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:57:36.263162165 +0000 UTC m=+408.965727532" watchObservedRunningTime="2026-09-18 21:57:36.264337318 +0000 UTC m=+408.966902679" Sep 18 21:57:47.207857 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:47.207828 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-x9xpb" Sep 18 21:57:51.155934 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:51.155899 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-sxt4d" Sep 18 21:57:55.185878 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:55.185846 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-krxq8" Sep 18 21:57:57.206038 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:57:57.206009 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-xsj4j" Sep 18 21:59:00.634443 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.634409 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-575575dfd7-74g6h"] Sep 18 21:59:00.636520 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.636503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:00.640026 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.640002 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 18 21:59:00.640150 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.640055 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Sep 18 21:59:00.640370 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.640352 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 18 21:59:00.641394 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.641379 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-9d5ns\"" Sep 18 21:59:00.646575 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.646553 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-448p6"] Sep 18 21:59:00.648568 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.648551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:00.651783 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.651765 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Sep 18 21:59:00.651885 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.651771 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-xqfrh\"" Sep 18 21:59:00.657219 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.657200 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575575dfd7-74g6h"] Sep 18 21:59:00.665457 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.665433 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-448p6"] Sep 18 21:59:00.767674 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.767648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1088b9e5-a182-42ba-a89e-91d07713ac48-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-448p6\" (UID: \"1088b9e5-a182-42ba-a89e-91d07713ac48\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:00.767769 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.767690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sxj6\" (UniqueName: \"kubernetes.io/projected/d4c25f2c-c857-4a2c-abb2-957992ccafb1-kube-api-access-8sxj6\") pod \"kserve-controller-manager-575575dfd7-74g6h\" (UID: \"d4c25f2c-c857-4a2c-abb2-957992ccafb1\") " pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:00.767769 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.767717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfccg\" (UniqueName: \"kubernetes.io/projected/1088b9e5-a182-42ba-a89e-91d07713ac48-kube-api-access-sfccg\") pod \"llmisvc-controller-manager-645f9c8fd6-448p6\" (UID: \"1088b9e5-a182-42ba-a89e-91d07713ac48\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:00.767860 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.767774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4c25f2c-c857-4a2c-abb2-957992ccafb1-cert\") pod \"kserve-controller-manager-575575dfd7-74g6h\" (UID: \"d4c25f2c-c857-4a2c-abb2-957992ccafb1\") " pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:00.868956 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.868929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfccg\" (UniqueName: \"kubernetes.io/projected/1088b9e5-a182-42ba-a89e-91d07713ac48-kube-api-access-sfccg\") pod \"llmisvc-controller-manager-645f9c8fd6-448p6\" (UID: \"1088b9e5-a182-42ba-a89e-91d07713ac48\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:00.869088 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.868974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4c25f2c-c857-4a2c-abb2-957992ccafb1-cert\") pod \"kserve-controller-manager-575575dfd7-74g6h\" (UID: \"d4c25f2c-c857-4a2c-abb2-957992ccafb1\") " pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:00.869088 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.869041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1088b9e5-a182-42ba-a89e-91d07713ac48-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-448p6\" (UID: \"1088b9e5-a182-42ba-a89e-91d07713ac48\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:00.869252 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.869099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sxj6\" (UniqueName: \"kubernetes.io/projected/d4c25f2c-c857-4a2c-abb2-957992ccafb1-kube-api-access-8sxj6\") pod \"kserve-controller-manager-575575dfd7-74g6h\" (UID: \"d4c25f2c-c857-4a2c-abb2-957992ccafb1\") " pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:00.871623 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.871596 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1088b9e5-a182-42ba-a89e-91d07713ac48-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-448p6\" (UID: \"1088b9e5-a182-42ba-a89e-91d07713ac48\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:00.871718 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.871638 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4c25f2c-c857-4a2c-abb2-957992ccafb1-cert\") pod \"kserve-controller-manager-575575dfd7-74g6h\" (UID: \"d4c25f2c-c857-4a2c-abb2-957992ccafb1\") " pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:00.881369 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.881345 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfccg\" (UniqueName: \"kubernetes.io/projected/1088b9e5-a182-42ba-a89e-91d07713ac48-kube-api-access-sfccg\") pod \"llmisvc-controller-manager-645f9c8fd6-448p6\" (UID: \"1088b9e5-a182-42ba-a89e-91d07713ac48\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:00.881664 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.881644 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sxj6\" (UniqueName: \"kubernetes.io/projected/d4c25f2c-c857-4a2c-abb2-957992ccafb1-kube-api-access-8sxj6\") pod \"kserve-controller-manager-575575dfd7-74g6h\" (UID: \"d4c25f2c-c857-4a2c-abb2-957992ccafb1\") " pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:00.946580 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.946559 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:00.957356 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:00.957338 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:01.232168 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:01.232108 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575575dfd7-74g6h"] Sep 18 21:59:01.233331 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:59:01.233304 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1088b9e5_a182_42ba_a89e_91d07713ac48.slice/crio-383a575b0236e407f37d4619aaf55dd4a71d8ac996a40ce6e543d5b139e64ce9 WatchSource:0}: Error finding container 383a575b0236e407f37d4619aaf55dd4a71d8ac996a40ce6e543d5b139e64ce9: Status 404 returned error can't find the container with id 383a575b0236e407f37d4619aaf55dd4a71d8ac996a40ce6e543d5b139e64ce9 Sep 18 21:59:01.233900 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:01.233809 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-448p6"] Sep 18 21:59:01.233954 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:59:01.233900 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c25f2c_c857_4a2c_abb2_957992ccafb1.slice/crio-f78a980a476612b434191deb818d02386273b33291a6875344070d276b411e75 WatchSource:0}: Error finding container f78a980a476612b434191deb818d02386273b33291a6875344070d276b411e75: Status 404 returned error can't find the container with id f78a980a476612b434191deb818d02386273b33291a6875344070d276b411e75 Sep 18 21:59:01.596572 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:01.596492 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" event={"ID":"1088b9e5-a182-42ba-a89e-91d07713ac48","Type":"ContainerStarted","Data":"383a575b0236e407f37d4619aaf55dd4a71d8ac996a40ce6e543d5b139e64ce9"} Sep 18 21:59:01.597744 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:01.597719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575575dfd7-74g6h" event={"ID":"d4c25f2c-c857-4a2c-abb2-957992ccafb1","Type":"ContainerStarted","Data":"f78a980a476612b434191deb818d02386273b33291a6875344070d276b411e75"} Sep 18 21:59:02.381279 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.381247 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5647c69f8f-rsmkb"] Sep 18 21:59:02.384543 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.384024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.402597 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.402544 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5647c69f8f-rsmkb"] Sep 18 21:59:02.482699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.482377 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f59965-dc06-495a-a9a5-fb5e796eff25-console-serving-cert\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.482699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.482427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f59965-dc06-495a-a9a5-fb5e796eff25-console-oauth-config\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.482699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.482461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbnf6\" (UniqueName: \"kubernetes.io/projected/78f59965-dc06-495a-a9a5-fb5e796eff25-kube-api-access-gbnf6\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.482699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.482527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-oauth-serving-cert\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.482699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.482572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-trusted-ca-bundle\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.482699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.482605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-service-ca\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.482699 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.482655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-console-config\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.583462 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.583434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-oauth-serving-cert\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.583610 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.583488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-trusted-ca-bundle\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.583610 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.583523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-service-ca\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.583610 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.583561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-console-config\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.583610 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.583602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f59965-dc06-495a-a9a5-fb5e796eff25-console-serving-cert\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.583838 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.583634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f59965-dc06-495a-a9a5-fb5e796eff25-console-oauth-config\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.583838 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.583665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbnf6\" (UniqueName: \"kubernetes.io/projected/78f59965-dc06-495a-a9a5-fb5e796eff25-kube-api-access-gbnf6\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.585064 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.584766 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-oauth-serving-cert\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.585064 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.584812 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-console-config\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.585373 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.585059 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-trusted-ca-bundle\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.585373 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.585349 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78f59965-dc06-495a-a9a5-fb5e796eff25-service-ca\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.588410 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.588357 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78f59965-dc06-495a-a9a5-fb5e796eff25-console-oauth-config\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.589650 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.589114 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78f59965-dc06-495a-a9a5-fb5e796eff25-console-serving-cert\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.596218 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.596151 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbnf6\" (UniqueName: \"kubernetes.io/projected/78f59965-dc06-495a-a9a5-fb5e796eff25-kube-api-access-gbnf6\") pod \"console-5647c69f8f-rsmkb\" (UID: \"78f59965-dc06-495a-a9a5-fb5e796eff25\") " pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:02.702250 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:02.702205 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:04.615794 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:04.615751 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575575dfd7-74g6h" event={"ID":"d4c25f2c-c857-4a2c-abb2-957992ccafb1","Type":"ContainerStarted","Data":"f59ab13bb39ec8164faa3f5ada60e3abdb834112613cd7c2f45f608554d48742"} Sep 18 21:59:04.616145 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:04.615935 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:04.643466 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:04.643422 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-575575dfd7-74g6h" podStartSLOduration=1.3528685280000001 podStartE2EDuration="4.643407669s" totalImagesPullingTime="3.290539141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:59:04.641196942 +0000 UTC m=+497.343762306" watchObservedRunningTime="2026-09-18 21:59:04.643407669 +0000 UTC m=+497.345973032" Sep 18 21:59:04.780463 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:04.780440 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5647c69f8f-rsmkb"] Sep 18 21:59:04.781431 ip-10-0-129-249 kubenswrapper[2567]: W0918 21:59:04.781408 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f59965_dc06_495a_a9a5_fb5e796eff25.slice/crio-c5755b9f0986f09223f2b8ffdb2c1844f251dc2557312fadae1cf97c89d35cc3 WatchSource:0}: Error finding container c5755b9f0986f09223f2b8ffdb2c1844f251dc2557312fadae1cf97c89d35cc3: Status 404 returned error can't find the container with id c5755b9f0986f09223f2b8ffdb2c1844f251dc2557312fadae1cf97c89d35cc3 Sep 18 21:59:05.621451 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:05.621409 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647c69f8f-rsmkb" event={"ID":"78f59965-dc06-495a-a9a5-fb5e796eff25","Type":"ContainerStarted","Data":"45ff2d565e61dff7dd5402e0a1cc56284db8b9fdbc3891c2c88464e30565eb18"} Sep 18 21:59:05.621888 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:05.621469 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5647c69f8f-rsmkb" event={"ID":"78f59965-dc06-495a-a9a5-fb5e796eff25","Type":"ContainerStarted","Data":"c5755b9f0986f09223f2b8ffdb2c1844f251dc2557312fadae1cf97c89d35cc3"} Sep 18 21:59:05.623018 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:05.622988 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" event={"ID":"1088b9e5-a182-42ba-a89e-91d07713ac48","Type":"ContainerStarted","Data":"403a1f05e17f19d1b4a9e5582b81016e8bae59542e2f67bff3f6f2e88c8e03e4"} Sep 18 21:59:05.623182 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:05.623155 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:05.643741 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:05.643695 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5647c69f8f-rsmkb" podStartSLOduration=3.64368167 podStartE2EDuration="3.64368167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:59:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:59:05.641643929 +0000 UTC m=+498.344209291" watchObservedRunningTime="2026-09-18 21:59:05.64368167 +0000 UTC m=+498.346247033" Sep 18 21:59:05.668098 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:05.668059 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" podStartSLOduration=2.38734102 podStartE2EDuration="5.668044939s" totalImagesPullingTime="3.280703919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:59:05.667884431 +0000 UTC m=+498.370449791" watchObservedRunningTime="2026-09-18 21:59:05.668044939 +0000 UTC m=+498.370610303" Sep 18 21:59:12.702678 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:12.702629 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:12.703213 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:12.702708 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:12.707865 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:12.707833 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:13.662771 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:13.662740 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5647c69f8f-rsmkb" Sep 18 21:59:13.776391 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:13.776360 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689667b9f5-98bp4"] Sep 18 21:59:35.628586 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:35.628493 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-575575dfd7-74g6h" Sep 18 21:59:36.630953 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:36.630922 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-448p6" Sep 18 21:59:38.794675 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:38.794618 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-689667b9f5-98bp4" podUID="0a2f7ac3-0664-4054-85c8-e764e3340540" containerName="console" containerID="cri-o://2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab" gracePeriod=15 Sep 18 21:59:39.031727 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.031703 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:59:39.044751 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.044697 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-service-ca\") pod \"0a2f7ac3-0664-4054-85c8-e764e3340540\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " Sep 18 21:59:39.044751 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.044743 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-trusted-ca-bundle\") pod \"0a2f7ac3-0664-4054-85c8-e764e3340540\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " Sep 18 21:59:39.044912 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.044783 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-console-config\") pod \"0a2f7ac3-0664-4054-85c8-e764e3340540\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " Sep 18 21:59:39.044912 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.044816 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjjvf\" (UniqueName: \"kubernetes.io/projected/0a2f7ac3-0664-4054-85c8-e764e3340540-kube-api-access-wjjvf\") pod \"0a2f7ac3-0664-4054-85c8-e764e3340540\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " Sep 18 21:59:39.044912 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.044858 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-oauth-config\") pod \"0a2f7ac3-0664-4054-85c8-e764e3340540\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " Sep 18 21:59:39.044912 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.044889 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-serving-cert\") pod \"0a2f7ac3-0664-4054-85c8-e764e3340540\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " Sep 18 21:59:39.045119 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.044926 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-oauth-serving-cert\") pod \"0a2f7ac3-0664-4054-85c8-e764e3340540\" (UID: \"0a2f7ac3-0664-4054-85c8-e764e3340540\") " Sep 18 21:59:39.045197 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.045123 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a2f7ac3-0664-4054-85c8-e764e3340540" (UID: "0a2f7ac3-0664-4054-85c8-e764e3340540"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:59:39.045197 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.045167 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-console-config" (OuterVolumeSpecName: "console-config") pod "0a2f7ac3-0664-4054-85c8-e764e3340540" (UID: "0a2f7ac3-0664-4054-85c8-e764e3340540"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:59:39.045435 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.045203 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0a2f7ac3-0664-4054-85c8-e764e3340540" (UID: "0a2f7ac3-0664-4054-85c8-e764e3340540"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:59:39.045435 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.045234 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-service-ca\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:59:39.045435 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.045252 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-console-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:59:39.045549 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.045452 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a2f7ac3-0664-4054-85c8-e764e3340540" (UID: "0a2f7ac3-0664-4054-85c8-e764e3340540"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:59:39.047029 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.047010 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a2f7ac3-0664-4054-85c8-e764e3340540" (UID: "0a2f7ac3-0664-4054-85c8-e764e3340540"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:59:39.047508 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.047489 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a2f7ac3-0664-4054-85c8-e764e3340540" (UID: "0a2f7ac3-0664-4054-85c8-e764e3340540"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:59:39.047603 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.047513 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2f7ac3-0664-4054-85c8-e764e3340540-kube-api-access-wjjvf" (OuterVolumeSpecName: "kube-api-access-wjjvf") pod "0a2f7ac3-0664-4054-85c8-e764e3340540" (UID: "0a2f7ac3-0664-4054-85c8-e764e3340540"). InnerVolumeSpecName "kube-api-access-wjjvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:59:39.145802 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.145772 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-oauth-config\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:59:39.145802 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.145798 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a2f7ac3-0664-4054-85c8-e764e3340540-console-serving-cert\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:59:39.145802 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.145808 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-oauth-serving-cert\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:59:39.146031 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.145816 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a2f7ac3-0664-4054-85c8-e764e3340540-trusted-ca-bundle\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:59:39.146031 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.145825 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjjvf\" (UniqueName: \"kubernetes.io/projected/0a2f7ac3-0664-4054-85c8-e764e3340540-kube-api-access-wjjvf\") on node \"ip-10-0-129-249.ec2.internal\" DevicePath \"\"" Sep 18 21:59:39.783510 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.783476 2567 generic.go:356] "Generic (PLEG): container finished" podID="0a2f7ac3-0664-4054-85c8-e764e3340540" containerID="2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab" exitCode=0 Sep 18 21:59:39.783687 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.783525 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689667b9f5-98bp4" event={"ID":"0a2f7ac3-0664-4054-85c8-e764e3340540","Type":"ContainerDied","Data":"2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab"} Sep 18 21:59:39.783687 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.783544 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689667b9f5-98bp4" Sep 18 21:59:39.783687 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.783571 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689667b9f5-98bp4" event={"ID":"0a2f7ac3-0664-4054-85c8-e764e3340540","Type":"ContainerDied","Data":"2a6dc2663bb78bca27e39c2341de1cc1fa3ae0e2ed590a2faaee03fda36756b3"} Sep 18 21:59:39.783687 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.783598 2567 scope.go:117] "RemoveContainer" containerID="2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab" Sep 18 21:59:39.791868 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.791849 2567 scope.go:117] "RemoveContainer" containerID="2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab" Sep 18 21:59:39.792217 ip-10-0-129-249 kubenswrapper[2567]: E0918 21:59:39.792196 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab\": container with ID starting with 2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab not found: ID does not exist" containerID="2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab" Sep 18 21:59:39.792263 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.792226 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab"} err="failed to get container status \"2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab\": rpc error: code = NotFound desc = could not find container \"2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab\": container with ID starting with 2241397fffe15fef8b22e2ae1e8276cf596f7694a4d1a70d4a84cf5b9d96aaab not found: ID does not exist" Sep 18 21:59:39.808410 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.808348 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689667b9f5-98bp4"] Sep 18 21:59:39.810403 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:39.810381 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689667b9f5-98bp4"] Sep 18 21:59:41.394947 ip-10-0-129-249 kubenswrapper[2567]: I0918 21:59:41.394902 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a2f7ac3-0664-4054-85c8-e764e3340540" path="/var/lib/kubelet/pods/0a2f7ac3-0664-4054-85c8-e764e3340540/volumes" Sep 18 22:00:14.754195 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:14.754166 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6wvwr_221a8ad9-e6c6-4986-bf4a-cdd50bad02f8/global-pull-secret-syncer/0.log" Sep 18 22:00:14.950872 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:14.950849 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zv7xs_f164b2da-3aca-442e-be9c-0d900172e351/konnectivity-agent/0.log" Sep 18 22:00:14.978962 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:14.978941 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-249.ec2.internal_beb0775bf473807b2efdbafa25f20da9/haproxy/0.log" Sep 18 22:00:19.411110 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.411070 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06bfeb3a-48e6-4038-8ec3-c66271d51932/alertmanager/0.log" Sep 18 22:00:19.458684 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.458656 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06bfeb3a-48e6-4038-8ec3-c66271d51932/config-reloader/0.log" Sep 18 22:00:19.487673 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.487651 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06bfeb3a-48e6-4038-8ec3-c66271d51932/kube-rbac-proxy-web/0.log" Sep 18 22:00:19.517930 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.517913 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06bfeb3a-48e6-4038-8ec3-c66271d51932/kube-rbac-proxy/0.log" Sep 18 22:00:19.558390 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.558366 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06bfeb3a-48e6-4038-8ec3-c66271d51932/kube-rbac-proxy-metric/0.log" Sep 18 22:00:19.598738 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.598719 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06bfeb3a-48e6-4038-8ec3-c66271d51932/prom-label-proxy/0.log" Sep 18 22:00:19.629994 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.629968 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06bfeb3a-48e6-4038-8ec3-c66271d51932/init-config-reloader/0.log" Sep 18 22:00:19.671833 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.671812 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-bvcfr_33de9d4a-7210-4bcf-9570-a06c3953db4d/cluster-monitoring-operator/0.log" Sep 18 22:00:19.812385 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.812363 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d7474ddc7-rjmr8_4d4a1abb-d264-4618-abad-2cf6f3517fc5/metrics-server/0.log" Sep 18 22:00:19.844393 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.844367 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-hh2r2_c2cff06c-ca17-406d-b4c2-802e81913a03/monitoring-plugin/0.log" Sep 18 22:00:19.961865 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.961808 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kmwqr_223f9dd9-608b-4e28-962e-938e14cb5229/node-exporter/0.log" Sep 18 22:00:19.993292 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:19.993271 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kmwqr_223f9dd9-608b-4e28-962e-938e14cb5229/kube-rbac-proxy/0.log" Sep 18 22:00:20.018364 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:20.018344 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kmwqr_223f9dd9-608b-4e28-962e-938e14cb5229/init-textfile/0.log" Sep 18 22:00:20.661841 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:20.661780 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-phllm_97dd2c53-253d-44e5-b79b-21cab36892c7/prometheus-operator-admission-webhook/0.log" Sep 18 22:00:20.703912 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:20.703889 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d677d89d-k2xnz_6301c1b5-81fc-4029-b021-91e2ece4acc3/telemeter-client/0.log" Sep 18 22:00:20.732605 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:20.732583 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d677d89d-k2xnz_6301c1b5-81fc-4029-b021-91e2ece4acc3/reload/0.log" Sep 18 22:00:20.765739 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:20.765722 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d677d89d-k2xnz_6301c1b5-81fc-4029-b021-91e2ece4acc3/kube-rbac-proxy/0.log" Sep 18 22:00:22.083555 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.083520 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-h7wj9_d658fc54-2b1d-4c13-9550-b3932bb8b10a/networking-console-plugin/0.log" Sep 18 22:00:22.692065 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.692032 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/2.log" Sep 18 22:00:22.697109 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.697073 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-6pmwb_f89a5ef2-a724-4862-9b01-5fd8e982271e/console-operator/3.log" Sep 18 22:00:22.716318 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.716290 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng"] Sep 18 22:00:22.716694 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.716678 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2f7ac3-0664-4054-85c8-e764e3340540" containerName="console" Sep 18 22:00:22.716739 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.716695 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2f7ac3-0664-4054-85c8-e764e3340540" containerName="console" Sep 18 22:00:22.716778 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.716757 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2f7ac3-0664-4054-85c8-e764e3340540" containerName="console" Sep 18 22:00:22.719966 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.719948 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.723765 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.723741 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6qs45\"/\"default-dockercfg-998n8\"" Sep 18 22:00:22.723906 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.723853 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6qs45\"/\"kube-root-ca.crt\"" Sep 18 22:00:22.725193 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.725172 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6qs45\"/\"openshift-service-ca.crt\"" Sep 18 22:00:22.736115 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.736088 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng"] Sep 18 22:00:22.878865 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.878837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-sys\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.878865 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.878863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjn9m\" (UniqueName: \"kubernetes.io/projected/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-kube-api-access-cjn9m\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.879078 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.878884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-lib-modules\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.879078 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.878901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-podres\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.879078 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.879008 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-proc\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979599 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979521 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-sys\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979599 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979563 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjn9m\" (UniqueName: \"kubernetes.io/projected/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-kube-api-access-cjn9m\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979599 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979595 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-lib-modules\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979824 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979620 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-podres\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979824 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-proc\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979824 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979652 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-sys\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979824 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979727 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-proc\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979824 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979779 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-lib-modules\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.979824 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.979780 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-podres\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:22.988534 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:22.988515 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjn9m\" (UniqueName: \"kubernetes.io/projected/ebc65af3-066f-4bc2-a37a-9fb6ba8321cd-kube-api-access-cjn9m\") pod \"perf-node-gather-daemonset-7g7ng\" (UID: \"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:23.030720 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:23.030699 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:23.306734 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:23.306707 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng"] Sep 18 22:00:23.309115 ip-10-0-129-249 kubenswrapper[2567]: W0918 22:00:23.309086 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podebc65af3_066f_4bc2_a37a_9fb6ba8321cd.slice/crio-909d947d3d6490ea3350899078a4f00040684ff1f7f55e41432bbdf14656b46d WatchSource:0}: Error finding container 909d947d3d6490ea3350899078a4f00040684ff1f7f55e41432bbdf14656b46d: Status 404 returned error can't find the container with id 909d947d3d6490ea3350899078a4f00040684ff1f7f55e41432bbdf14656b46d Sep 18 22:00:23.309298 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:23.309278 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5647c69f8f-rsmkb_78f59965-dc06-495a-a9a5-fb5e796eff25/console/0.log" Sep 18 22:00:23.374961 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:23.374941 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-c8dkf_1c84b284-a5d7-48a9-bc1f-71741d9ace1e/download-server/0.log" Sep 18 22:00:24.001594 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:24.001555 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" event={"ID":"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd","Type":"ContainerStarted","Data":"8cd0594fdbaa3c98fd5c56f585d7c7cb414b22223db5c1da79e97f146d5e9a26"} Sep 18 22:00:24.001767 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:24.001624 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" event={"ID":"ebc65af3-066f-4bc2-a37a-9fb6ba8321cd","Type":"ContainerStarted","Data":"909d947d3d6490ea3350899078a4f00040684ff1f7f55e41432bbdf14656b46d"} Sep 18 22:00:24.001767 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:24.001689 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:24.027115 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:24.027070 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" podStartSLOduration=2.027055661 podStartE2EDuration="2.027055661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:24.026440359 +0000 UTC m=+576.729005721" watchObservedRunningTime="2026-09-18 22:00:24.027055661 +0000 UTC m=+576.729621023" Sep 18 22:00:24.989826 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:24.989798 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6p9zr_ad686e52-0160-4170-83f0-d800df399ba6/dns/0.log" Sep 18 22:00:25.017229 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:25.017208 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6p9zr_ad686e52-0160-4170-83f0-d800df399ba6/kube-rbac-proxy/0.log" Sep 18 22:00:25.248015 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:25.247956 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jljlf_4e10c295-0617-4e38-b7c8-9c47cd1f651d/dns-node-resolver/0.log" Sep 18 22:00:25.835975 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:25.835949 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76f5df994f-rqfbr_77b38ac3-a6e2-4bbd-a850-3537f1d67696/registry/0.log" Sep 18 22:00:25.876263 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:25.876238 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-48g9m_5bbc25d9-a502-4422-a9e7-65be602585e9/node-ca/0.log" Sep 18 22:00:27.387108 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:27.387076 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-49dnr_49dd2dc5-0107-445c-b896-edfd7412d9e2/serve-healthcheck-canary/0.log" Sep 18 22:00:28.192381 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:28.192349 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z6rz5_01224773-326a-42f9-bc4f-db6fb68d2339/kube-rbac-proxy/0.log" Sep 18 22:00:28.221057 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:28.221029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z6rz5_01224773-326a-42f9-bc4f-db6fb68d2339/exporter/0.log" Sep 18 22:00:28.246773 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:28.246746 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z6rz5_01224773-326a-42f9-bc4f-db6fb68d2339/extractor/0.log" Sep 18 22:00:30.016920 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:30.016889 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-7g7ng" Sep 18 22:00:30.692666 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:30.692639 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-575575dfd7-74g6h_d4c25f2c-c857-4a2c-abb2-957992ccafb1/manager/0.log" Sep 18 22:00:30.739824 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:30.739796 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-448p6_1088b9e5-a182-42ba-a89e-91d07713ac48/manager/0.log" Sep 18 22:00:35.658827 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:35.658789 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-hs52c_caadd732-802f-4efb-ab11-20d7c45ec9bc/migrator/0.log" Sep 18 22:00:35.684403 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:35.684380 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-hs52c_caadd732-802f-4efb-ab11-20d7c45ec9bc/graceful-termination/0.log" Sep 18 22:00:37.476311 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:37.476282 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshmg_30d234e5-9e6e-4ef4-b7d8-bfee22756fbd/kube-multus-additional-cni-plugins/0.log" Sep 18 22:00:37.514227 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:37.514202 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshmg_30d234e5-9e6e-4ef4-b7d8-bfee22756fbd/egress-router-binary-copy/0.log" Sep 18 22:00:37.549449 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:37.549433 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshmg_30d234e5-9e6e-4ef4-b7d8-bfee22756fbd/cni-plugins/0.log" Sep 18 22:00:37.589012 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:37.588991 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshmg_30d234e5-9e6e-4ef4-b7d8-bfee22756fbd/bond-cni-plugin/0.log" Sep 18 22:00:37.618810 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:37.618793 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshmg_30d234e5-9e6e-4ef4-b7d8-bfee22756fbd/routeoverride-cni/0.log" Sep 18 22:00:37.649274 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:37.649252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshmg_30d234e5-9e6e-4ef4-b7d8-bfee22756fbd/whereabouts-cni-bincopy/0.log" Sep 18 22:00:37.678574 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:37.678551 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dshmg_30d234e5-9e6e-4ef4-b7d8-bfee22756fbd/whereabouts-cni/0.log" Sep 18 22:00:37.981121 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:37.981103 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f6k4r_87fb5366-a15a-419e-a7aa-0021e94f4ce9/kube-multus/0.log" Sep 18 22:00:38.152194 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:38.152172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zmxqf_64e7f8a7-840d-487b-a8fd-2bec3675c1a6/network-metrics-daemon/0.log" Sep 18 22:00:38.180207 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:38.180179 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zmxqf_64e7f8a7-840d-487b-a8fd-2bec3675c1a6/kube-rbac-proxy/0.log" Sep 18 22:00:39.392686 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:39.392655 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wlv2_12d97d79-cce7-4ea4-8a28-b5b063c38de4/ovn-controller/0.log" Sep 18 22:00:39.415625 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:39.415601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wlv2_12d97d79-cce7-4ea4-8a28-b5b063c38de4/ovn-acl-logging/0.log" Sep 18 22:00:39.441832 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:39.441814 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wlv2_12d97d79-cce7-4ea4-8a28-b5b063c38de4/kube-rbac-proxy-node/0.log" Sep 18 22:00:39.469466 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:39.469440 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wlv2_12d97d79-cce7-4ea4-8a28-b5b063c38de4/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 22:00:39.493270 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:39.493247 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wlv2_12d97d79-cce7-4ea4-8a28-b5b063c38de4/northd/0.log" Sep 18 22:00:39.530997 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:39.530976 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wlv2_12d97d79-cce7-4ea4-8a28-b5b063c38de4/nbdb/0.log" Sep 18 22:00:39.586575 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:39.586555 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wlv2_12d97d79-cce7-4ea4-8a28-b5b063c38de4/sbdb/0.log" Sep 18 22:00:39.638946 ip-10-0-129-249 kubenswrapper[2567]: I0918 22:00:39.638924 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wlv2_12d97d79-cce7-4ea4-8a28-b5b063c38de4/ovnkube-controller/0.log"