Sep 19 01:37:11.882696 ip-10-0-128-63 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 19 01:37:11.882711 ip-10-0-128-63 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 19 01:37:11.882720 ip-10-0-128-63 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 19 01:37:11.883010 ip-10-0-128-63 systemd[1]: Failed to start Kubernetes Kubelet. Sep 19 01:37:21.497124 ip-10-0-128-63 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Sep 19 01:37:21.497137 ip-10-0-128-63 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9595ed6835894712a94b9739ec475494 -- Sep 19 01:39:11.829663 ip-10-0-128-63 systemd[1]: Starting Kubernetes Kubelet... Sep 19 01:39:12.181457 ip-10-0-128-63 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:12.181457 ip-10-0-128-63 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 19 01:39:12.181457 ip-10-0-128-63 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:12.182107 ip-10-0-128-63 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 19 01:39:12.182107 ip-10-0-128-63 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 01:39:12.183356 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.183259 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 19 01:39:12.188402 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188384 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:12.188402 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188401 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188405 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188408 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188411 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188415 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188419 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188421 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188424 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188426 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188429 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188431 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188434 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188437 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188439 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188442 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188444 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188447 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188449 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188452 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188455 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:12.188476 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188457 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188460 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188463 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188465 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188473 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188476 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188478 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188482 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188485 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188488 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188491 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188493 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188496 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188499 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188501 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188503 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188506 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188508 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188511 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188513 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:12.189005 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188516 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188520 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188524 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188527 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188539 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188543 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188546 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188550 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188553 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188555 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188557 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188560 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188562 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188565 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188568 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188571 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188574 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188576 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188579 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:12.189509 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188581 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188584 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188586 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188589 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188591 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188594 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188596 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188599 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188601 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188604 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188606 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188609 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188612 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188614 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188617 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188619 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188622 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188624 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188627 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188630 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:12.189977 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188633 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188636 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188638 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188641 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188643 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188646 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188649 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188652 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188655 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188657 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188662 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188665 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188668 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188671 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188673 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188676 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188678 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188681 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.188683 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:12.190575 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189409 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189419 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189423 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189426 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189430 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189433 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189436 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189439 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189441 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189444 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189446 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189449 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189452 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189454 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189457 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189459 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189462 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189464 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189467 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:12.191046 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189469 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189472 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189475 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189478 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189480 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189483 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189485 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189488 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189491 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189494 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189496 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189499 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189501 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189506 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189509 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189512 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189517 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189520 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189523 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:12.191586 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189530 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189533 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189536 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189539 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189542 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189544 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189547 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189549 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189552 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189554 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189557 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189559 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189561 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189564 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189568 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189570 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189573 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189576 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189578 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189581 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:12.192055 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189583 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189586 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189588 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189591 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189594 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189596 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189599 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189602 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189604 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189606 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189609 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189611 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189614 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189617 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189619 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189622 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189624 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189627 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189631 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189633 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:12.192568 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189636 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189638 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189641 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189644 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189646 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189649 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189651 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189654 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189657 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189659 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189662 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189664 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189666 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189669 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189671 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189674 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189676 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189679 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189681 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189684 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:12.193070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.189686 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190052 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190057 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190059 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190062 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190065 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190068 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190070 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190073 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190075 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190078 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190081 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190083 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190086 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190089 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190092 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190094 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190097 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190100 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190103 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:12.193583 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190105 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190108 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190111 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190113 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190117 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190119 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190122 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190125 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190127 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190130 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190132 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190135 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190137 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190140 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190142 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190144 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190147 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190149 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190152 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:12.194070 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190155 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190157 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190160 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190162 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190165 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190167 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190170 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190172 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190175 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190177 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190180 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190183 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190185 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190188 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190190 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190193 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190195 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190198 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190201 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190203 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:12.194546 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190205 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190208 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190211 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190214 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190217 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190222 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190227 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190231 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190235 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190239 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190243 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190246 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190251 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190255 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190258 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190262 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190265 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190269 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190273 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190276 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:12.195042 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190280 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190285 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190289 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190294 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190298 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190301 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190305 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190309 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190313 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190320 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190324 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190328 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190331 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190334 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190336 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190339 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190355 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190359 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190362 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:12.195569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190366 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.190369 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190446 2564 flags.go:64] FLAG: --address="0.0.0.0" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190489 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190499 2564 flags.go:64] FLAG: --anonymous-auth="true" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190503 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190509 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190513 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190517 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190522 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190572 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190577 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190580 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190584 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190587 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190590 2564 flags.go:64] FLAG: --cgroup-root="" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190593 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190597 2564 flags.go:64] FLAG: --client-ca-file="" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190600 2564 flags.go:64] FLAG: --cloud-provider="external" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190603 2564 flags.go:64] FLAG: --cluster-dns="[]" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190608 2564 flags.go:64] FLAG: --cluster-domain="" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190611 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190615 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 19 01:39:12.196048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190618 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190621 2564 flags.go:64] FLAG: --container-log-max-files="5" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190625 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190628 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190631 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190635 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190638 2564 flags.go:64] FLAG: --contention-profiling="false" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190640 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190643 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190646 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190650 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190654 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190657 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190660 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190662 2564 flags.go:64] FLAG: --enable-load-reader="false" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190666 2564 flags.go:64] FLAG: --enable-server="true" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190669 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190673 2564 flags.go:64] FLAG: --event-burst="100" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190676 2564 flags.go:64] FLAG: --event-qps="50" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190679 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190682 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190685 2564 flags.go:64] FLAG: --eviction-hard="" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190689 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190691 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190694 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 19 01:39:12.196635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190700 2564 flags.go:64] FLAG: --eviction-soft="" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190703 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190706 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190709 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190712 2564 flags.go:64] FLAG: --experimental-mounter-path="" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190715 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190718 2564 flags.go:64] FLAG: --fail-swap-on="true" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190721 2564 flags.go:64] FLAG: --feature-gates="" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190725 2564 flags.go:64] FLAG: --file-check-frequency="20s" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190728 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190731 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190734 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190737 2564 flags.go:64] FLAG: --healthz-port="10248" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190741 2564 flags.go:64] FLAG: --help="false" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190743 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190746 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190749 2564 flags.go:64] FLAG: --http-check-frequency="20s" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190752 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190755 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190759 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190762 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190765 2564 flags.go:64] FLAG: --image-service-endpoint="" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190768 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 19 01:39:12.197272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190770 2564 flags.go:64] FLAG: --kube-api-burst="100" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190775 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190778 2564 flags.go:64] FLAG: --kube-api-qps="50" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190781 2564 flags.go:64] FLAG: --kube-reserved="" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190784 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190786 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190789 2564 flags.go:64] FLAG: --kubelet-cgroups="" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190792 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190795 2564 flags.go:64] FLAG: --lock-file="" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190799 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190802 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190805 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190810 2564 flags.go:64] FLAG: --log-json-split-stream="false" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190813 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190816 2564 flags.go:64] FLAG: --log-text-split-stream="false" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190819 2564 flags.go:64] FLAG: --logging-format="text" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190822 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190825 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190828 2564 flags.go:64] FLAG: --manifest-url="" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190831 2564 flags.go:64] FLAG: --manifest-url-header="" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190836 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190839 2564 flags.go:64] FLAG: --max-open-files="1000000" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190843 2564 flags.go:64] FLAG: --max-pods="110" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190846 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190849 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 19 01:39:12.197925 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190852 2564 flags.go:64] FLAG: --memory-manager-policy="None" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190855 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190858 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190861 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190864 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190872 2564 flags.go:64] FLAG: --node-status-max-images="50" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190874 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190877 2564 flags.go:64] FLAG: --oom-score-adj="-999" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190881 2564 flags.go:64] FLAG: --pod-cidr="" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190884 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190889 2564 flags.go:64] FLAG: --pod-manifest-path="" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190892 2564 flags.go:64] FLAG: --pod-max-pids="-1" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190895 2564 flags.go:64] FLAG: --pods-per-core="0" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190898 2564 flags.go:64] FLAG: --port="10250" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190901 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190904 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0741e5d8cba248f3c" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190907 2564 flags.go:64] FLAG: --qos-reserved="" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190911 2564 flags.go:64] FLAG: --read-only-port="10255" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190914 2564 flags.go:64] FLAG: --register-node="true" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190917 2564 flags.go:64] FLAG: --register-with-taints="" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190921 2564 flags.go:64] FLAG: --registry-burst="10" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190923 2564 flags.go:64] FLAG: --registry-qps="5" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190926 2564 flags.go:64] FLAG: --reserved-cpus="" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190929 2564 flags.go:64] FLAG: --reserved-memory="" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190933 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 19 01:39:12.198589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190936 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190939 2564 flags.go:64] FLAG: --rotate-certificates="false" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190942 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190945 2564 flags.go:64] FLAG: --runonce="false" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190948 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190951 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190954 2564 flags.go:64] FLAG: --seccomp-default="false" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190957 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190960 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190962 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190966 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190969 2564 flags.go:64] FLAG: --storage-driver-password="root" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190971 2564 flags.go:64] FLAG: --storage-driver-secure="false" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190974 2564 flags.go:64] FLAG: --storage-driver-table="stats" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190977 2564 flags.go:64] FLAG: --storage-driver-user="root" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190980 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190983 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190986 2564 flags.go:64] FLAG: --system-cgroups="" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190989 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190994 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190997 2564 flags.go:64] FLAG: --tls-cert-file="" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.190999 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191004 2564 flags.go:64] FLAG: --tls-min-version="" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191006 2564 flags.go:64] FLAG: --tls-private-key-file="" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191011 2564 flags.go:64] FLAG: --topology-manager-policy="none" Sep 19 01:39:12.199208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191013 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191016 2564 flags.go:64] FLAG: --topology-manager-scope="container" Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191019 2564 flags.go:64] FLAG: --v="2" Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191025 2564 flags.go:64] FLAG: --version="false" Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191029 2564 flags.go:64] FLAG: --vmodule="" Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191032 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191036 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191153 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191157 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191160 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191163 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191168 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191171 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191174 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191178 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191181 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191184 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191187 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191189 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191192 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191195 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:12.199847 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191197 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191200 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191202 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191205 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191214 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191217 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191220 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191222 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191225 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191227 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191231 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191233 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191236 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191239 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191243 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191245 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191248 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191250 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191253 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:12.200398 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191256 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191258 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191261 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191264 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191266 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191269 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191272 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191274 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191277 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191280 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191283 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191285 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191288 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191290 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191293 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191295 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191298 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191301 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191304 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191306 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:12.200889 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191309 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191311 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191313 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191317 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191320 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191322 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191325 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191329 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191331 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191334 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191336 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191353 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191357 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191360 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191364 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191367 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191370 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191373 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191376 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:12.201411 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191379 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191381 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191384 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191386 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191389 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191391 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191394 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191396 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191399 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191401 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191404 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191406 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191409 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191412 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191414 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191417 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191421 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191423 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191426 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191429 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:12.201887 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191434 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191437 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191440 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191443 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191445 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191448 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.191451 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.191926 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.198917 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.198932 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.199685 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.199693 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199751 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199756 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199760 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:12.202392 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199763 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199766 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199769 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199772 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199774 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199777 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199780 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199782 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199785 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199789 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199792 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199794 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199797 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199799 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199802 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199804 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199807 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199810 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199813 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:12.202819 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199816 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199818 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199821 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199824 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199827 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199829 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199832 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199835 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199838 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199843 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199847 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199851 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199855 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199859 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199863 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199866 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199869 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199872 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199877 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:12.203296 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199881 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199883 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199886 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199889 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199892 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199895 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199898 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199900 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199903 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199905 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199908 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199911 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199914 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199916 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199918 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199921 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199924 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199927 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199929 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199933 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:12.204071 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199935 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199938 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199941 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199943 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199946 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199948 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199950 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199953 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199955 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199958 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199960 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199963 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199965 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199968 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199971 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199974 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199976 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199979 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199981 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199984 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:12.204812 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199988 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199992 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199994 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.199997 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200001 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200004 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200007 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200010 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200013 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200016 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200018 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200021 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200024 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200027 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200029 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200032 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200034 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:12.205428 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200037 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.200042 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200152 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200156 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200160 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200162 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200165 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200167 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200170 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200173 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200175 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200178 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200181 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200184 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200187 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 01:39:12.205900 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200189 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200192 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200194 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200197 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200199 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200202 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200204 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200206 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200209 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200212 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200214 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200217 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200219 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200222 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200224 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200227 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200229 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200233 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200236 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200240 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 01:39:12.206323 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200242 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200245 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200247 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200250 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200252 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200254 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200257 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200260 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200262 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200265 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200267 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200270 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200273 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200275 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200278 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200281 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200283 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200287 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200290 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 01:39:12.206922 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200293 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200296 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200299 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200302 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200304 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200307 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200309 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200312 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200314 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200317 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200320 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200323 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200325 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200328 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200330 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200332 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200335 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200337 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200340 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200359 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 01:39:12.207417 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200362 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200365 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200367 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200370 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200372 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200375 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200378 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200380 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200383 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200385 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200388 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200390 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200393 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200395 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200398 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200402 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200405 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200408 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200411 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 01:39:12.208150 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200414 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200416 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200419 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200421 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200424 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200427 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200429 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:12.200432 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.200437 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.200559 2564 server.go:962] "Client rotation is on, will bootstrap in background" Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.202434 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.203261 2564 server.go:1019] "Starting client certificate rotation" Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.203386 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 01:39:12.208908 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.203440 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 01:39:12.209243 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.205532 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 01:39:12.209243 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.207065 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 01:39:12.224670 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.224647 2564 log.go:25] "Validated CRI v1 runtime API" Sep 19 01:39:12.226270 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.226252 2564 log.go:25] "Validated CRI v1 image API" Sep 19 01:39:12.227167 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.227146 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 19 01:39:12.231704 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.231684 2564 fs.go:135] Filesystem UUIDs: map[1fa4e619-ab8b-41fb-9fb1-60b8ccba4b76:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 817c6729-0bef-4067-aff5-7bbd4ec50b68:/dev/nvme0n1p3] Sep 19 01:39:12.231783 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.231703 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 19 01:39:12.237130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.237006 2564 manager.go:216] Machine: {Timestamp:2026-09-19 01:39:12.235797514 +0000 UTC m=+0.301701250 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3184745 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb2e5cb5a60d86bcb2ba7799754fc SystemUUID:ec2fb2e5-cb5a-60d8-6bcb-2ba7799754fc BootID:9595ed68-3589-4712-a94b-9739ec475494 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d6:9c:88:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d6:9c:88:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:22:69:0e:15:3d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 19 01:39:12.237130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.237125 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 19 01:39:12.237248 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.237210 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 19 01:39:12.238159 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.238131 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 19 01:39:12.238417 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.238398 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 01:39:12.238450 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.238163 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 19 01:39:12.238975 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.238964 2564 topology_manager.go:138] "Creating topology manager with none policy" Sep 19 01:39:12.239015 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.238980 2564 container_manager_linux.go:309] "Creating device plugin manager" Sep 19 01:39:12.239015 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.238988 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 01:39:12.240082 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.240072 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 01:39:12.240160 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.240148 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 19 01:39:12.243619 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.243607 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 19 01:39:12.243751 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.243741 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 19 01:39:12.243794 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.243771 2564 kubelet.go:486] "Attempting to sync node with API server" Sep 19 01:39:12.243794 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.243785 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 19 01:39:12.243869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.243796 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 19 01:39:12.243869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.243805 2564 kubelet.go:398] "Adding apiserver pod source" Sep 19 01:39:12.243869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.243814 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 19 01:39:12.244197 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.244185 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 01:39:12.244234 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.244206 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 01:39:12.246202 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.246177 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 19 01:39:12.248189 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.248173 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 19 01:39:12.248253 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.248204 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 19 01:39:12.249273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249255 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 19 01:39:12.249273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249277 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249284 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249290 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249299 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249304 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249319 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249324 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249332 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249337 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249366 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 19 01:39:12.249381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.249372 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 19 01:39:12.250074 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.250063 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 19 01:39:12.250074 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.250072 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 19 01:39:12.254555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.254456 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 19 01:39:12.254646 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.254483 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 19 01:39:12.254646 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.254599 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 19 01:39:12.256006 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.255988 2564 server.go:1268] "Started kubelet" Sep 19 01:39:12.256089 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.256052 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 19 01:39:12.256160 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.256095 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 19 01:39:12.256202 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.256188 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 19 01:39:12.257020 ip-10-0-128-63 systemd[1]: Started Kubernetes Kubelet. Sep 19 01:39:12.258178 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.258076 2564 server.go:310] "Adding debug handlers to kubelet server" Sep 19 01:39:12.260238 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.260118 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 19 01:39:12.260501 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.260487 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 19 01:39:12.261819 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.261004 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-63.ec2.internal.18d69533f19f228d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-63.ec2.internal,UID:ip-10-0-128-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-63.ec2.internal,},FirstTimestamp:2026-09-19 01:39:12.255959693 +0000 UTC m=+0.321863475,LastTimestamp:2026-09-19 01:39:12.255959693 +0000 UTC m=+0.321863475,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-63.ec2.internal,}" Sep 19 01:39:12.264281 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.264266 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qlxfx" Sep 19 01:39:12.264578 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.264560 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 19 01:39:12.264578 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.264575 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 19 01:39:12.264835 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.264813 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:12.265123 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265093 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 19 01:39:12.265123 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265097 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 19 01:39:12.265123 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265121 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 19 01:39:12.265298 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265203 2564 reconstruct.go:97] "Volume reconstruction finished" Sep 19 01:39:12.265298 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265211 2564 reconciler.go:29] "Reconciler: start to sync state" Sep 19 01:39:12.265432 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265404 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 19 01:39:12.265432 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265419 2564 factory.go:55] Registering systemd factory Sep 19 01:39:12.265432 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265428 2564 factory.go:223] Registration of the systemd container factory successfully Sep 19 01:39:12.265647 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265631 2564 factory.go:153] Registering CRI-O factory Sep 19 01:39:12.265647 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265644 2564 factory.go:223] Registration of the crio container factory successfully Sep 19 01:39:12.265773 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265661 2564 factory.go:103] Registering Raw factory Sep 19 01:39:12.265773 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.265678 2564 manager.go:1196] Started watching for new ooms in manager Sep 19 01:39:12.266085 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.266069 2564 manager.go:349] Starting recovery of all containers Sep 19 01:39:12.270910 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.270885 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qlxfx" Sep 19 01:39:12.271524 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.271501 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 19 01:39:12.272141 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.272095 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 19 01:39:12.279155 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.279132 2564 manager.go:354] Recovery completed Sep 19 01:39:12.284212 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.284196 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:12.286137 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.286120 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:12.286209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.286150 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:12.286209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.286161 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:12.286707 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.286695 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 19 01:39:12.286707 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.286702 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:12.286707 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.286707 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 19 01:39:12.286871 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.286725 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 19 01:39:12.287562 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.287422 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:12.287562 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.287447 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:12.287562 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.287458 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:12.288765 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.288752 2564 policy_none.go:49] "None policy: Start" Sep 19 01:39:12.288847 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.288773 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 19 01:39:12.288847 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.288794 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 19 01:39:12.288943 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.288790 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-63.ec2.internal.18d69533f36b967d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-63.ec2.internal,UID:ip-10-0-128-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-63.ec2.internal,},FirstTimestamp:2026-09-19 01:39:12.286135933 +0000 UTC m=+0.352039669,LastTimestamp:2026-09-19 01:39:12.286135933 +0000 UTC m=+0.352039669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-63.ec2.internal,}" Sep 19 01:39:12.290785 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.290773 2564 policy_none.go:47] "Start" Sep 19 01:39:12.330063 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.330045 2564 manager.go:337] "Starting Device Plugin manager" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.330088 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.330101 2564 server.go:87] "Starting device plugin registration server" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.330539 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.330554 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.330696 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.330791 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.330801 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.331376 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 19 01:39:12.349435 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.331430 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:12.366215 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.366170 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 19 01:39:12.367640 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.367622 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 19 01:39:12.367714 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.367687 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 19 01:39:12.367766 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.367716 2564 kubelet.go:2448] "Starting kubelet main sync loop" Sep 19 01:39:12.367809 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.367763 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 19 01:39:12.369945 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.369924 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:12.431257 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.430901 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:12.432600 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.432521 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:12.432600 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.432564 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:12.432600 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.432580 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:12.432762 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.432605 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.440453 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.440433 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.440559 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.440459 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-63.ec2.internal\": node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:12.459386 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.459362 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:12.468662 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.468628 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal"] Sep 19 01:39:12.468726 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.468702 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:12.470223 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.470211 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:12.470290 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.470241 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:12.470290 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.470251 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:12.472608 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.472593 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:12.472739 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.472724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.472791 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.472755 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:12.473452 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.473438 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:12.473534 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.473467 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:12.473534 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.473481 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:12.473534 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.473444 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:12.473652 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.473546 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:12.473652 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.473559 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:12.475770 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.475753 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.475857 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.475779 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 01:39:12.476638 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.476621 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientMemory" Sep 19 01:39:12.476712 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.476653 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 01:39:12.476712 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.476668 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeHasSufficientPID" Sep 19 01:39:12.509061 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.509032 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-63.ec2.internal\" not found" node="ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.512494 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.512475 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-63.ec2.internal\" not found" node="ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.560433 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.560408 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:12.566687 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.566666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1eafad0aa0edaad12fedad61adff6039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"1eafad0aa0edaad12fedad61adff6039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.566749 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.566692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1eafad0aa0edaad12fedad61adff6039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"1eafad0aa0edaad12fedad61adff6039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.566749 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.566711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1676bf3cffcb415df1f65bf8ae4005f2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-63.ec2.internal\" (UID: \"1676bf3cffcb415df1f65bf8ae4005f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.660512 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.660467 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:12.666950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.666926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1eafad0aa0edaad12fedad61adff6039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"1eafad0aa0edaad12fedad61adff6039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.667058 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.666954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1eafad0aa0edaad12fedad61adff6039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"1eafad0aa0edaad12fedad61adff6039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.667058 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.666971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1676bf3cffcb415df1f65bf8ae4005f2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-63.ec2.internal\" (UID: \"1676bf3cffcb415df1f65bf8ae4005f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.667058 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.667052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1eafad0aa0edaad12fedad61adff6039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"1eafad0aa0edaad12fedad61adff6039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.667160 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.667060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1676bf3cffcb415df1f65bf8ae4005f2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-63.ec2.internal\" (UID: \"1676bf3cffcb415df1f65bf8ae4005f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.667160 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.667054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1eafad0aa0edaad12fedad61adff6039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal\" (UID: \"1eafad0aa0edaad12fedad61adff6039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.761303 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.761223 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:12.812708 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.812678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.815852 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:12.815831 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" Sep 19 01:39:12.862301 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.862271 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:12.962802 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:12.962770 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:13.063426 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:13.063332 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:13.083831 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.083808 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:13.163751 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:13.163720 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:13.203282 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.203256 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 19 01:39:13.203735 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.203427 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 19 01:39:13.203735 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.203427 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 19 01:39:13.263923 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:13.263895 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:13.277040 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.277009 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 01:34:12 +0000 UTC" deadline="2028-02-12 07:23:25.070398396 +0000 UTC" Sep 19 01:39:13.277040 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.277036 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12269h44m11.79336505s" Sep 19 01:39:13.364415 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:13.364331 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-63.ec2.internal\" not found" Sep 19 01:39:13.381886 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.381858 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:13.435964 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:13.435933 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1676bf3cffcb415df1f65bf8ae4005f2.slice/crio-59a1bbe404ac618612eaae31f303a6768e5f11c2dd3ad9b46a800b9ea6a54ede WatchSource:0}: Error finding container 59a1bbe404ac618612eaae31f303a6768e5f11c2dd3ad9b46a800b9ea6a54ede: Status 404 returned error can't find the container with id 59a1bbe404ac618612eaae31f303a6768e5f11c2dd3ad9b46a800b9ea6a54ede Sep 19 01:39:13.436622 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:13.436598 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eafad0aa0edaad12fedad61adff6039.slice/crio-5cccaf9fd26c9b22ccc7e932f94928b94f5317e075f411ff9b79b12e1f21483a WatchSource:0}: Error finding container 5cccaf9fd26c9b22ccc7e932f94928b94f5317e075f411ff9b79b12e1f21483a: Status 404 returned error can't find the container with id 5cccaf9fd26c9b22ccc7e932f94928b94f5317e075f411ff9b79b12e1f21483a Sep 19 01:39:13.441199 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.441181 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:39:13.464943 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.464909 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" Sep 19 01:39:13.475884 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.475862 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 01:39:13.477515 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.477500 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" Sep 19 01:39:13.484997 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.484981 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 01:39:13.696226 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:13.696143 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:14.244733 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.244691 2564 apiserver.go:52] "Watching apiserver" Sep 19 01:39:14.252500 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.252471 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 19 01:39:14.253060 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.253030 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-z84pz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws","openshift-cluster-node-tuning-operator/tuned-8q8mz","openshift-image-registry/node-ca-mvttq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal","openshift-multus/network-metrics-daemon-mthbh","openshift-network-diagnostics/network-check-target-2n54s","openshift-network-operator/iptables-alerter-2nmvh","kube-system/konnectivity-agent-zrlqx","kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal","openshift-dns/node-resolver-dgzwk","openshift-multus/multus-8spjh","openshift-multus/multus-additional-cni-plugins-6rt9g","openshift-ovn-kubernetes/ovnkube-node-qvbq9"] Sep 19 01:39:14.255724 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.255696 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:14.255865 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.255789 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:14.258126 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.258101 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.260213 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.260190 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mfgw6\"" Sep 19 01:39:14.260353 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.260332 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 19 01:39:14.260855 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.260528 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.260855 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.260604 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 19 01:39:14.263190 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.262783 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:39:14.263190 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.262860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.263190 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.262929 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 19 01:39:14.263190 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.263169 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cgqzl\"" Sep 19 01:39:14.264957 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.264929 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rfz4b\"" Sep 19 01:39:14.265085 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.265069 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 19 01:39:14.265273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.265256 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 19 01:39:14.265523 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.265506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 19 01:39:14.265688 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.265674 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 19 01:39:14.266057 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.266037 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.267915 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.267895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:14.268000 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.267966 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:14.268298 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.268277 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 19 01:39:14.268512 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.268495 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 19 01:39:14.269676 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.269525 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sdnwr\"" Sep 19 01:39:14.269676 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.269537 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 19 01:39:14.269676 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.269553 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 19 01:39:14.269676 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.269540 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 19 01:39:14.269676 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.269640 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 19 01:39:14.271240 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.270697 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:14.273266 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.273173 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 19 01:39:14.273266 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.273207 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tctzc\"" Sep 19 01:39:14.273634 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.273603 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 19 01:39:14.274404 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.274369 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.275402 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.275346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-sys\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.275505 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.275426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-tmp\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.275505 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.275462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-etc-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.275612 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.275511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-cni-netd\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.278575 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.275574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovnkube-script-lib\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.278677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.277316 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 19 01:39:14.278677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbptm\" (UniqueName: \"kubernetes.io/projected/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-kube-api-access-jbptm\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.278677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-serviceca\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.278677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.277484 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.278677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn74m\" (UniqueName: \"kubernetes.io/projected/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-kube-api-access-bn74m\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-systemd-units\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278349 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-var-lib-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-tmp-dir\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-systemd\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.277255 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c7hnj\"" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-lib-modules\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-tuned\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-systemd\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278367 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 19 01:39:14.278992 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278453 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.278498 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv6lh\" (UniqueName: \"kubernetes.io/projected/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-kube-api-access-wv6lh\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysconfig\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-kubernetes\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-var-lib-kubelet\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-host\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-ovn\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-log-socket\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qksjf\" (UniqueName: \"kubernetes.io/projected/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-kube-api-access-qksjf\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-modprobe-d\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysctl-conf\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-hosts-file\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysctl-d\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-run-netns\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.279555 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovn-node-metrics-cert\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-host\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-kubelet\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279543 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-slash\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-run\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-node-log\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-cni-bin\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovnkube-config\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280520 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.279780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-env-overrides\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.280948 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.280692 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 19 01:39:14.280948 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.280820 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 19 01:39:14.281053 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.280966 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.281241 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.281217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tnrd5\"" Sep 19 01:39:14.281308 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.281270 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 19 01:39:14.281913 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.281892 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 01:39:14.283029 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.283005 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:39:14.283309 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.283262 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 19 01:39:14.283309 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.283324 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9b26m\"" Sep 19 01:39:14.283545 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.283524 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 19 01:39:14.283760 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.283732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.283858 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.283817 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:14.286350 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.286325 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.289628 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.289607 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 19 01:39:14.289853 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.289833 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7nk92\"" Sep 19 01:39:14.307194 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.307155 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-psmvg" Sep 19 01:39:14.317677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.317647 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-psmvg" Sep 19 01:39:14.366944 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.366913 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 19 01:39:14.376816 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.376738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" event={"ID":"1eafad0aa0edaad12fedad61adff6039","Type":"ContainerStarted","Data":"5cccaf9fd26c9b22ccc7e932f94928b94f5317e075f411ff9b79b12e1f21483a"} Sep 19 01:39:14.378299 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.378263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" event={"ID":"1676bf3cffcb415df1f65bf8ae4005f2","Type":"ContainerStarted","Data":"59a1bbe404ac618612eaae31f303a6768e5f11c2dd3ad9b46a800b9ea6a54ede"} Sep 19 01:39:14.381922 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.381895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.382071 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.381932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.382071 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.381960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhqr5\" (UniqueName: \"kubernetes.io/projected/7e659224-116c-4447-9bc1-463998af3d79-kube-api-access-rhqr5\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.382071 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.381983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-cni-bin\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.382071 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovnkube-config\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.382071 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fspc\" (UniqueName: \"kubernetes.io/projected/1809e877-6cf8-43d4-9046-3ef68073edd6-kube-api-access-2fspc\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:14.382071 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382038 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.382071 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-socket-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-cni-bin\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-registration-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3b35378-86aa-48f8-bc78-57f6b84f81ce-host-slash\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-hostroot\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-etc-kubernetes\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-sys\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-etc-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovnkube-script-lib\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-cnibin\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382330 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-sys\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-serviceca\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-etc-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.382416 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-tmp-dir\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-cnibin\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-tuned\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-system-cni-dir\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-cni-bin\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysconfig\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-var-lib-kubelet\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-host\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-ovn\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382768 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovnkube-config\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-log-socket\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-tmp-dir\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-log-socket\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382882 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-serviceca\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382891 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysconfig\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.383081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-system-cni-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382973 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-host\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-var-lib-kubelet\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382973 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovnkube-script-lib\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.382987 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-ovn\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-modprobe-d\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ccbbb000-17b0-48c6-9ef7-081f00d2129c-konnectivity-ca\") pod \"konnectivity-agent-zrlqx\" (UID: \"ccbbb000-17b0-48c6-9ef7-081f00d2129c\") " pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysctl-d\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-run-netns\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383156 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-modprobe-d\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ccbbb000-17b0-48c6-9ef7-081f00d2129c-agent-certs\") pod \"konnectivity-agent-zrlqx\" (UID: \"ccbbb000-17b0-48c6-9ef7-081f00d2129c\") " pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383215 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-run-netns\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqwfx\" (UniqueName: \"kubernetes.io/projected/d3b35378-86aa-48f8-bc78-57f6b84f81ce-kube-api-access-fqwfx\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysctl-d\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e659224-116c-4447-9bc1-463998af3d79-cni-binary-copy\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383257 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.383950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-socket-dir-parent\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383306 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-conf-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-host\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-kubelet\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-slash\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383391 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383432 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-host\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-run\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-slash\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-node-log\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-env-overrides\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383544 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-kubelet\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk97v\" (UniqueName: \"kubernetes.io/projected/1f24796a-8c91-4070-9e1b-9a4d038ab457-kube-api-access-pk97v\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbzv7\" (UniqueName: \"kubernetes.io/projected/6da6680b-cccb-4378-8a63-f0f356612573-kube-api-access-sbzv7\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383596 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-run\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.384860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-dbus\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-multus-certs\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383767 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-node-log\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-tmp\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-cni-netd\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383860 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-cni-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-host-cni-netd\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-netns\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-kubelet\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbptm\" (UniqueName: \"kubernetes.io/projected/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-kube-api-access-jbptm\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.383996 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-env-overrides\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn74m\" (UniqueName: \"kubernetes.io/projected/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-kube-api-access-bn74m\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-systemd-units\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-var-lib-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384130 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-systemd\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-var-lib-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.385911 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-lib-modules\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-systemd\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv6lh\" (UniqueName: \"kubernetes.io/projected/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-kube-api-access-wv6lh\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-lib-modules\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-systemd\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-k8s-cni-cncf-io\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384312 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-systemd-units\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-kubernetes\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384352 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-openvswitch\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qksjf\" (UniqueName: \"kubernetes.io/projected/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-kube-api-access-qksjf\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-device-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-sys-fs\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384579 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-cni-multus\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysctl-conf\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.386869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-run-systemd\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-hosts-file\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e659224-116c-4447-9bc1-463998af3d79-multus-daemon-config\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovn-node-metrics-cert\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-cni-binary-copy\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3b35378-86aa-48f8-bc78-57f6b84f81ce-iptables-alerter-script\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-kubelet-config\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384882 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-kubernetes\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.384939 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-hosts-file\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.387671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.385147 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-sysctl-conf\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.388096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.387763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-etc-tuned\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.388202 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.388178 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-tmp\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.388454 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.388429 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-ovn-node-metrics-cert\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.392242 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.392205 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:14.392242 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.392240 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:14.392407 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.392256 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jm2tl for pod openshift-network-diagnostics/network-check-target-2n54s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:14.392407 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.392338 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl podName:1a08e37a-88d9-451e-a505-ee8c069d50c9 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:14.892315548 +0000 UTC m=+2.958219293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jm2tl" (UniqueName: "kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl") pod "network-check-target-2n54s" (UID: "1a08e37a-88d9-451e-a505-ee8c069d50c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:14.394526 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.394501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn74m\" (UniqueName: \"kubernetes.io/projected/f652b19d-2016-40dd-8f08-0a7d6e4d1e62-kube-api-access-bn74m\") pod \"node-ca-mvttq\" (UID: \"f652b19d-2016-40dd-8f08-0a7d6e4d1e62\") " pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.395342 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.395318 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qksjf\" (UniqueName: \"kubernetes.io/projected/3aaf6e24-c0ae-4d9a-adc5-95a03d983395-kube-api-access-qksjf\") pod \"node-resolver-dgzwk\" (UID: \"3aaf6e24-c0ae-4d9a-adc5-95a03d983395\") " pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.396302 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.396227 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv6lh\" (UniqueName: \"kubernetes.io/projected/b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6-kube-api-access-wv6lh\") pod \"ovnkube-node-qvbq9\" (UID: \"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.397183 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.397160 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbptm\" (UniqueName: \"kubernetes.io/projected/0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297-kube-api-access-jbptm\") pod \"tuned-8q8mz\" (UID: \"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297\") " pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.485862 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.485801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-system-cni-dir\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.485862 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.485848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-cni-bin\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.485945 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-system-cni-dir\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.486130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.486130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-system-cni-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486048 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-cni-bin\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ccbbb000-17b0-48c6-9ef7-081f00d2129c-konnectivity-ca\") pod \"konnectivity-agent-zrlqx\" (UID: \"ccbbb000-17b0-48c6-9ef7-081f00d2129c\") " pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:14.486130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ccbbb000-17b0-48c6-9ef7-081f00d2129c-agent-certs\") pod \"konnectivity-agent-zrlqx\" (UID: \"ccbbb000-17b0-48c6-9ef7-081f00d2129c\") " pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:14.486130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqwfx\" (UniqueName: \"kubernetes.io/projected/d3b35378-86aa-48f8-bc78-57f6b84f81ce-kube-api-access-fqwfx\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e659224-116c-4447-9bc1-463998af3d79-cni-binary-copy\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486147 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-system-cni-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-socket-dir-parent\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486182 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-etc-selinux\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-conf-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk97v\" (UniqueName: \"kubernetes.io/projected/1f24796a-8c91-4070-9e1b-9a4d038ab457-kube-api-access-pk97v\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbzv7\" (UniqueName: \"kubernetes.io/projected/6da6680b-cccb-4378-8a63-f0f356612573-kube-api-access-sbzv7\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-dbus\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-multus-certs\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-cni-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-netns\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-kubelet\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.486511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-k8s-cni-cncf-io\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-device-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-sys-fs\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-cni-multus\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e659224-116c-4447-9bc1-463998af3d79-multus-daemon-config\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-cni-binary-copy\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3b35378-86aa-48f8-bc78-57f6b84f81ce-iptables-alerter-script\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-kubelet-config\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhqr5\" (UniqueName: \"kubernetes.io/projected/7e659224-116c-4447-9bc1-463998af3d79-kube-api-access-rhqr5\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fspc\" (UniqueName: \"kubernetes.io/projected/1809e877-6cf8-43d4-9046-3ef68073edd6-kube-api-access-2fspc\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-socket-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-registration-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3b35378-86aa-48f8-bc78-57f6b84f81ce-host-slash\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486903 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ccbbb000-17b0-48c6-9ef7-081f00d2129c-konnectivity-ca\") pod \"konnectivity-agent-zrlqx\" (UID: \"ccbbb000-17b0-48c6-9ef7-081f00d2129c\") " pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:14.487272 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-hostroot\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-etc-kubernetes\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-cnibin\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-cnibin\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.486999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-cni-multus\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487037 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e659224-116c-4447-9bc1-463998af3d79-cni-binary-copy\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.487072 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487098 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-var-lib-kubelet\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.487121 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs podName:1809e877-6cf8-43d4-9046-3ef68073edd6 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:14.987107017 +0000 UTC m=+3.053010740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs") pod "network-metrics-daemon-mthbh" (UID: "1809e877-6cf8-43d4-9046-3ef68073edd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.487132 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.487193 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret podName:57d45a8d-f26e-46fe-b4ae-9885e8c21d37 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:14.987175643 +0000 UTC m=+3.053079384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret") pod "global-pull-secret-syncer-z84pz" (UID: "57d45a8d-f26e-46fe-b4ae-9885e8c21d37") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487210 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-socket-dir-parent\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-conf-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487248 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-dbus\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487284 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-multus-certs\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487322 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-multus-cni-dir\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488217 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487350 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-netns\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-socket-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e659224-116c-4447-9bc1-463998af3d79-multus-daemon-config\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487557 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-registration-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487587 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3b35378-86aa-48f8-bc78-57f6b84f81ce-host-slash\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487615 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-hostroot\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487624 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-etc-kubernetes\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487673 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-cnibin\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487678 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e659224-116c-4447-9bc1-463998af3d79-host-run-k8s-cni-cncf-io\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f24796a-8c91-4070-9e1b-9a4d038ab457-cnibin\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487700 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487736 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-device-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487755 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-cni-binary-copy\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487792 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6da6680b-cccb-4378-8a63-f0f356612573-sys-fs\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.487862 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-kubelet-config\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.488850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.488218 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3b35378-86aa-48f8-bc78-57f6b84f81ce-iptables-alerter-script\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.489493 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.488376 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f24796a-8c91-4070-9e1b-9a4d038ab457-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.490693 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.490671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ccbbb000-17b0-48c6-9ef7-081f00d2129c-agent-certs\") pod \"konnectivity-agent-zrlqx\" (UID: \"ccbbb000-17b0-48c6-9ef7-081f00d2129c\") " pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:14.498273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.498200 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqwfx\" (UniqueName: \"kubernetes.io/projected/d3b35378-86aa-48f8-bc78-57f6b84f81ce-kube-api-access-fqwfx\") pod \"iptables-alerter-2nmvh\" (UID: \"d3b35378-86aa-48f8-bc78-57f6b84f81ce\") " pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.503129 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.503100 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhqr5\" (UniqueName: \"kubernetes.io/projected/7e659224-116c-4447-9bc1-463998af3d79-kube-api-access-rhqr5\") pod \"multus-8spjh\" (UID: \"7e659224-116c-4447-9bc1-463998af3d79\") " pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.503315 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.503294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbzv7\" (UniqueName: \"kubernetes.io/projected/6da6680b-cccb-4378-8a63-f0f356612573-kube-api-access-sbzv7\") pod \"aws-ebs-csi-driver-node-9z9ws\" (UID: \"6da6680b-cccb-4378-8a63-f0f356612573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.503790 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.503764 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk97v\" (UniqueName: \"kubernetes.io/projected/1f24796a-8c91-4070-9e1b-9a4d038ab457-kube-api-access-pk97v\") pod \"multus-additional-cni-plugins-6rt9g\" (UID: \"1f24796a-8c91-4070-9e1b-9a4d038ab457\") " pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.507591 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.507563 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fspc\" (UniqueName: \"kubernetes.io/projected/1809e877-6cf8-43d4-9046-3ef68073edd6-kube-api-access-2fspc\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:14.570589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.570544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgzwk" Sep 19 01:39:14.583421 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.583375 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" Sep 19 01:39:14.592610 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.592576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mvttq" Sep 19 01:39:14.598561 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.598539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:14.606503 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.606479 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:14.613894 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.613873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" Sep 19 01:39:14.615997 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.615977 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:14.622138 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.622117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" Sep 19 01:39:14.634776 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.634747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2nmvh" Sep 19 01:39:14.640882 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.640857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8spjh" Sep 19 01:39:14.991303 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.991217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:14.991303 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.991291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:14.991542 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:14.991326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:14.991542 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.991377 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:14.991775 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.991739 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:14.991835 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.991777 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:14.991835 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.991814 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:14.991835 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.991827 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jm2tl for pod openshift-network-diagnostics/network-check-target-2n54s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:14.991976 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.991841 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret podName:57d45a8d-f26e-46fe-b4ae-9885e8c21d37 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:15.991821011 +0000 UTC m=+4.057724739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret") pod "global-pull-secret-syncer-z84pz" (UID: "57d45a8d-f26e-46fe-b4ae-9885e8c21d37") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:14.991976 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.991860 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs podName:1809e877-6cf8-43d4-9046-3ef68073edd6 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:15.991850204 +0000 UTC m=+4.057753930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs") pod "network-metrics-daemon-mthbh" (UID: "1809e877-6cf8-43d4-9046-3ef68073edd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:14.991976 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:14.991883 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl podName:1a08e37a-88d9-451e-a505-ee8c069d50c9 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:15.991866968 +0000 UTC m=+4.057770690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm2tl" (UniqueName: "kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl") pod "network-check-target-2n54s" (UID: "1a08e37a-88d9-451e-a505-ee8c069d50c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:15.322320 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:15.322217 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 01:34:14 +0000 UTC" deadline="2028-06-20 10:55:43.076260672 +0000 UTC" Sep 19 01:39:15.322320 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:15.322273 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15369h16m27.753992515s" Sep 19 01:39:15.368667 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:15.368635 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:15.368827 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.368748 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:15.414544 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:15.414512 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3af8c78_dff6_4fc2_9ccc_749dc5fd7bd6.slice/crio-c0dd7dce85b2c25b3d731183fb97236c4b248c6d734c3c6ce333f20e43f3b08a WatchSource:0}: Error finding container c0dd7dce85b2c25b3d731183fb97236c4b248c6d734c3c6ce333f20e43f3b08a: Status 404 returned error can't find the container with id c0dd7dce85b2c25b3d731183fb97236c4b248c6d734c3c6ce333f20e43f3b08a Sep 19 01:39:15.416604 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:15.416577 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b35378_86aa_48f8_bc78_57f6b84f81ce.slice/crio-0fca514861e282ffa7959ba79d9d2a72581e14c80c0e30e34bed6e9de6eee942 WatchSource:0}: Error finding container 0fca514861e282ffa7959ba79d9d2a72581e14c80c0e30e34bed6e9de6eee942: Status 404 returned error can't find the container with id 0fca514861e282ffa7959ba79d9d2a72581e14c80c0e30e34bed6e9de6eee942 Sep 19 01:39:15.418183 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:15.418161 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbbb000_17b0_48c6_9ef7_081f00d2129c.slice/crio-23b013b8ed56597bec8eb2f225a5c8d59aaa32d8345b86db652b867fe5ecdc3f WatchSource:0}: Error finding container 23b013b8ed56597bec8eb2f225a5c8d59aaa32d8345b86db652b867fe5ecdc3f: Status 404 returned error can't find the container with id 23b013b8ed56597bec8eb2f225a5c8d59aaa32d8345b86db652b867fe5ecdc3f Sep 19 01:39:15.420870 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:15.420849 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4a6dc6_23a3_43d3_bfd7_7606d3f4f297.slice/crio-31976f848969641719df8bd12238217b02ae0aee3d6852e35adbf47c40719e39 WatchSource:0}: Error finding container 31976f848969641719df8bd12238217b02ae0aee3d6852e35adbf47c40719e39: Status 404 returned error can't find the container with id 31976f848969641719df8bd12238217b02ae0aee3d6852e35adbf47c40719e39 Sep 19 01:39:15.421569 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:15.421517 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf652b19d_2016_40dd_8f08_0a7d6e4d1e62.slice/crio-88146c2b9fc97998c864b9c4345dfad5dcb3fa6f3f450ac44f206d74a2ec6afb WatchSource:0}: Error finding container 88146c2b9fc97998c864b9c4345dfad5dcb3fa6f3f450ac44f206d74a2ec6afb: Status 404 returned error can't find the container with id 88146c2b9fc97998c864b9c4345dfad5dcb3fa6f3f450ac44f206d74a2ec6afb Sep 19 01:39:15.422213 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:15.422180 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aaf6e24_c0ae_4d9a_adc5_95a03d983395.slice/crio-0cecfe604e1d3d8ad5e29325a289d98697a47a62607c6e644ea4b9e8c6f3e268 WatchSource:0}: Error finding container 0cecfe604e1d3d8ad5e29325a289d98697a47a62607c6e644ea4b9e8c6f3e268: Status 404 returned error can't find the container with id 0cecfe604e1d3d8ad5e29325a289d98697a47a62607c6e644ea4b9e8c6f3e268 Sep 19 01:39:15.434743 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:15.434715 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 01:39:15.998135 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:15.998087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:15.998333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:15.998171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:15.998333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:15.998230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:15.998333 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.998403 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:15.998653 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.998473 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret podName:57d45a8d-f26e-46fe-b4ae-9885e8c21d37 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:17.9984535 +0000 UTC m=+6.064357238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret") pod "global-pull-secret-syncer-z84pz" (UID: "57d45a8d-f26e-46fe-b4ae-9885e8c21d37") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:15.998929 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.998907 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:15.998977 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.998937 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:15.998977 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.998954 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jm2tl for pod openshift-network-diagnostics/network-check-target-2n54s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:15.999039 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.999004 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl podName:1a08e37a-88d9-451e-a505-ee8c069d50c9 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:17.998988464 +0000 UTC m=+6.064892203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm2tl" (UniqueName: "kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl") pod "network-check-target-2n54s" (UID: "1a08e37a-88d9-451e-a505-ee8c069d50c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:15.999082 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.999072 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:15.999117 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:15.999112 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs podName:1809e877-6cf8-43d4-9046-3ef68073edd6 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:17.999098614 +0000 UTC m=+6.065002351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs") pod "network-metrics-daemon-mthbh" (UID: "1809e877-6cf8-43d4-9046-3ef68073edd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:16.323310 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.323218 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 01:34:14 +0000 UTC" deadline="2028-04-22 13:10:21.513514931 +0000 UTC" Sep 19 01:39:16.323310 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.323261 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13955h31m5.190258628s" Sep 19 01:39:16.370213 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.370178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:16.370389 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:16.370302 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:16.370744 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.370723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:16.370847 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:16.370826 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:16.400239 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.399682 2564 generic.go:356] "Generic (PLEG): container finished" podID="1eafad0aa0edaad12fedad61adff6039" containerID="5bb7a8b0f8d5df25cee68d86407658fb3b4e0869c62cdbb009335b8e64b9ea66" exitCode=0 Sep 19 01:39:16.400239 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.399781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" event={"ID":"1eafad0aa0edaad12fedad61adff6039","Type":"ContainerDied","Data":"5bb7a8b0f8d5df25cee68d86407658fb3b4e0869c62cdbb009335b8e64b9ea66"} Sep 19 01:39:16.418720 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.418685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" event={"ID":"1676bf3cffcb415df1f65bf8ae4005f2","Type":"ContainerStarted","Data":"f8b96c65d108cb9820cbd2610e091e8805810e3426c7868083e446e6449de5c9"} Sep 19 01:39:16.433659 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.433631 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8spjh" event={"ID":"7e659224-116c-4447-9bc1-463998af3d79","Type":"ContainerStarted","Data":"0637378ae49a6c68858171db710b2b2c6fe04b12c1889ae19a6444db2273f256"} Sep 19 01:39:16.442700 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.442626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" event={"ID":"1f24796a-8c91-4070-9e1b-9a4d038ab457","Type":"ContainerStarted","Data":"6c9d1f4725d88736582e3c5cbf8de13eaf40dfe8296209c57c8a7dd2a26d96a1"} Sep 19 01:39:16.478050 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.478006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" event={"ID":"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297","Type":"ContainerStarted","Data":"31976f848969641719df8bd12238217b02ae0aee3d6852e35adbf47c40719e39"} Sep 19 01:39:16.493882 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.493842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zrlqx" event={"ID":"ccbbb000-17b0-48c6-9ef7-081f00d2129c","Type":"ContainerStarted","Data":"23b013b8ed56597bec8eb2f225a5c8d59aaa32d8345b86db652b867fe5ecdc3f"} Sep 19 01:39:16.505802 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.505744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"c0dd7dce85b2c25b3d731183fb97236c4b248c6d734c3c6ce333f20e43f3b08a"} Sep 19 01:39:16.515947 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.515919 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" event={"ID":"6da6680b-cccb-4378-8a63-f0f356612573","Type":"ContainerStarted","Data":"736362fd1e7ee4a54a732cb68d733508d002b66ff8f0aa835bdab6f4b5711fdc"} Sep 19 01:39:16.536271 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.536238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgzwk" event={"ID":"3aaf6e24-c0ae-4d9a-adc5-95a03d983395","Type":"ContainerStarted","Data":"0cecfe604e1d3d8ad5e29325a289d98697a47a62607c6e644ea4b9e8c6f3e268"} Sep 19 01:39:16.544671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.544540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mvttq" event={"ID":"f652b19d-2016-40dd-8f08-0a7d6e4d1e62","Type":"ContainerStarted","Data":"88146c2b9fc97998c864b9c4345dfad5dcb3fa6f3f450ac44f206d74a2ec6afb"} Sep 19 01:39:16.570771 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:16.570727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2nmvh" event={"ID":"d3b35378-86aa-48f8-bc78-57f6b84f81ce","Type":"ContainerStarted","Data":"0fca514861e282ffa7959ba79d9d2a72581e14c80c0e30e34bed6e9de6eee942"} Sep 19 01:39:17.368699 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:17.368661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:17.369170 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:17.368812 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:17.591435 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:17.591400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" event={"ID":"1eafad0aa0edaad12fedad61adff6039","Type":"ContainerStarted","Data":"7e4427ab6606144741de97c92ed9c93893a50378b7e39dca377a6591d5e2bf8f"} Sep 19 01:39:17.607319 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:17.607260 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-63.ec2.internal" podStartSLOduration=4.607239519 podStartE2EDuration="4.607239519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:17.606365894 +0000 UTC m=+5.672269637" watchObservedRunningTime="2026-09-19 01:39:17.607239519 +0000 UTC m=+5.673143265" Sep 19 01:39:17.607604 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:17.607573 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-63.ec2.internal" podStartSLOduration=4.607562094 podStartE2EDuration="4.607562094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:16.438307591 +0000 UTC m=+4.504211337" watchObservedRunningTime="2026-09-19 01:39:17.607562094 +0000 UTC m=+5.673465840" Sep 19 01:39:18.016012 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:18.015970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:18.016186 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:18.016029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:18.016186 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:18.016087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:18.016315 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.016218 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:18.016315 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.016286 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs podName:1809e877-6cf8-43d4-9046-3ef68073edd6 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:22.016264885 +0000 UTC m=+10.082168612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs") pod "network-metrics-daemon-mthbh" (UID: "1809e877-6cf8-43d4-9046-3ef68073edd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:18.016803 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.016782 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:18.016881 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.016844 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret podName:57d45a8d-f26e-46fe-b4ae-9885e8c21d37 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:22.016827691 +0000 UTC m=+10.082731415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret") pod "global-pull-secret-syncer-z84pz" (UID: "57d45a8d-f26e-46fe-b4ae-9885e8c21d37") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:18.016949 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.016936 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:18.017011 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.016958 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:18.017011 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.016970 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jm2tl for pod openshift-network-diagnostics/network-check-target-2n54s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:18.017011 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.017005 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl podName:1a08e37a-88d9-451e-a505-ee8c069d50c9 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:22.016993997 +0000 UTC m=+10.082897720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm2tl" (UniqueName: "kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl") pod "network-check-target-2n54s" (UID: "1a08e37a-88d9-451e-a505-ee8c069d50c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:18.370453 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:18.370373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:18.370886 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.370503 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:18.371005 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:18.370896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:18.371005 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:18.370994 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:19.368132 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:19.368098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:19.368427 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:19.368215 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:20.369473 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:20.369445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:20.369913 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:20.369550 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:20.369971 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:20.369929 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:20.370029 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:20.370012 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:21.368437 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:21.368107 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:21.368604 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:21.368495 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:22.047623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:22.047696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:22.047730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.047874 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.047895 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.047908 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jm2tl for pod openshift-network-diagnostics/network-check-target-2n54s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.047972 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl podName:1a08e37a-88d9-451e-a505-ee8c069d50c9 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:30.047951883 +0000 UTC m=+18.113855608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm2tl" (UniqueName: "kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl") pod "network-check-target-2n54s" (UID: "1a08e37a-88d9-451e-a505-ee8c069d50c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.048396 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.048443 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs podName:1809e877-6cf8-43d4-9046-3ef68073edd6 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:30.048427665 +0000 UTC m=+18.114331388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs") pod "network-metrics-daemon-mthbh" (UID: "1809e877-6cf8-43d4-9046-3ef68073edd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.048498 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:22.048563 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.048530 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret podName:57d45a8d-f26e-46fe-b4ae-9885e8c21d37 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:30.048519071 +0000 UTC m=+18.114422796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret") pod "global-pull-secret-syncer-z84pz" (UID: "57d45a8d-f26e-46fe-b4ae-9885e8c21d37") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:22.369243 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:22.369167 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:22.369415 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:22.369274 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:22.369415 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.369280 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:22.369534 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:22.369412 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:23.367909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:23.367872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:23.368419 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:23.368000 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:24.369044 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:24.369009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:24.369551 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:24.369119 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:24.369551 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:24.369545 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:24.369733 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:24.369695 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:25.368320 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:25.368288 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:25.368491 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:25.368419 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:26.368255 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:26.368222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:26.368695 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:26.368336 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:26.368695 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:26.368407 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:26.368695 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:26.368533 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:27.368903 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:27.368868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:27.369309 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:27.369005 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:28.368417 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:28.368380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:28.368588 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:28.368382 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:28.368588 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:28.368489 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:28.368695 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:28.368589 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:29.368854 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:29.368819 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:29.369453 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:29.368943 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:30.108412 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:30.108377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:30.108412 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:30.108417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:30.108606 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:30.108446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:30.108606 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.108536 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:30.108606 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.108536 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:30.108606 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.108548 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:30.108606 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.108569 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:30.108606 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.108578 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jm2tl for pod openshift-network-diagnostics/network-check-target-2n54s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:30.108606 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.108595 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs podName:1809e877-6cf8-43d4-9046-3ef68073edd6 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:46.108579644 +0000 UTC m=+34.174483368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs") pod "network-metrics-daemon-mthbh" (UID: "1809e877-6cf8-43d4-9046-3ef68073edd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:30.108821 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.108612 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl podName:1a08e37a-88d9-451e-a505-ee8c069d50c9 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:46.10860185 +0000 UTC m=+34.174505572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm2tl" (UniqueName: "kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl") pod "network-check-target-2n54s" (UID: "1a08e37a-88d9-451e-a505-ee8c069d50c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:30.108821 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.108627 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret podName:57d45a8d-f26e-46fe-b4ae-9885e8c21d37 nodeName:}" failed. No retries permitted until 2026-09-19 01:39:46.108619891 +0000 UTC m=+34.174523612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret") pod "global-pull-secret-syncer-z84pz" (UID: "57d45a8d-f26e-46fe-b4ae-9885e8c21d37") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:30.368994 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:30.368896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:30.369466 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.369050 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:30.369466 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:30.369080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:30.369466 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:30.369183 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:31.368611 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:31.368576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:31.368820 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:31.368699 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:32.369069 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:32.369031 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:32.369560 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:32.369136 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:32.369560 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:32.369229 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:32.369560 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:32.369331 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:33.368096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:33.368061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:33.368297 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:33.368165 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:34.369051 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.368810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:34.369766 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.368866 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:34.369766 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:34.369172 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:34.369766 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:34.369249 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:34.630395 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.630336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8spjh" event={"ID":"7e659224-116c-4447-9bc1-463998af3d79","Type":"ContainerStarted","Data":"15a1f7ba8882b771006cf040f29a3570b07bc977f6e6fc22dd7010e73f23e75b"} Sep 19 01:39:34.632289 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.632255 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f24796a-8c91-4070-9e1b-9a4d038ab457" containerID="92b2618cdf01297f57f334c58f10456bd8058facd7dc76acfe56efd09e58e3a6" exitCode=0 Sep 19 01:39:34.632450 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.632360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" event={"ID":"1f24796a-8c91-4070-9e1b-9a4d038ab457","Type":"ContainerDied","Data":"92b2618cdf01297f57f334c58f10456bd8058facd7dc76acfe56efd09e58e3a6"} Sep 19 01:39:34.634511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.634484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" event={"ID":"0b4a6dc6-23a3-43d3-bfd7-7606d3f4f297","Type":"ContainerStarted","Data":"433bfd9b337bbbd044b9ccd079c0b29a248bf80884a3a199c51d8d83793df9a8"} Sep 19 01:39:34.636273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.636238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zrlqx" event={"ID":"ccbbb000-17b0-48c6-9ef7-081f00d2129c","Type":"ContainerStarted","Data":"48f515c785aa5ac41e2e078ddcb2688f097c887e5e14e3353315adfc3abe711a"} Sep 19 01:39:34.639443 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.639422 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:39:34.639881 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.639853 2564 generic.go:356] "Generic (PLEG): container finished" podID="b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6" containerID="a7b4c34df9bceecaa3b2671258713cc26f480b7fee49c9bd0f4d05b6fecf8e87" exitCode=1 Sep 19 01:39:34.639994 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.639930 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"dae9c0bf02191b761f239dd2a2af6cfb577e7f3a5f8c17c51733818e316be174"} Sep 19 01:39:34.640035 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.640001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"2a8c16e8b51369d0bc22e28d0428276a57ab22cbd6d5c1132464a95cdd94cbcd"} Sep 19 01:39:34.640078 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.640049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"3b5ee8fa5cffb8cf6113d9956c2c6157365ea7d337a9af340a76229e67fb83f9"} Sep 19 01:39:34.640114 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.640094 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"4cc32f49c0615b643a33d5cb08d2a3dc576d1b732a92affa1c483b3977b51011"} Sep 19 01:39:34.640165 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.640140 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerDied","Data":"a7b4c34df9bceecaa3b2671258713cc26f480b7fee49c9bd0f4d05b6fecf8e87"} Sep 19 01:39:34.640226 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.640186 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"c4dbb7827515b4019a7c7e63a6b5617187505c42f81283b4940daf584e56608b"} Sep 19 01:39:34.642228 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.642200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" event={"ID":"6da6680b-cccb-4378-8a63-f0f356612573","Type":"ContainerStarted","Data":"102923ff8c85b17b979da683bcee7c17851f6a9db03d2fbde03e749db7c9b80b"} Sep 19 01:39:34.643950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.643929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgzwk" event={"ID":"3aaf6e24-c0ae-4d9a-adc5-95a03d983395","Type":"ContainerStarted","Data":"1c1c18f9d869b89aa948d5d331c6804b0001a1e4e1552eac1af0a9bcc268205a"} Sep 19 01:39:34.645514 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.645489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mvttq" event={"ID":"f652b19d-2016-40dd-8f08-0a7d6e4d1e62","Type":"ContainerStarted","Data":"13b45871a98934aa1fa16fa8fb515e0ca847763c2dc49c8276c3dcf481d30ae7"} Sep 19 01:39:34.647717 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.647676 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8spjh" podStartSLOduration=4.355448029 podStartE2EDuration="22.647663439s" totalImagesPullingTime="18.29221541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:34.647255501 +0000 UTC m=+22.713159245" watchObservedRunningTime="2026-09-19 01:39:34.647663439 +0000 UTC m=+22.713567184" Sep 19 01:39:34.660914 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.660871 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mvttq" podStartSLOduration=4.421855486 podStartE2EDuration="22.660857177s" totalImagesPullingTime="18.239001691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:34.660540359 +0000 UTC m=+22.726444105" watchObservedRunningTime="2026-09-19 01:39:34.660857177 +0000 UTC m=+22.726760921" Sep 19 01:39:34.675564 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.675518 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dgzwk" podStartSLOduration=4.438372243 podStartE2EDuration="22.675497777s" totalImagesPullingTime="18.237125534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:34.675386496 +0000 UTC m=+22.741290243" watchObservedRunningTime="2026-09-19 01:39:34.675497777 +0000 UTC m=+22.741401521" Sep 19 01:39:34.691628 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.691042 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zrlqx" podStartSLOduration=7.958168613 podStartE2EDuration="22.691025318s" totalImagesPullingTime="14.732856705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:34.690599691 +0000 UTC m=+22.756503436" watchObservedRunningTime="2026-09-19 01:39:34.691025318 +0000 UTC m=+22.756929065" Sep 19 01:39:34.728860 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:34.728813 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8q8mz" podStartSLOduration=4.46648367 podStartE2EDuration="22.728799356s" totalImagesPullingTime="18.262315686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:34.728378875 +0000 UTC m=+22.794282616" watchObservedRunningTime="2026-09-19 01:39:34.728799356 +0000 UTC m=+22.794703100" Sep 19 01:39:35.267787 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.267508 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 19 01:39:35.352055 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.351947 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T01:39:35.267754402Z","UUID":"e95f099c-181c-4249-bcee-6a2bc3cc7fb4","Handler":null,"Name":"","Endpoint":""} Sep 19 01:39:35.353377 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.353339 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 19 01:39:35.353469 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.353391 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 19 01:39:35.367934 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.367899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:35.368060 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:35.367995 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:35.650407 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.650366 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" event={"ID":"6da6680b-cccb-4378-8a63-f0f356612573","Type":"ContainerStarted","Data":"a3511a99b3636d4f5420e31acdc5ac9c2225d5504c97d2eaa56ec6a492a08589"} Sep 19 01:39:35.652095 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.651964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2nmvh" event={"ID":"d3b35378-86aa-48f8-bc78-57f6b84f81ce","Type":"ContainerStarted","Data":"f801ff8bd49c3ea06872673038c2e8f8dac5dac97584cd046050e0e5c418b7a0"} Sep 19 01:39:35.666776 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.666728 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2nmvh" podStartSLOduration=5.413573374 podStartE2EDuration="23.666711285s" totalImagesPullingTime="18.253137911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:35.666549833 +0000 UTC m=+23.732453580" watchObservedRunningTime="2026-09-19 01:39:35.666711285 +0000 UTC m=+23.732615032" Sep 19 01:39:35.931378 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.931268 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:35.932042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:35.932021 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:36.368578 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:36.368547 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:36.368733 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:36.368696 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:36.368789 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:36.368755 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:36.368903 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:36.368882 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:36.657257 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:36.657165 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" event={"ID":"6da6680b-cccb-4378-8a63-f0f356612573","Type":"ContainerStarted","Data":"b6bcff229c2a8c36c08f18dfb23b6e1601684fbc446653978eb52d7c8fd51837"} Sep 19 01:39:36.660785 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:36.660763 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:39:36.661156 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:36.661132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"59df0789afbc4cb7aa43778cb01d1f3c7eca8d84d650aebbea884c843e631c61"} Sep 19 01:39:36.661523 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:36.661503 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:36.662023 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:36.662000 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zrlqx" Sep 19 01:39:36.674927 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:36.674880 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9z9ws" podStartSLOduration=4.191012865 podStartE2EDuration="24.674865976s" totalImagesPullingTime="20.483853111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:36.673691999 +0000 UTC m=+24.739595743" watchObservedRunningTime="2026-09-19 01:39:36.674865976 +0000 UTC m=+24.740769724" Sep 19 01:39:37.368255 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:37.368226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:37.368426 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:37.368330 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:38.368424 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:38.368390 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:38.368912 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:38.368394 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:38.368912 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:38.368536 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:38.368912 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:38.368606 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:39.368824 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.368660 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:39.369125 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:39.368905 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:39.671808 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.671732 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:39:39.672188 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.672163 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"7e34f8cbc02eb19579162a4a64358cb4053ff19afc01733d48ea3c6b5d647c36"} Sep 19 01:39:39.672475 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.672381 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:39.672475 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.672448 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:39.672666 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.672651 2564 scope.go:117] "RemoveContainer" containerID="a7b4c34df9bceecaa3b2671258713cc26f480b7fee49c9bd0f4d05b6fecf8e87" Sep 19 01:39:39.674162 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.674142 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f24796a-8c91-4070-9e1b-9a4d038ab457" containerID="0dbce76fd5d9c7221f2c5bd21257ba457865016fd13016356e32e943ad804df9" exitCode=0 Sep 19 01:39:39.674263 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.674177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" event={"ID":"1f24796a-8c91-4070-9e1b-9a4d038ab457","Type":"ContainerDied","Data":"0dbce76fd5d9c7221f2c5bd21257ba457865016fd13016356e32e943ad804df9"} Sep 19 01:39:39.689242 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:39.689214 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:40.371574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:40.370910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:40.371574 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:40.371018 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:40.371574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:40.371371 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:40.371574 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:40.371497 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:40.680406 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:40.680327 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:39:40.680780 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:40.680758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" event={"ID":"b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6","Type":"ContainerStarted","Data":"4e684d90976d00c1a46fa0ccf7973f9101cb6a2d4409d6617d7f5cab1b469d4d"} Sep 19 01:39:40.681139 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:40.681111 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:40.697401 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:40.697328 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:39:40.716940 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:40.716867 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" podStartSLOduration=10.403131922 podStartE2EDuration="28.716848996s" totalImagesPullingTime="18.313717074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:40.715835025 +0000 UTC m=+28.781738808" watchObservedRunningTime="2026-09-19 01:39:40.716848996 +0000 UTC m=+28.782752740" Sep 19 01:39:41.013637 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:41.013394 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mthbh"] Sep 19 01:39:41.013788 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:41.013760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:41.013899 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:41.013878 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:41.017519 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:41.017495 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z84pz"] Sep 19 01:39:41.017645 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:41.017578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:41.017690 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:41.017661 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:41.035086 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:41.035060 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2n54s"] Sep 19 01:39:41.035204 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:41.035165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:41.035260 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:41.035239 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:41.685730 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:41.685696 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f24796a-8c91-4070-9e1b-9a4d038ab457" containerID="81dc0bdb9db2aeeb51e545abb32fe9f56217b6dc59dcae207ad34b4ea2218713" exitCode=0 Sep 19 01:39:41.686472 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:41.685755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" event={"ID":"1f24796a-8c91-4070-9e1b-9a4d038ab457","Type":"ContainerDied","Data":"81dc0bdb9db2aeeb51e545abb32fe9f56217b6dc59dcae207ad34b4ea2218713"} Sep 19 01:39:42.368799 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:42.368768 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:42.368956 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:42.368858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:42.368956 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:42.368865 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:42.369039 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:42.368989 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:43.368411 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:43.368336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:43.368855 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:43.368488 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:43.693099 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:43.693062 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f24796a-8c91-4070-9e1b-9a4d038ab457" containerID="8cd2b2a2309794f0b3cddb42a4e1c196431e3b85af262f115eed18ca8809c66f" exitCode=0 Sep 19 01:39:43.693301 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:43.693124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" event={"ID":"1f24796a-8c91-4070-9e1b-9a4d038ab457","Type":"ContainerDied","Data":"8cd2b2a2309794f0b3cddb42a4e1c196431e3b85af262f115eed18ca8809c66f"} Sep 19 01:39:44.368229 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:44.368191 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:44.368430 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:44.368329 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:44.368430 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:44.368394 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:44.368878 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:44.368509 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:45.368113 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:45.368075 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:45.368294 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:45.368199 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z84pz" podUID="57d45a8d-f26e-46fe-b4ae-9885e8c21d37" Sep 19 01:39:46.117492 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.117454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.117526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.117556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.117620 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.117661 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.117675 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.117688 2564 projected.go:196] Error preparing data for projected volume kube-api-access-jm2tl for pod openshift-network-diagnostics/network-check-target-2n54s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.117689 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs podName:1809e877-6cf8-43d4-9046-3ef68073edd6 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:18.117671228 +0000 UTC m=+66.183574969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs") pod "network-metrics-daemon-mthbh" (UID: "1809e877-6cf8-43d4-9046-3ef68073edd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.117729 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl podName:1a08e37a-88d9-451e-a505-ee8c069d50c9 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:18.117717832 +0000 UTC m=+66.183621555 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jm2tl" (UniqueName: "kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl") pod "network-check-target-2n54s" (UID: "1a08e37a-88d9-451e-a505-ee8c069d50c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.117728 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:46.118069 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.117806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret podName:57d45a8d-f26e-46fe-b4ae-9885e8c21d37 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:18.117792683 +0000 UTC m=+66.183696409 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret") pod "global-pull-secret-syncer-z84pz" (UID: "57d45a8d-f26e-46fe-b4ae-9885e8c21d37") : object "kube-system"/"original-pull-secret" not registered Sep 19 01:39:46.368050 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.367969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:46.368050 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.368005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:46.368226 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.368110 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mthbh" podUID="1809e877-6cf8-43d4-9046-3ef68073edd6" Sep 19 01:39:46.368285 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:46.368256 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2n54s" podUID="1a08e37a-88d9-451e-a505-ee8c069d50c9" Sep 19 01:39:46.763360 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.763323 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-63.ec2.internal" event="NodeReady" Sep 19 01:39:46.763519 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.763499 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 19 01:39:46.811140 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.811107 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zjk5z"] Sep 19 01:39:46.816023 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.815998 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n84hj"] Sep 19 01:39:46.816156 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.816122 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:46.818534 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.818509 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 19 01:39:46.819598 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.819266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n84hj" Sep 19 01:39:46.819598 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.819406 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 19 01:39:46.819598 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.819422 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttj8c\"" Sep 19 01:39:46.821473 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.821451 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 19 01:39:46.821624 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.821607 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 19 01:39:46.822163 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.822135 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 19 01:39:46.822163 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.822141 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-898pj\"" Sep 19 01:39:46.824885 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.824826 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zjk5z"] Sep 19 01:39:46.828499 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.828479 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n84hj"] Sep 19 01:39:46.924270 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.924237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43575c24-a13f-496e-9439-5aecfa3a477e-tmp-dir\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:46.924471 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.924277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43575c24-a13f-496e-9439-5aecfa3a477e-config-volume\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:46.924471 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.924315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:46.924471 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.924373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5c5m\" (UniqueName: \"kubernetes.io/projected/43575c24-a13f-496e-9439-5aecfa3a477e-kube-api-access-s5c5m\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:46.924471 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.924399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27d15022-5125-4ec5-a331-94a8885c003a-cert\") pod \"ingress-canary-n84hj\" (UID: \"27d15022-5125-4ec5-a331-94a8885c003a\") " pod="openshift-ingress-canary/ingress-canary-n84hj" Sep 19 01:39:46.924471 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:46.924418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ms8n\" (UniqueName: \"kubernetes.io/projected/27d15022-5125-4ec5-a331-94a8885c003a-kube-api-access-7ms8n\") pod \"ingress-canary-n84hj\" (UID: \"27d15022-5125-4ec5-a331-94a8885c003a\") " pod="openshift-ingress-canary/ingress-canary-n84hj" Sep 19 01:39:47.025589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.025507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5c5m\" (UniqueName: \"kubernetes.io/projected/43575c24-a13f-496e-9439-5aecfa3a477e-kube-api-access-s5c5m\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:47.025589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.025543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27d15022-5125-4ec5-a331-94a8885c003a-cert\") pod \"ingress-canary-n84hj\" (UID: \"27d15022-5125-4ec5-a331-94a8885c003a\") " pod="openshift-ingress-canary/ingress-canary-n84hj" Sep 19 01:39:47.025589 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.025559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ms8n\" (UniqueName: \"kubernetes.io/projected/27d15022-5125-4ec5-a331-94a8885c003a-kube-api-access-7ms8n\") pod \"ingress-canary-n84hj\" (UID: \"27d15022-5125-4ec5-a331-94a8885c003a\") " pod="openshift-ingress-canary/ingress-canary-n84hj" Sep 19 01:39:47.025874 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.025680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43575c24-a13f-496e-9439-5aecfa3a477e-tmp-dir\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:47.025874 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.025724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43575c24-a13f-496e-9439-5aecfa3a477e-config-volume\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:47.025874 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.025746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:47.026032 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:47.025880 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:47.026032 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:47.025933 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls podName:43575c24-a13f-496e-9439-5aecfa3a477e nodeName:}" failed. No retries permitted until 2026-09-19 01:39:47.525917663 +0000 UTC m=+35.591821385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls") pod "dns-default-zjk5z" (UID: "43575c24-a13f-496e-9439-5aecfa3a477e") : secret "dns-default-metrics-tls" not found Sep 19 01:39:47.026128 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.026068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43575c24-a13f-496e-9439-5aecfa3a477e-tmp-dir\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:47.026322 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.026302 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43575c24-a13f-496e-9439-5aecfa3a477e-config-volume\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:47.030661 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.030637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27d15022-5125-4ec5-a331-94a8885c003a-cert\") pod \"ingress-canary-n84hj\" (UID: \"27d15022-5125-4ec5-a331-94a8885c003a\") " pod="openshift-ingress-canary/ingress-canary-n84hj" Sep 19 01:39:47.036051 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.036024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ms8n\" (UniqueName: \"kubernetes.io/projected/27d15022-5125-4ec5-a331-94a8885c003a-kube-api-access-7ms8n\") pod \"ingress-canary-n84hj\" (UID: \"27d15022-5125-4ec5-a331-94a8885c003a\") " pod="openshift-ingress-canary/ingress-canary-n84hj" Sep 19 01:39:47.036593 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.036572 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5c5m\" (UniqueName: \"kubernetes.io/projected/43575c24-a13f-496e-9439-5aecfa3a477e-kube-api-access-s5c5m\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:47.136383 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.136328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n84hj" Sep 19 01:39:47.368463 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.368191 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:39:47.371226 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.371206 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 01:39:47.528770 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:47.528724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:47.528964 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:47.528862 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:47.528964 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:47.528943 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls podName:43575c24-a13f-496e-9439-5aecfa3a477e nodeName:}" failed. No retries permitted until 2026-09-19 01:39:48.528922465 +0000 UTC m=+36.594826204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls") pod "dns-default-zjk5z" (UID: "43575c24-a13f-496e-9439-5aecfa3a477e") : secret "dns-default-metrics-tls" not found Sep 19 01:39:48.014969 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.014231 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n84hj"] Sep 19 01:39:48.022277 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:39:48.022247 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d15022_5125_4ec5_a331_94a8885c003a.slice/crio-3f942fecb60917066e76b1145d15e6a4d7a0edc667f712214131831c9a156b7d WatchSource:0}: Error finding container 3f942fecb60917066e76b1145d15e6a4d7a0edc667f712214131831c9a156b7d: Status 404 returned error can't find the container with id 3f942fecb60917066e76b1145d15e6a4d7a0edc667f712214131831c9a156b7d Sep 19 01:39:48.368942 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.368861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:39:48.369625 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.369070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:39:48.371910 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.371865 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 01:39:48.372691 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.372668 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 01:39:48.372798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.372687 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-td9x9\"" Sep 19 01:39:48.372798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.372700 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mflb\"" Sep 19 01:39:48.372798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.372706 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 01:39:48.536327 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.536290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:48.536521 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:48.536481 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:48.536593 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:48.536579 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls podName:43575c24-a13f-496e-9439-5aecfa3a477e nodeName:}" failed. No retries permitted until 2026-09-19 01:39:50.536556742 +0000 UTC m=+38.602460465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls") pod "dns-default-zjk5z" (UID: "43575c24-a13f-496e-9439-5aecfa3a477e") : secret "dns-default-metrics-tls" not found Sep 19 01:39:48.707591 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.707472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n84hj" event={"ID":"27d15022-5125-4ec5-a331-94a8885c003a","Type":"ContainerStarted","Data":"3f942fecb60917066e76b1145d15e6a4d7a0edc667f712214131831c9a156b7d"} Sep 19 01:39:48.710751 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.710720 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f24796a-8c91-4070-9e1b-9a4d038ab457" containerID="936d841c16643c3da1cfcc3db10d53a6226070ef921c7bd25a9ddf5c621695ae" exitCode=0 Sep 19 01:39:48.710904 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:48.710766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" event={"ID":"1f24796a-8c91-4070-9e1b-9a4d038ab457","Type":"ContainerDied","Data":"936d841c16643c3da1cfcc3db10d53a6226070ef921c7bd25a9ddf5c621695ae"} Sep 19 01:39:49.717585 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:49.717466 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f24796a-8c91-4070-9e1b-9a4d038ab457" containerID="aef5e7158f3654723383ef230846e1ab1cf6be9289177ad1614d1c74694908ac" exitCode=0 Sep 19 01:39:49.717585 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:49.717536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" event={"ID":"1f24796a-8c91-4070-9e1b-9a4d038ab457","Type":"ContainerDied","Data":"aef5e7158f3654723383ef230846e1ab1cf6be9289177ad1614d1c74694908ac"} Sep 19 01:39:50.553376 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:50.553286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:50.553506 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:50.553432 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:50.553506 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:50.553489 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls podName:43575c24-a13f-496e-9439-5aecfa3a477e nodeName:}" failed. No retries permitted until 2026-09-19 01:39:54.5534744 +0000 UTC m=+42.619378123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls") pod "dns-default-zjk5z" (UID: "43575c24-a13f-496e-9439-5aecfa3a477e") : secret "dns-default-metrics-tls" not found Sep 19 01:39:50.726526 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:50.726271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" event={"ID":"1f24796a-8c91-4070-9e1b-9a4d038ab457","Type":"ContainerStarted","Data":"2b5db5f1a31de06db360c171711a29367ffbff76a92eb5a3d58ca9583800dd5c"} Sep 19 01:39:50.727840 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:50.727809 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n84hj" event={"ID":"27d15022-5125-4ec5-a331-94a8885c003a","Type":"ContainerStarted","Data":"8f5e062bd55e696fc5992ab2e73d613ea7c93053e556ec82771a9e606dccbb86"} Sep 19 01:39:50.752647 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:50.752593 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6rt9g" podStartSLOduration=9.594911876 podStartE2EDuration="38.752577921s" totalImagesPullingTime="29.157666045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:50.751468436 +0000 UTC m=+38.817372180" watchObservedRunningTime="2026-09-19 01:39:50.752577921 +0000 UTC m=+38.818481664" Sep 19 01:39:50.767791 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:50.767735 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n84hj" podStartSLOduration=2.223634109 podStartE2EDuration="4.767713759s" totalImagesPullingTime="2.54407965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:50.766597352 +0000 UTC m=+38.832501095" watchObservedRunningTime="2026-09-19 01:39:50.767713759 +0000 UTC m=+38.833617504" Sep 19 01:39:54.586804 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:39:54.586767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:39:54.587164 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:54.586927 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:39:54.587164 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:39:54.586993 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls podName:43575c24-a13f-496e-9439-5aecfa3a477e nodeName:}" failed. No retries permitted until 2026-09-19 01:40:02.586978437 +0000 UTC m=+50.652882179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls") pod "dns-default-zjk5z" (UID: "43575c24-a13f-496e-9439-5aecfa3a477e") : secret "dns-default-metrics-tls" not found Sep 19 01:40:02.641558 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:02.641517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:40:02.641992 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:02.641670 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:40:02.641992 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:02.641736 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls podName:43575c24-a13f-496e-9439-5aecfa3a477e nodeName:}" failed. No retries permitted until 2026-09-19 01:40:18.641720615 +0000 UTC m=+66.707624353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls") pod "dns-default-zjk5z" (UID: "43575c24-a13f-496e-9439-5aecfa3a477e") : secret "dns-default-metrics-tls" not found Sep 19 01:40:12.699398 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:12.699371 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvbq9" Sep 19 01:40:15.397856 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.397820 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p"] Sep 19 01:40:15.400625 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.400607 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.402862 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.402834 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 19 01:40:15.402862 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.402856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 19 01:40:15.403049 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.402834 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:40:15.403581 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.403561 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jk87h\"" Sep 19 01:40:15.403660 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.403566 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 19 01:40:15.410831 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.410811 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p"] Sep 19 01:40:15.505194 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.505160 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-lc5nh"] Sep 19 01:40:15.506978 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.506961 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.509832 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.509811 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:40:15.509952 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.509915 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 19 01:40:15.509952 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.509945 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-775kq\"" Sep 19 01:40:15.510321 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.510304 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 19 01:40:15.510680 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.510663 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 19 01:40:15.515551 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.515534 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 19 01:40:15.533283 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.533254 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.533426 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.533378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c2vr\" (UniqueName: \"kubernetes.io/projected/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-kube-api-access-5c2vr\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.533426 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.533411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.534915 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.534894 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-lc5nh"] Sep 19 01:40:15.602922 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.602889 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz"] Sep 19 01:40:15.605613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.605579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:15.608203 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.608177 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 19 01:40:15.608361 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.608276 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kxslx\"" Sep 19 01:40:15.608489 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.608475 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 19 01:40:15.612389 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.612370 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77b9b5668c-5nh6p"] Sep 19 01:40:15.614192 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.614172 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.616307 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.616289 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 19 01:40:15.616660 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.616645 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 19 01:40:15.616998 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.616985 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 19 01:40:15.617046 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.617026 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-49x4x\"" Sep 19 01:40:15.622174 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.622151 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz"] Sep 19 01:40:15.622427 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.622408 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 19 01:40:15.630865 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.630844 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b9b5668c-5nh6p"] Sep 19 01:40:15.634218 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.634194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.634314 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.634240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-serving-cert\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.634314 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.634286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn7hk\" (UniqueName: \"kubernetes.io/projected/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-kube-api-access-sn7hk\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.634463 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.634320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.634463 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.634391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-trusted-ca\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.634463 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.634450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c2vr\" (UniqueName: \"kubernetes.io/projected/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-kube-api-access-5c2vr\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.634619 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.634465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-config\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.634783 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.634766 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.637862 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.637824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.653433 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.653371 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c2vr\" (UniqueName: \"kubernetes.io/projected/0d13f650-fdc9-44f8-92d6-d0ed0019e5a1-kube-api-access-5c2vr\") pod \"kube-storage-version-migrator-operator-55889f7b47-hkv2p\" (UID: \"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.710168 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.710130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" Sep 19 01:40:15.735316 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-trusted-ca\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.735490 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn22s\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-kube-api-access-bn22s\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.735490 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-bound-sa-token\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.735490 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.735490 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-config\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.735714 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735494 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abd9e256-2e8c-4230-a105-d29fe90bf5f3-ca-trust-extracted\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.735714 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-image-registry-private-configuration\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.735714 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-serving-cert\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.735714 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7hk\" (UniqueName: \"kubernetes.io/projected/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-kube-api-access-sn7hk\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.735714 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-installation-pull-secrets\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.735714 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/002d92fd-541e-4481-bcb9-a6fd0c9602f2-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:15.736004 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-certificates\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.736004 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-trusted-ca\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.736004 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.735835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:15.736254 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.736232 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-config\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.736452 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.736435 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-trusted-ca\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.738179 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.738147 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-serving-cert\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.745457 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.745431 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn7hk\" (UniqueName: \"kubernetes.io/projected/ae6411a5-1953-4b5a-a44b-03eeb4d833bd-kube-api-access-sn7hk\") pod \"console-operator-fd4bb46c-lc5nh\" (UID: \"ae6411a5-1953-4b5a-a44b-03eeb4d833bd\") " pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.816392 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.816330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:15.837066 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn22s\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-kube-api-access-bn22s\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837066 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-bound-sa-token\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837227 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837227 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:15.837202 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:40:15.837227 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:15.837213 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9b5668c-5nh6p: secret "image-registry-tls" not found Sep 19 01:40:15.837356 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:15.837261 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls podName:abd9e256-2e8c-4230-a105-d29fe90bf5f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:16.337242472 +0000 UTC m=+64.403146197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls") pod "image-registry-77b9b5668c-5nh6p" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3") : secret "image-registry-tls" not found Sep 19 01:40:15.837356 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abd9e256-2e8c-4230-a105-d29fe90bf5f3-ca-trust-extracted\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837356 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-image-registry-private-configuration\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837503 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-installation-pull-secrets\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837503 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/002d92fd-541e-4481-bcb9-a6fd0c9602f2-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:15.837603 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-certificates\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837603 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-trusted-ca\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837706 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:15.837759 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.837742 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abd9e256-2e8c-4230-a105-d29fe90bf5f3-ca-trust-extracted\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.837812 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:15.837745 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 19 01:40:15.837861 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:15.837840 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert podName:002d92fd-541e-4481-bcb9-a6fd0c9602f2 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:16.337819527 +0000 UTC m=+64.403723263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5jxjz" (UID: "002d92fd-541e-4481-bcb9-a6fd0c9602f2") : secret "networking-console-plugin-cert" not found Sep 19 01:40:15.838286 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.838259 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-certificates\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.838431 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.838387 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/002d92fd-541e-4481-bcb9-a6fd0c9602f2-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:15.838744 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.838718 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-trusted-ca\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.839785 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.839764 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-image-registry-private-configuration\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.840557 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.840540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-installation-pull-secrets\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.846297 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.846275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-bound-sa-token\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.846407 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.846328 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn22s\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-kube-api-access-bn22s\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:15.977445 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:15.977417 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p"] Sep 19 01:40:15.979999 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:15.979977 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d13f650_fdc9_44f8_92d6_d0ed0019e5a1.slice/crio-1501f4e9958628a39a597dd032fb0869b0b3cc14f45933af8e5c3a01814b46a2 WatchSource:0}: Error finding container 1501f4e9958628a39a597dd032fb0869b0b3cc14f45933af8e5c3a01814b46a2: Status 404 returned error can't find the container with id 1501f4e9958628a39a597dd032fb0869b0b3cc14f45933af8e5c3a01814b46a2 Sep 19 01:40:16.086095 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:16.086065 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-lc5nh"] Sep 19 01:40:16.089473 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:16.089451 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6411a5_1953_4b5a_a44b_03eeb4d833bd.slice/crio-c008d7191cbf12b489e71f803ae5c0fda13c23692ac81dcfccd5ab9b4ba4d950 WatchSource:0}: Error finding container c008d7191cbf12b489e71f803ae5c0fda13c23692ac81dcfccd5ab9b4ba4d950: Status 404 returned error can't find the container with id c008d7191cbf12b489e71f803ae5c0fda13c23692ac81dcfccd5ab9b4ba4d950 Sep 19 01:40:16.341619 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:16.341519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:16.341619 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:16.341589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:16.341800 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:16.341693 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 19 01:40:16.341800 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:16.341760 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert podName:002d92fd-541e-4481-bcb9-a6fd0c9602f2 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:17.341745772 +0000 UTC m=+65.407649494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5jxjz" (UID: "002d92fd-541e-4481-bcb9-a6fd0c9602f2") : secret "networking-console-plugin-cert" not found Sep 19 01:40:16.341800 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:16.341696 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:40:16.341897 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:16.341809 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9b5668c-5nh6p: secret "image-registry-tls" not found Sep 19 01:40:16.341897 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:16.341852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls podName:abd9e256-2e8c-4230-a105-d29fe90bf5f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:17.341838497 +0000 UTC m=+65.407742233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls") pod "image-registry-77b9b5668c-5nh6p" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3") : secret "image-registry-tls" not found Sep 19 01:40:16.789125 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:16.789082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" event={"ID":"ae6411a5-1953-4b5a-a44b-03eeb4d833bd","Type":"ContainerStarted","Data":"c008d7191cbf12b489e71f803ae5c0fda13c23692ac81dcfccd5ab9b4ba4d950"} Sep 19 01:40:16.790553 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:16.790525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" event={"ID":"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1","Type":"ContainerStarted","Data":"1501f4e9958628a39a597dd032fb0869b0b3cc14f45933af8e5c3a01814b46a2"} Sep 19 01:40:17.350338 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:17.350304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:17.350545 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:17.350369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:17.350545 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:17.350461 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 19 01:40:17.350545 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:17.350477 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:40:17.350545 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:17.350488 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9b5668c-5nh6p: secret "image-registry-tls" not found Sep 19 01:40:17.350545 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:17.350530 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert podName:002d92fd-541e-4481-bcb9-a6fd0c9602f2 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:19.350509015 +0000 UTC m=+67.416412737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5jxjz" (UID: "002d92fd-541e-4481-bcb9-a6fd0c9602f2") : secret "networking-console-plugin-cert" not found Sep 19 01:40:17.350545 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:17.350545 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls podName:abd9e256-2e8c-4230-a105-d29fe90bf5f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:19.350539006 +0000 UTC m=+67.416442728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls") pod "image-registry-77b9b5668c-5nh6p" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3") : secret "image-registry-tls" not found Sep 19 01:40:18.158291 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.158246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:40:18.158291 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.158294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:40:18.158818 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.158372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:40:18.161262 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.161087 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 01:40:18.161262 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.161196 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 01:40:18.161262 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.161243 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 01:40:18.169367 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:18.169262 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 19 01:40:18.169492 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:18.169478 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs podName:1809e877-6cf8-43d4-9046-3ef68073edd6 nodeName:}" failed. No retries permitted until 2026-09-19 01:41:22.169324333 +0000 UTC m=+130.235228057 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs") pod "network-metrics-daemon-mthbh" (UID: "1809e877-6cf8-43d4-9046-3ef68073edd6") : secret "metrics-daemon-secret" not found Sep 19 01:40:18.171499 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.171476 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 01:40:18.171932 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.171913 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57d45a8d-f26e-46fe-b4ae-9885e8c21d37-original-pull-secret\") pod \"global-pull-secret-syncer-z84pz\" (UID: \"57d45a8d-f26e-46fe-b4ae-9885e8c21d37\") " pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:40:18.182832 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.182808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm2tl\" (UniqueName: \"kubernetes.io/projected/1a08e37a-88d9-451e-a505-ee8c069d50c9-kube-api-access-jm2tl\") pod \"network-check-target-2n54s\" (UID: \"1a08e37a-88d9-451e-a505-ee8c069d50c9\") " pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:40:18.279073 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.279037 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z84pz" Sep 19 01:40:18.381612 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.381582 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-td9x9\"" Sep 19 01:40:18.389559 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.389531 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:40:18.661506 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:18.661466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:40:18.661697 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:18.661627 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 01:40:18.661766 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:18.661705 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls podName:43575c24-a13f-496e-9439-5aecfa3a477e nodeName:}" failed. No retries permitted until 2026-09-19 01:40:50.661684208 +0000 UTC m=+98.727587952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls") pod "dns-default-zjk5z" (UID: "43575c24-a13f-496e-9439-5aecfa3a477e") : secret "dns-default-metrics-tls" not found Sep 19 01:40:19.195796 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.195637 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2n54s"] Sep 19 01:40:19.201177 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.201153 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z84pz"] Sep 19 01:40:19.206396 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:19.206361 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d45a8d_f26e_46fe_b4ae_9885e8c21d37.slice/crio-b9d825d363b01dc5b73e62431aa57f1b59d37abac147634c180db0fda5589dd6 WatchSource:0}: Error finding container b9d825d363b01dc5b73e62431aa57f1b59d37abac147634c180db0fda5589dd6: Status 404 returned error can't find the container with id b9d825d363b01dc5b73e62431aa57f1b59d37abac147634c180db0fda5589dd6 Sep 19 01:40:19.206624 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:19.206609 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a08e37a_88d9_451e_a505_ee8c069d50c9.slice/crio-7b952baf8d7a0be3f492879969c21de753b9e25f22bacd1c26240c77d86efd5f WatchSource:0}: Error finding container 7b952baf8d7a0be3f492879969c21de753b9e25f22bacd1c26240c77d86efd5f: Status 404 returned error can't find the container with id 7b952baf8d7a0be3f492879969c21de753b9e25f22bacd1c26240c77d86efd5f Sep 19 01:40:19.368164 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.368134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:19.368308 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.368201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:19.368308 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:19.368273 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:40:19.368308 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:19.368290 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9b5668c-5nh6p: secret "image-registry-tls" not found Sep 19 01:40:19.368431 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:19.368294 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 19 01:40:19.368431 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:19.368375 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls podName:abd9e256-2e8c-4230-a105-d29fe90bf5f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:23.368338919 +0000 UTC m=+71.434242640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls") pod "image-registry-77b9b5668c-5nh6p" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3") : secret "image-registry-tls" not found Sep 19 01:40:19.368431 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:19.368402 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert podName:002d92fd-541e-4481-bcb9-a6fd0c9602f2 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:23.368391778 +0000 UTC m=+71.434295500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5jxjz" (UID: "002d92fd-541e-4481-bcb9-a6fd0c9602f2") : secret "networking-console-plugin-cert" not found Sep 19 01:40:19.802096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.802051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" event={"ID":"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1","Type":"ContainerStarted","Data":"2ee3b18e3add15ba215c99b7a58e77587a5d8d5ccd3831a02b78dde6f3270328"} Sep 19 01:40:19.805140 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.805109 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/0.log" Sep 19 01:40:19.805261 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.805150 2564 generic.go:356] "Generic (PLEG): container finished" podID="ae6411a5-1953-4b5a-a44b-03eeb4d833bd" containerID="6b9fc20633cc64acb716beb92dc95779b484639b6f0a4fdeadcd0e1d40765580" exitCode=255 Sep 19 01:40:19.805489 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.805359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" event={"ID":"ae6411a5-1953-4b5a-a44b-03eeb4d833bd","Type":"ContainerDied","Data":"6b9fc20633cc64acb716beb92dc95779b484639b6f0a4fdeadcd0e1d40765580"} Sep 19 01:40:19.805594 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.805532 2564 scope.go:117] "RemoveContainer" containerID="6b9fc20633cc64acb716beb92dc95779b484639b6f0a4fdeadcd0e1d40765580" Sep 19 01:40:19.808758 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.808735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2n54s" event={"ID":"1a08e37a-88d9-451e-a505-ee8c069d50c9","Type":"ContainerStarted","Data":"7b952baf8d7a0be3f492879969c21de753b9e25f22bacd1c26240c77d86efd5f"} Sep 19 01:40:19.814105 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.814080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z84pz" event={"ID":"57d45a8d-f26e-46fe-b4ae-9885e8c21d37","Type":"ContainerStarted","Data":"b9d825d363b01dc5b73e62431aa57f1b59d37abac147634c180db0fda5589dd6"} Sep 19 01:40:19.818785 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:19.818740 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" podStartSLOduration=1.86664481 podStartE2EDuration="4.818727249s" totalImagesPullingTime="2.952082439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:19.818197827 +0000 UTC m=+67.884101585" watchObservedRunningTime="2026-09-19 01:40:19.818727249 +0000 UTC m=+67.884631003" Sep 19 01:40:20.819572 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.819542 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:40:20.820053 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.820035 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/0.log" Sep 19 01:40:20.820116 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.820087 2564 generic.go:356] "Generic (PLEG): container finished" podID="ae6411a5-1953-4b5a-a44b-03eeb4d833bd" containerID="e9d752f1b82a6d6493555c7818070e87c953e155e350a371afb0a88bc9d10d35" exitCode=255 Sep 19 01:40:20.820668 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.820641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" event={"ID":"ae6411a5-1953-4b5a-a44b-03eeb4d833bd","Type":"ContainerDied","Data":"e9d752f1b82a6d6493555c7818070e87c953e155e350a371afb0a88bc9d10d35"} Sep 19 01:40:20.820790 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.820708 2564 scope.go:117] "RemoveContainer" containerID="6b9fc20633cc64acb716beb92dc95779b484639b6f0a4fdeadcd0e1d40765580" Sep 19 01:40:20.820852 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.820842 2564 scope.go:117] "RemoveContainer" containerID="e9d752f1b82a6d6493555c7818070e87c953e155e350a371afb0a88bc9d10d35" Sep 19 01:40:20.821016 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:20.820994 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-lc5nh_openshift-console-operator(ae6411a5-1953-4b5a-a44b-03eeb4d833bd)\"" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" podUID="ae6411a5-1953-4b5a-a44b-03eeb4d833bd" Sep 19 01:40:20.945364 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.945320 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6dc"] Sep 19 01:40:20.949610 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.949594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:20.952016 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.951849 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vg5n6\"" Sep 19 01:40:20.952016 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.951861 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 19 01:40:20.952016 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.951935 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 19 01:40:20.952016 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.951925 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 19 01:40:20.952281 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.952170 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 19 01:40:20.959306 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.959242 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6dc"] Sep 19 01:40:20.981365 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.981319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:20.981497 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.981395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31fc2811-c700-4742-a015-8c6ca2d7c53d-data-volume\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:20.981497 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.981431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:20.981497 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.981478 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31fc2811-c700-4742-a015-8c6ca2d7c53d-crio-socket\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:20.981671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:20.981501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd6qs\" (UniqueName: \"kubernetes.io/projected/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-api-access-kd6qs\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.082063 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.081982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31fc2811-c700-4742-a015-8c6ca2d7c53d-crio-socket\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.082063 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.082017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd6qs\" (UniqueName: \"kubernetes.io/projected/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-api-access-kd6qs\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.082251 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.082097 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.082251 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.082111 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31fc2811-c700-4742-a015-8c6ca2d7c53d-crio-socket\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.082251 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.082141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31fc2811-c700-4742-a015-8c6ca2d7c53d-data-volume\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.082251 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.082168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.082413 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.082252 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.082413 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.082272 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:21.082413 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.082313 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:21.582296916 +0000 UTC m=+69.648200639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.082413 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.082392 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:21.582370312 +0000 UTC m=+69.648274041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : configmap "kube-rbac-proxy" not found Sep 19 01:40:21.082671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.082511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31fc2811-c700-4742-a015-8c6ca2d7c53d-data-volume\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.094776 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.094720 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd6qs\" (UniqueName: \"kubernetes.io/projected/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-api-access-kd6qs\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.586721 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.586688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.586917 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.586758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:21.586984 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.586923 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.587034 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.586989 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:22.586969147 +0000 UTC m=+70.652872882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:21.587205 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.587179 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:21.587340 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.587243 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:22.587228204 +0000 UTC m=+70.653131927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : configmap "kube-rbac-proxy" not found Sep 19 01:40:21.826764 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.826666 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:40:21.827215 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:21.827070 2564 scope.go:117] "RemoveContainer" containerID="e9d752f1b82a6d6493555c7818070e87c953e155e350a371afb0a88bc9d10d35" Sep 19 01:40:21.827305 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:21.827266 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-lc5nh_openshift-console-operator(ae6411a5-1953-4b5a-a44b-03eeb4d833bd)\"" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" podUID="ae6411a5-1953-4b5a-a44b-03eeb4d833bd" Sep 19 01:40:22.595828 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:22.595789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:22.596027 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:22.595852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:22.596027 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:22.595923 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:22.596027 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:22.595937 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:22.596027 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:22.595988 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:24.595970196 +0000 UTC m=+72.661873918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : configmap "kube-rbac-proxy" not found Sep 19 01:40:22.596027 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:22.596020 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:24.596010251 +0000 UTC m=+72.661913980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:23.402720 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:23.402679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:23.403160 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:23.402772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:23.403160 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:23.402836 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 19 01:40:23.403160 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:23.402862 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 19 01:40:23.403160 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:23.402873 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9b5668c-5nh6p: secret "image-registry-tls" not found Sep 19 01:40:23.403160 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:23.402907 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert podName:002d92fd-541e-4481-bcb9-a6fd0c9602f2 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:31.402889578 +0000 UTC m=+79.468793315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5jxjz" (UID: "002d92fd-541e-4481-bcb9-a6fd0c9602f2") : secret "networking-console-plugin-cert" not found Sep 19 01:40:23.403160 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:23.402923 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls podName:abd9e256-2e8c-4230-a105-d29fe90bf5f3 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:31.402916021 +0000 UTC m=+79.468819743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls") pod "image-registry-77b9b5668c-5nh6p" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3") : secret "image-registry-tls" not found Sep 19 01:40:23.502656 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:23.502628 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgzwk_3aaf6e24-c0ae-4d9a-adc5-95a03d983395/dns-node-resolver/0.log" Sep 19 01:40:23.835095 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:23.835064 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2n54s" event={"ID":"1a08e37a-88d9-451e-a505-ee8c069d50c9","Type":"ContainerStarted","Data":"184f23037ab99d50a1e5ee91d4f838592750f611e506e608af4a57f8f73defc8"} Sep 19 01:40:23.835287 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:23.835169 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:40:23.836755 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:23.836723 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z84pz" event={"ID":"57d45a8d-f26e-46fe-b4ae-9885e8c21d37","Type":"ContainerStarted","Data":"48086ed22371e26997c0ec87680f28826435e88416a64bb4701f97569ef57cb5"} Sep 19 01:40:23.852887 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:23.852842 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2n54s" podStartSLOduration=67.444619147 podStartE2EDuration="1m11.852825885s" totalImagesPullingTime="4.408206738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:23.851228312 +0000 UTC m=+71.917132056" watchObservedRunningTime="2026-09-19 01:40:23.852825885 +0000 UTC m=+71.918729628" Sep 19 01:40:23.871143 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:23.871096 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z84pz" podStartSLOduration=67.459283372 podStartE2EDuration="1m11.871081017s" totalImagesPullingTime="4.411797645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:23.870586836 +0000 UTC m=+71.936490581" watchObservedRunningTime="2026-09-19 01:40:23.871081017 +0000 UTC m=+71.936984766" Sep 19 01:40:24.612774 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:24.612723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:24.613159 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:24.612788 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:24.613159 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:24.612864 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:24.613159 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:24.612895 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:24.613159 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:24.612934 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.612918927 +0000 UTC m=+76.678822667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : configmap "kube-rbac-proxy" not found Sep 19 01:40:24.613159 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:24.612951 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:28.612945127 +0000 UTC m=+76.678848848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:24.699187 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:24.699157 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mvttq_f652b19d-2016-40dd-8f08-0a7d6e4d1e62/node-ca/0.log" Sep 19 01:40:25.503225 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:25.503173 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n84hj_27d15022-5125-4ec5-a331-94a8885c003a/serve-healthcheck-canary/0.log" Sep 19 01:40:25.816934 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:25.816858 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:25.816934 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:25.816933 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:25.817308 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:25.817241 2564 scope.go:117] "RemoveContainer" containerID="e9d752f1b82a6d6493555c7818070e87c953e155e350a371afb0a88bc9d10d35" Sep 19 01:40:25.817426 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:25.817408 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-lc5nh_openshift-console-operator(ae6411a5-1953-4b5a-a44b-03eeb4d833bd)\"" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" podUID="ae6411a5-1953-4b5a-a44b-03eeb4d833bd" Sep 19 01:40:26.305801 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:26.305770 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-hkv2p_0d13f650-fdc9-44f8-92d6-d0ed0019e5a1/kube-storage-version-migrator-operator/0.log" Sep 19 01:40:28.643879 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:28.643843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:28.644338 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:28.643895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:28.644338 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:28.643985 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 01:40:28.644338 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:28.643999 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:28.644338 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:28.644064 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:36.644049054 +0000 UTC m=+84.709952780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:28.644338 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:28.644077 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:36.644071532 +0000 UTC m=+84.709975254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : configmap "kube-rbac-proxy" not found Sep 19 01:40:31.463535 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:31.463490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:31.463985 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:31.463588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:31.463985 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:31.463662 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 19 01:40:31.463985 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:31.463728 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert podName:002d92fd-541e-4481-bcb9-a6fd0c9602f2 nodeName:}" failed. No retries permitted until 2026-09-19 01:40:47.463711082 +0000 UTC m=+95.529614821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5jxjz" (UID: "002d92fd-541e-4481-bcb9-a6fd0c9602f2") : secret "networking-console-plugin-cert" not found Sep 19 01:40:31.466158 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:31.466134 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"image-registry-77b9b5668c-5nh6p\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:31.522731 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:31.522697 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:31.799292 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:31.799256 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b9b5668c-5nh6p"] Sep 19 01:40:31.803415 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:31.803381 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd9e256_2e8c_4230_a105_d29fe90bf5f3.slice/crio-f01b2407f0e71d1e9351cc79406bb89182ca5291629366c1cfc5b9e983f4bdd6 WatchSource:0}: Error finding container f01b2407f0e71d1e9351cc79406bb89182ca5291629366c1cfc5b9e983f4bdd6: Status 404 returned error can't find the container with id f01b2407f0e71d1e9351cc79406bb89182ca5291629366c1cfc5b9e983f4bdd6 Sep 19 01:40:31.862430 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:31.862400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" event={"ID":"abd9e256-2e8c-4230-a105-d29fe90bf5f3","Type":"ContainerStarted","Data":"f01b2407f0e71d1e9351cc79406bb89182ca5291629366c1cfc5b9e983f4bdd6"} Sep 19 01:40:32.866613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:32.866574 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" event={"ID":"abd9e256-2e8c-4230-a105-d29fe90bf5f3","Type":"ContainerStarted","Data":"c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751"} Sep 19 01:40:32.867019 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:32.866697 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:40:32.891722 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:32.891636 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" podStartSLOduration=17.891615761 podStartE2EDuration="17.891615761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:32.891300009 +0000 UTC m=+80.957203752" watchObservedRunningTime="2026-09-19 01:40:32.891615761 +0000 UTC m=+80.957519504" Sep 19 01:40:36.703569 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:36.703427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:36.703569 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:36.703493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:36.704012 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:36.703620 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 01:40:36.704012 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:40:36.703671 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls podName:31fc2811-c700-4742-a015-8c6ca2d7c53d nodeName:}" failed. No retries permitted until 2026-09-19 01:40:52.703658889 +0000 UTC m=+100.769562611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6dc" (UID: "31fc2811-c700-4742-a015-8c6ca2d7c53d") : secret "insights-runtime-extractor-tls" not found Sep 19 01:40:36.704012 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:36.703984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31fc2811-c700-4742-a015-8c6ca2d7c53d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:38.368249 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:38.368217 2564 scope.go:117] "RemoveContainer" containerID="e9d752f1b82a6d6493555c7818070e87c953e155e350a371afb0a88bc9d10d35" Sep 19 01:40:38.888477 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:38.888449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:40:38.888655 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:38.888536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" event={"ID":"ae6411a5-1953-4b5a-a44b-03eeb4d833bd","Type":"ContainerStarted","Data":"0299c5bfc701b8921758695e8a0ab125edcf4b5a22efe5e83f96d3fbb49f417e"} Sep 19 01:40:38.888845 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:38.888823 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:38.904976 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:38.904931 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" podStartSLOduration=21.063655131 podStartE2EDuration="23.904917975s" totalImagesPullingTime="2.841262844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:38.904185816 +0000 UTC m=+86.970089562" watchObservedRunningTime="2026-09-19 01:40:38.904917975 +0000 UTC m=+86.970821719" Sep 19 01:40:39.495964 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:39.495930 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-lc5nh" Sep 19 01:40:47.486639 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:47.486605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:47.489157 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:47.489133 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/002d92fd-541e-4481-bcb9-a6fd0c9602f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5jxjz\" (UID: \"002d92fd-541e-4481-bcb9-a6fd0c9602f2\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:47.715471 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:47.715431 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" Sep 19 01:40:47.984632 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:47.984601 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz"] Sep 19 01:40:47.987874 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:47.987842 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002d92fd_541e_4481_bcb9_a6fd0c9602f2.slice/crio-08da15d73e5bf30004bcd3c3f7b9be6e466ceda0e7ae5765cf7939c83d9b3d1a WatchSource:0}: Error finding container 08da15d73e5bf30004bcd3c3f7b9be6e466ceda0e7ae5765cf7939c83d9b3d1a: Status 404 returned error can't find the container with id 08da15d73e5bf30004bcd3c3f7b9be6e466ceda0e7ae5765cf7939c83d9b3d1a Sep 19 01:40:48.921047 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:48.921005 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" event={"ID":"002d92fd-541e-4481-bcb9-a6fd0c9602f2","Type":"ContainerStarted","Data":"08da15d73e5bf30004bcd3c3f7b9be6e466ceda0e7ae5765cf7939c83d9b3d1a"} Sep 19 01:40:49.926108 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:49.926076 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" event={"ID":"002d92fd-541e-4481-bcb9-a6fd0c9602f2","Type":"ContainerStarted","Data":"cc6fe75f9d95505eb0cf73ba1be29cb53ec0b627a3ee98b36a046cb9457fc7bf"} Sep 19 01:40:49.945848 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:49.945799 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5jxjz" podStartSLOduration=33.606199421 podStartE2EDuration="34.945784685s" totalImagesPullingTime="1.339585264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:49.94541907 +0000 UTC m=+98.011322814" watchObservedRunningTime="2026-09-19 01:40:49.945784685 +0000 UTC m=+98.011688428" Sep 19 01:40:50.712509 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:50.712474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:40:50.714881 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:50.714854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43575c24-a13f-496e-9439-5aecfa3a477e-metrics-tls\") pod \"dns-default-zjk5z\" (UID: \"43575c24-a13f-496e-9439-5aecfa3a477e\") " pod="openshift-dns/dns-default-zjk5z" Sep 19 01:40:50.731922 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:50.731899 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttj8c\"" Sep 19 01:40:50.740950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:50.740929 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zjk5z" Sep 19 01:40:51.016895 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.016872 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zjk5z"] Sep 19 01:40:51.018709 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:51.018677 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43575c24_a13f_496e_9439_5aecfa3a477e.slice/crio-211fcee0ac56cba55592dc3aeafe200a36e5ed251bad00faec861755639796fd WatchSource:0}: Error finding container 211fcee0ac56cba55592dc3aeafe200a36e5ed251bad00faec861755639796fd: Status 404 returned error can't find the container with id 211fcee0ac56cba55592dc3aeafe200a36e5ed251bad00faec861755639796fd Sep 19 01:40:51.238433 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.238247 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54"] Sep 19 01:40:51.270355 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.270264 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b9b5668c-5nh6p"] Sep 19 01:40:51.270355 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.270321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54"] Sep 19 01:40:51.270546 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.270409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" Sep 19 01:40:51.274511 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.274483 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xl6m9\"" Sep 19 01:40:51.275123 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.275097 2564 patch_prober.go:28] interesting pod/image-registry-77b9b5668c-5nh6p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 19 01:40:51.275238 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.275145 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" podUID="abd9e256-2e8c-4230-a105-d29fe90bf5f3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 19 01:40:51.285623 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.285600 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 19 01:40:51.285797 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.285637 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 19 01:40:51.285797 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.285786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 19 01:40:51.286000 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.285786 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 19 01:40:51.317493 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.317464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f94de64f-5fad-4257-95a5-871ece39d342-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-785dcc697d-44p54\" (UID: \"f94de64f-5fad-4257-95a5-871ece39d342\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" Sep 19 01:40:51.317634 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.317549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9snz\" (UniqueName: \"kubernetes.io/projected/f94de64f-5fad-4257-95a5-871ece39d342-kube-api-access-d9snz\") pod \"managed-serviceaccount-addon-agent-785dcc697d-44p54\" (UID: \"f94de64f-5fad-4257-95a5-871ece39d342\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" Sep 19 01:40:51.347959 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.347924 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f"] Sep 19 01:40:51.374413 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.374384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" Sep 19 01:40:51.375210 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.375186 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f"] Sep 19 01:40:51.379981 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.379960 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7wcnq\"" Sep 19 01:40:51.380163 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.380147 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 19 01:40:51.418313 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.418287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f94de64f-5fad-4257-95a5-871ece39d342-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-785dcc697d-44p54\" (UID: \"f94de64f-5fad-4257-95a5-871ece39d342\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" Sep 19 01:40:51.418503 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.418380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49d65ae9-7f46-4e14-98a2-c0498f92df83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-zj66f\" (UID: \"49d65ae9-7f46-4e14-98a2-c0498f92df83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" Sep 19 01:40:51.418578 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.418513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9snz\" (UniqueName: \"kubernetes.io/projected/f94de64f-5fad-4257-95a5-871ece39d342-kube-api-access-d9snz\") pod \"managed-serviceaccount-addon-agent-785dcc697d-44p54\" (UID: \"f94de64f-5fad-4257-95a5-871ece39d342\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" Sep 19 01:40:51.420905 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.420877 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f94de64f-5fad-4257-95a5-871ece39d342-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-785dcc697d-44p54\" (UID: \"f94de64f-5fad-4257-95a5-871ece39d342\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" Sep 19 01:40:51.434158 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.434132 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-pp5zb"] Sep 19 01:40:51.440470 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.440449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9snz\" (UniqueName: \"kubernetes.io/projected/f94de64f-5fad-4257-95a5-871ece39d342-kube-api-access-d9snz\") pod \"managed-serviceaccount-addon-agent-785dcc697d-44p54\" (UID: \"f94de64f-5fad-4257-95a5-871ece39d342\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" Sep 19 01:40:51.456205 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.456178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-pp5zb" Sep 19 01:40:51.457488 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.457467 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-pp5zb"] Sep 19 01:40:51.460240 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.460223 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-792lz\"" Sep 19 01:40:51.461003 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.460981 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 19 01:40:51.461003 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.460992 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 19 01:40:51.518958 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.518917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49d65ae9-7f46-4e14-98a2-c0498f92df83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-zj66f\" (UID: \"49d65ae9-7f46-4e14-98a2-c0498f92df83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" Sep 19 01:40:51.519154 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.519014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dg98\" (UniqueName: \"kubernetes.io/projected/974c0136-3e54-465f-abd4-28e8044db26e-kube-api-access-7dg98\") pod \"downloads-6594f4c75-pp5zb\" (UID: \"974c0136-3e54-465f-abd4-28e8044db26e\") " pod="openshift-console/downloads-6594f4c75-pp5zb" Sep 19 01:40:51.521642 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.521580 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/49d65ae9-7f46-4e14-98a2-c0498f92df83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-zj66f\" (UID: \"49d65ae9-7f46-4e14-98a2-c0498f92df83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" Sep 19 01:40:51.591989 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.591953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" Sep 19 01:40:51.620363 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.620312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dg98\" (UniqueName: \"kubernetes.io/projected/974c0136-3e54-465f-abd4-28e8044db26e-kube-api-access-7dg98\") pod \"downloads-6594f4c75-pp5zb\" (UID: \"974c0136-3e54-465f-abd4-28e8044db26e\") " pod="openshift-console/downloads-6594f4c75-pp5zb" Sep 19 01:40:51.631484 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.631292 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dg98\" (UniqueName: \"kubernetes.io/projected/974c0136-3e54-465f-abd4-28e8044db26e-kube-api-access-7dg98\") pod \"downloads-6594f4c75-pp5zb\" (UID: \"974c0136-3e54-465f-abd4-28e8044db26e\") " pod="openshift-console/downloads-6594f4c75-pp5zb" Sep 19 01:40:51.683515 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.683471 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" Sep 19 01:40:51.767301 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.767273 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-pp5zb" Sep 19 01:40:51.899578 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.899542 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54"] Sep 19 01:40:51.902619 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:51.902588 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf94de64f_5fad_4257_95a5_871ece39d342.slice/crio-66ec61a9de3239422907b62625a74338c793acbb79a13e82d727e5ad9ab05c62 WatchSource:0}: Error finding container 66ec61a9de3239422907b62625a74338c793acbb79a13e82d727e5ad9ab05c62: Status 404 returned error can't find the container with id 66ec61a9de3239422907b62625a74338c793acbb79a13e82d727e5ad9ab05c62 Sep 19 01:40:51.934771 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.934731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" event={"ID":"f94de64f-5fad-4257-95a5-871ece39d342","Type":"ContainerStarted","Data":"66ec61a9de3239422907b62625a74338c793acbb79a13e82d727e5ad9ab05c62"} Sep 19 01:40:51.936084 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.936054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zjk5z" event={"ID":"43575c24-a13f-496e-9439-5aecfa3a477e","Type":"ContainerStarted","Data":"211fcee0ac56cba55592dc3aeafe200a36e5ed251bad00faec861755639796fd"} Sep 19 01:40:51.988395 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:51.988230 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f"] Sep 19 01:40:51.990737 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:51.990710 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d65ae9_7f46_4e14_98a2_c0498f92df83.slice/crio-3467edcce50929f201d08773572734b9b4789d2d45133fad14590b94dd25dc42 WatchSource:0}: Error finding container 3467edcce50929f201d08773572734b9b4789d2d45133fad14590b94dd25dc42: Status 404 returned error can't find the container with id 3467edcce50929f201d08773572734b9b4789d2d45133fad14590b94dd25dc42 Sep 19 01:40:52.078537 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.078456 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-pp5zb"] Sep 19 01:40:52.082339 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:52.082310 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974c0136_3e54_465f_abd4_28e8044db26e.slice/crio-4fe795450f1d6ae742cb9947c67f78b08e74e0570c4b13dbc8be95133064348b WatchSource:0}: Error finding container 4fe795450f1d6ae742cb9947c67f78b08e74e0570c4b13dbc8be95133064348b: Status 404 returned error can't find the container with id 4fe795450f1d6ae742cb9947c67f78b08e74e0570c4b13dbc8be95133064348b Sep 19 01:40:52.728920 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.728887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:52.732806 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.732773 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31fc2811-c700-4742-a015-8c6ca2d7c53d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6dc\" (UID: \"31fc2811-c700-4742-a015-8c6ca2d7c53d\") " pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:52.762021 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.761984 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj6dc" Sep 19 01:40:52.825400 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.825363 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-658f7b78b5-zrdv2"] Sep 19 01:40:52.837967 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.837943 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:52.839077 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.839051 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-658f7b78b5-zrdv2"] Sep 19 01:40:52.840984 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.840951 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 19 01:40:52.841102 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.841036 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 19 01:40:52.842119 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.842033 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 19 01:40:52.842119 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.842076 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jm6bh\"" Sep 19 01:40:52.842312 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.842033 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 19 01:40:52.842312 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.842233 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 19 01:40:52.930863 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.930836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d86q5\" (UniqueName: \"kubernetes.io/projected/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-kube-api-access-d86q5\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:52.930991 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.930883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-oauth-serving-cert\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:52.930991 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.930937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-config\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:52.930991 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.930986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-serving-cert\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:52.931096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.931037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-service-ca\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:52.931096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.931078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-oauth-config\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:52.940926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.940892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-pp5zb" event={"ID":"974c0136-3e54-465f-abd4-28e8044db26e","Type":"ContainerStarted","Data":"4fe795450f1d6ae742cb9947c67f78b08e74e0570c4b13dbc8be95133064348b"} Sep 19 01:40:52.942096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:52.942069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" event={"ID":"49d65ae9-7f46-4e14-98a2-c0498f92df83","Type":"ContainerStarted","Data":"3467edcce50929f201d08773572734b9b4789d2d45133fad14590b94dd25dc42"} Sep 19 01:40:53.031610 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.031537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-oauth-config\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.031610 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.031585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d86q5\" (UniqueName: \"kubernetes.io/projected/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-kube-api-access-d86q5\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.031610 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.031609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-oauth-serving-cert\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.031856 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.031627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-config\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.031856 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.031673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-serving-cert\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.031856 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.031707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-service-ca\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.032496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.032394 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-config\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.032496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.032403 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-service-ca\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.032496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.032414 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-oauth-serving-cert\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.034304 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.034275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-oauth-config\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.034432 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.034286 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-serving-cert\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.041131 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.041111 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d86q5\" (UniqueName: \"kubernetes.io/projected/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-kube-api-access-d86q5\") pod \"console-658f7b78b5-zrdv2\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.128899 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.128846 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6dc"] Sep 19 01:40:53.147914 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.147887 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:40:53.201057 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:53.201025 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fc2811_c700_4742_a015_8c6ca2d7c53d.slice/crio-da246300cff838f19ef6902fe9ef82acd21cf21e158aacf351cffc50c22395a1 WatchSource:0}: Error finding container da246300cff838f19ef6902fe9ef82acd21cf21e158aacf351cffc50c22395a1: Status 404 returned error can't find the container with id da246300cff838f19ef6902fe9ef82acd21cf21e158aacf351cffc50c22395a1 Sep 19 01:40:53.529458 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.529372 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-658f7b78b5-zrdv2"] Sep 19 01:40:53.537532 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:53.537497 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bc4c77_cc2b_4efd_8d5c_2e3ebcfb2b79.slice/crio-9f8b8919ae1675d021963d8a4fba5078b566a7673613333aa299874eef279bdf WatchSource:0}: Error finding container 9f8b8919ae1675d021963d8a4fba5078b566a7673613333aa299874eef279bdf: Status 404 returned error can't find the container with id 9f8b8919ae1675d021963d8a4fba5078b566a7673613333aa299874eef279bdf Sep 19 01:40:53.949080 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.948976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zjk5z" event={"ID":"43575c24-a13f-496e-9439-5aecfa3a477e","Type":"ContainerStarted","Data":"0ec1df2f695d63d334629d03aa10a56e7829d4c1843dcc419f81ba542412d1fd"} Sep 19 01:40:53.949080 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.949077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zjk5z" event={"ID":"43575c24-a13f-496e-9439-5aecfa3a477e","Type":"ContainerStarted","Data":"64ea95029355278503327d65ec4029dc0ef57e57de63c98a0d0582fa7bb27ecd"} Sep 19 01:40:53.949324 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.949259 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zjk5z" Sep 19 01:40:53.951203 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.951168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658f7b78b5-zrdv2" event={"ID":"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79","Type":"ContainerStarted","Data":"9f8b8919ae1675d021963d8a4fba5078b566a7673613333aa299874eef279bdf"} Sep 19 01:40:53.954394 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.954279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6dc" event={"ID":"31fc2811-c700-4742-a015-8c6ca2d7c53d","Type":"ContainerStarted","Data":"23f35df0096d8fed84f39654686ef901b017ccdeeaac8cea4997467dbcab041a"} Sep 19 01:40:53.954394 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.954333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6dc" event={"ID":"31fc2811-c700-4742-a015-8c6ca2d7c53d","Type":"ContainerStarted","Data":"da246300cff838f19ef6902fe9ef82acd21cf21e158aacf351cffc50c22395a1"} Sep 19 01:40:53.971056 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:53.970800 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zjk5z" podStartSLOduration=65.75240247 podStartE2EDuration="1m7.970780396s" totalImagesPullingTime="2.218377926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:53.970414325 +0000 UTC m=+102.036318071" watchObservedRunningTime="2026-09-19 01:40:53.970780396 +0000 UTC m=+102.036684144" Sep 19 01:40:54.842609 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:54.842577 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2n54s" Sep 19 01:40:54.887103 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:54.887065 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-584ddf588f-jh6dj"] Sep 19 01:40:54.948688 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:54.948626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584ddf588f-jh6dj"] Sep 19 01:40:54.948844 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:54.948742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:54.967668 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:54.967456 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 19 01:40:55.049521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.048607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-oauth-serving-cert\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.049521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.048655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-service-ca\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.049521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.048686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-trusted-ca-bundle\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.049521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.048716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-serving-cert\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.049521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.048767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-config\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.049521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.048853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-oauth-config\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.049521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.048907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48mzz\" (UniqueName: \"kubernetes.io/projected/1864d8d1-60d1-445f-8d47-9d812b5bcc11-kube-api-access-48mzz\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.150139 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.149999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-oauth-config\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.150139 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.150044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48mzz\" (UniqueName: \"kubernetes.io/projected/1864d8d1-60d1-445f-8d47-9d812b5bcc11-kube-api-access-48mzz\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.150139 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.150119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-oauth-serving-cert\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.150421 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.150146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-service-ca\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.150421 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.150174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-trusted-ca-bundle\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.150421 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.150204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-serving-cert\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.150421 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.150255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-config\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.151147 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.151078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-config\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.151552 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.151524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-service-ca\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.151654 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.151566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-oauth-serving-cert\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.152112 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.152070 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-trusted-ca-bundle\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.154023 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.153997 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-serving-cert\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.154429 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.154410 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-oauth-config\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.159885 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.159846 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48mzz\" (UniqueName: \"kubernetes.io/projected/1864d8d1-60d1-445f-8d47-9d812b5bcc11-kube-api-access-48mzz\") pod \"console-584ddf588f-jh6dj\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:55.261738 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:55.261527 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:40:56.657390 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:56.657251 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584ddf588f-jh6dj"] Sep 19 01:40:56.661252 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:40:56.661216 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1864d8d1_60d1_445f_8d47_9d812b5bcc11.slice/crio-a2f76987ebc4b3fe79942940ece5c33c8f90a835550ece4865676a7d451028df WatchSource:0}: Error finding container a2f76987ebc4b3fe79942940ece5c33c8f90a835550ece4865676a7d451028df: Status 404 returned error can't find the container with id a2f76987ebc4b3fe79942940ece5c33c8f90a835550ece4865676a7d451028df Sep 19 01:40:56.976942 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:56.975670 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584ddf588f-jh6dj" event={"ID":"1864d8d1-60d1-445f-8d47-9d812b5bcc11","Type":"ContainerStarted","Data":"a2f76987ebc4b3fe79942940ece5c33c8f90a835550ece4865676a7d451028df"} Sep 19 01:40:56.979044 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:56.979012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" event={"ID":"49d65ae9-7f46-4e14-98a2-c0498f92df83","Type":"ContainerStarted","Data":"da63e60ffc4920ec160e70626d969b4653e6f4d425377210b75f8da656115da1"} Sep 19 01:40:56.979273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:56.979237 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" Sep 19 01:40:56.982194 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:56.982164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" event={"ID":"f94de64f-5fad-4257-95a5-871ece39d342","Type":"ContainerStarted","Data":"6dd5bb082dc9c52f60a641f58a0757cd8af7bcad294d2b120640db7bda2ccb04"} Sep 19 01:40:56.985179 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:56.985154 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6dc" event={"ID":"31fc2811-c700-4742-a015-8c6ca2d7c53d","Type":"ContainerStarted","Data":"0ccdf5017e10f7c3d8dc8df59b036d1383ab79d980cd6de23a0b3c739d7c4394"} Sep 19 01:40:56.985807 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:56.985783 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" Sep 19 01:40:56.996780 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:56.996727 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-zj66f" podStartSLOduration=1.624936841 podStartE2EDuration="5.99671087s" totalImagesPullingTime="4.371774029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:56.996018307 +0000 UTC m=+105.061922053" watchObservedRunningTime="2026-09-19 01:40:56.99671087 +0000 UTC m=+105.062614610" Sep 19 01:40:57.019303 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.019242 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-785dcc697d-44p54" podStartSLOduration=1.5389772640000001 podStartE2EDuration="6.019221162s" totalImagesPullingTime="4.480243898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:57.01798255 +0000 UTC m=+105.083886295" watchObservedRunningTime="2026-09-19 01:40:57.019221162 +0000 UTC m=+105.085124907" Sep 19 01:40:57.350513 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.350438 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl"] Sep 19 01:40:57.353875 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.353847 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.356533 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.356324 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 19 01:40:57.357282 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.357260 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 19 01:40:57.357550 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.357485 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 19 01:40:57.357550 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.357524 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-52v9d\"" Sep 19 01:40:57.357550 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.357540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 19 01:40:57.357715 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.357489 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 19 01:40:57.363730 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.363652 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl"] Sep 19 01:40:57.474647 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.474614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmq6\" (UniqueName: \"kubernetes.io/projected/65cc017c-c238-447e-83d2-91c6d0e7d202-kube-api-access-jrmq6\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.474842 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.474663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65cc017c-c238-447e-83d2-91c6d0e7d202-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.474842 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.474708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65cc017c-c238-447e-83d2-91c6d0e7d202-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.474842 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.474768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65cc017c-c238-447e-83d2-91c6d0e7d202-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.576149 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.576111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmq6\" (UniqueName: \"kubernetes.io/projected/65cc017c-c238-447e-83d2-91c6d0e7d202-kube-api-access-jrmq6\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.576332 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.576164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65cc017c-c238-447e-83d2-91c6d0e7d202-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.576332 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.576218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65cc017c-c238-447e-83d2-91c6d0e7d202-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.576332 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.576251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65cc017c-c238-447e-83d2-91c6d0e7d202-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.577138 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.576961 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65cc017c-c238-447e-83d2-91c6d0e7d202-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.579119 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.579094 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65cc017c-c238-447e-83d2-91c6d0e7d202-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.579211 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.579120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65cc017c-c238-447e-83d2-91c6d0e7d202-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.585541 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.585520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmq6\" (UniqueName: \"kubernetes.io/projected/65cc017c-c238-447e-83d2-91c6d0e7d202-kube-api-access-jrmq6\") pod \"prometheus-operator-7bd5d56d6-t64cl\" (UID: \"65cc017c-c238-447e-83d2-91c6d0e7d202\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:40:57.667329 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:40:57.667239 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" Sep 19 01:41:00.355716 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:00.355583 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl"] Sep 19 01:41:00.570665 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:41:00.570617 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65cc017c_c238_447e_83d2_91c6d0e7d202.slice/crio-709bede167e8b21aa367e02dbcccb796804cfc29ffa6aee6ee254f89b8925128 WatchSource:0}: Error finding container 709bede167e8b21aa367e02dbcccb796804cfc29ffa6aee6ee254f89b8925128: Status 404 returned error can't find the container with id 709bede167e8b21aa367e02dbcccb796804cfc29ffa6aee6ee254f89b8925128 Sep 19 01:41:01.003898 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.003864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" event={"ID":"65cc017c-c238-447e-83d2-91c6d0e7d202","Type":"ContainerStarted","Data":"709bede167e8b21aa367e02dbcccb796804cfc29ffa6aee6ee254f89b8925128"} Sep 19 01:41:01.005726 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.005698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658f7b78b5-zrdv2" event={"ID":"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79","Type":"ContainerStarted","Data":"f15b716f762a80ae3662c707be9a3c023dfa161d6e9ebf23882b58e77ced204a"} Sep 19 01:41:01.008598 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.008074 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6dc" event={"ID":"31fc2811-c700-4742-a015-8c6ca2d7c53d","Type":"ContainerStarted","Data":"6c4edb500f848ce9b56cb33bcfccc7911f3d62a4338c240066289da8bf0c5170"} Sep 19 01:41:01.009875 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.009840 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584ddf588f-jh6dj" event={"ID":"1864d8d1-60d1-445f-8d47-9d812b5bcc11","Type":"ContainerStarted","Data":"40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63"} Sep 19 01:41:01.027470 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.027426 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-658f7b78b5-zrdv2" podStartSLOduration=1.980470959 podStartE2EDuration="9.027406637s" totalImagesPullingTime="7.046935678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:01.025382522 +0000 UTC m=+109.091286268" watchObservedRunningTime="2026-09-19 01:41:01.027406637 +0000 UTC m=+109.093310381" Sep 19 01:41:01.052063 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.052004 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nj6dc" podStartSLOduration=33.909316132 podStartE2EDuration="41.051989228s" totalImagesPullingTime="7.142673096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:40:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:01.050673727 +0000 UTC m=+109.116577470" watchObservedRunningTime="2026-09-19 01:41:01.051989228 +0000 UTC m=+109.117892971" Sep 19 01:41:01.075701 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.075644 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-584ddf588f-jh6dj" podStartSLOduration=3.092268523 podStartE2EDuration="7.075630265s" totalImagesPullingTime="3.983361742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:01.074317399 +0000 UTC m=+109.140221144" watchObservedRunningTime="2026-09-19 01:41:01.075630265 +0000 UTC m=+109.141534000" Sep 19 01:41:01.276129 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.276044 2564 patch_prober.go:28] interesting pod/image-registry-77b9b5668c-5nh6p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 19 01:41:01.276129 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:01.276116 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" podUID="abd9e256-2e8c-4230-a105-d29fe90bf5f3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 19 01:41:03.020786 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:03.020748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" event={"ID":"65cc017c-c238-447e-83d2-91c6d0e7d202","Type":"ContainerStarted","Data":"b547dcf8976673ebc9b934253004c93fa5a442a84e6cffa45b124c1cba2e2040"} Sep 19 01:41:03.021365 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:03.020826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" event={"ID":"65cc017c-c238-447e-83d2-91c6d0e7d202","Type":"ContainerStarted","Data":"447c210b52de3611d756786d843f1cc8832763e0f71581a0cd4d3b3199498aae"} Sep 19 01:41:03.039297 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:03.039250 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-t64cl" podStartSLOduration=4.309212653 podStartE2EDuration="6.039234003s" totalImagesPullingTime="1.73002135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:03.038096994 +0000 UTC m=+111.104000750" watchObservedRunningTime="2026-09-19 01:41:03.039234003 +0000 UTC m=+111.105137746" Sep 19 01:41:03.148268 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:03.148223 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:41:03.148464 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:03.148305 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:41:03.153676 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:03.153653 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:41:03.966437 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:03.966408 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zjk5z" Sep 19 01:41:04.029523 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.029492 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:41:04.737424 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.737375 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9nrrh"] Sep 19 01:41:04.741538 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.741512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.744497 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.744425 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 19 01:41:04.744688 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.744667 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sl9pg\"" Sep 19 01:41:04.745286 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.745262 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 19 01:41:04.745406 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.745271 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 19 01:41:04.844732 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.844695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hfmn\" (UniqueName: \"kubernetes.io/projected/44a7926d-c14f-444e-a00e-639b4afd1e29-kube-api-access-5hfmn\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.844935 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.844749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-sys\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.844935 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.844774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-tls\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.844935 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.844804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44a7926d-c14f-444e-a00e-639b4afd1e29-metrics-client-ca\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.844935 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.844841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.845155 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.844939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-textfile\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.845155 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.844990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-root\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.845155 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.845070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.845155 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.845107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-wtmp\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946295 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-textfile\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946519 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-root\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946519 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946519 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946405 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-root\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946519 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-wtmp\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946519 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hfmn\" (UniqueName: \"kubernetes.io/projected/44a7926d-c14f-444e-a00e-639b4afd1e29-kube-api-access-5hfmn\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946519 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-sys\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946837 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-tls\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946837 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44a7926d-c14f-444e-a00e-639b4afd1e29-metrics-client-ca\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946837 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946601 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-wtmp\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946837 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946837 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946769 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-textfile\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.946837 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.946819 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44a7926d-c14f-444e-a00e-639b4afd1e29-sys\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.947111 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.947094 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-accelerators-collector-config\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.947240 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.947210 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44a7926d-c14f-444e-a00e-639b4afd1e29-metrics-client-ca\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.949290 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.949266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.949442 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.949426 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/44a7926d-c14f-444e-a00e-639b4afd1e29-node-exporter-tls\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:04.960134 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:04.960112 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hfmn\" (UniqueName: \"kubernetes.io/projected/44a7926d-c14f-444e-a00e-639b4afd1e29-kube-api-access-5hfmn\") pod \"node-exporter-9nrrh\" (UID: \"44a7926d-c14f-444e-a00e-639b4afd1e29\") " pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:05.052523 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:05.052442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9nrrh" Sep 19 01:41:05.262304 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:05.262261 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:41:05.262513 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:05.262335 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:41:05.267538 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:05.267506 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:41:06.037440 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:06.037405 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:41:06.098011 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:06.097972 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-658f7b78b5-zrdv2"] Sep 19 01:41:09.153096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.153043 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j"] Sep 19 01:41:09.156825 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.156782 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.160495 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.160472 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 19 01:41:09.160495 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.160488 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 19 01:41:09.160677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.160580 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 19 01:41:09.160677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.160496 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mjv6q\"" Sep 19 01:41:09.160794 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.160719 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4ov06i290fgul\"" Sep 19 01:41:09.160794 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.160779 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 19 01:41:09.165231 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.165169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j"] Sep 19 01:41:09.283993 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.283960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/92ca60a6-23af-4e4c-9ab4-124412095383-audit-log\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.283993 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.283996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-secret-metrics-server-client-certs\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.284240 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.284077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-secret-metrics-server-tls\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.284240 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.284114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv4hp\" (UniqueName: \"kubernetes.io/projected/92ca60a6-23af-4e4c-9ab4-124412095383-kube-api-access-wv4hp\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.284240 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.284141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-client-ca-bundle\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.284240 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.284163 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92ca60a6-23af-4e4c-9ab4-124412095383-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.284413 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.284283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/92ca60a6-23af-4e4c-9ab4-124412095383-metrics-server-audit-profiles\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.385572 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.385523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/92ca60a6-23af-4e4c-9ab4-124412095383-audit-log\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.385572 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.385568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-secret-metrics-server-client-certs\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.385801 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.385622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-secret-metrics-server-tls\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.385801 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.385646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4hp\" (UniqueName: \"kubernetes.io/projected/92ca60a6-23af-4e4c-9ab4-124412095383-kube-api-access-wv4hp\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.385801 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.385667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-client-ca-bundle\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.385801 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.385687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92ca60a6-23af-4e4c-9ab4-124412095383-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.385801 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.385722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/92ca60a6-23af-4e4c-9ab4-124412095383-metrics-server-audit-profiles\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.386032 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.386014 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/92ca60a6-23af-4e4c-9ab4-124412095383-audit-log\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.386440 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.386388 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92ca60a6-23af-4e4c-9ab4-124412095383-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.387082 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.387044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/92ca60a6-23af-4e4c-9ab4-124412095383-metrics-server-audit-profiles\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.388892 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.388848 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-secret-metrics-server-client-certs\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.389026 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.389006 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-secret-metrics-server-tls\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.389103 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.389081 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92ca60a6-23af-4e4c-9ab4-124412095383-client-ca-bundle\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.394440 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.394417 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4hp\" (UniqueName: \"kubernetes.io/projected/92ca60a6-23af-4e4c-9ab4-124412095383-kube-api-access-wv4hp\") pod \"metrics-server-7d9cc88bdf-q7v4j\" (UID: \"92ca60a6-23af-4e4c-9ab4-124412095383\") " pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:09.469297 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:09.469229 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:10.849573 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:41:10.849537 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a7926d_c14f_444e_a00e_639b4afd1e29.slice/crio-535c665a68d4d2ee6ce6317fad8620dbf08e9733e3a119d644b61521b355ecfb WatchSource:0}: Error finding container 535c665a68d4d2ee6ce6317fad8620dbf08e9733e3a119d644b61521b355ecfb: Status 404 returned error can't find the container with id 535c665a68d4d2ee6ce6317fad8620dbf08e9733e3a119d644b61521b355ecfb Sep 19 01:41:11.054535 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.054499 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-pp5zb" event={"ID":"974c0136-3e54-465f-abd4-28e8044db26e","Type":"ContainerStarted","Data":"68de147b6f5f8539ee908e7c6cfeff366788f64bba8a257d6e2334a2f932695f"} Sep 19 01:41:11.054736 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.054716 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-pp5zb" Sep 19 01:41:11.055977 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.055946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nrrh" event={"ID":"44a7926d-c14f-444e-a00e-639b4afd1e29","Type":"ContainerStarted","Data":"535c665a68d4d2ee6ce6317fad8620dbf08e9733e3a119d644b61521b355ecfb"} Sep 19 01:41:11.056381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.056339 2564 patch_prober.go:28] interesting pod/downloads-6594f4c75-pp5zb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.15:8080/\": dial tcp 10.133.0.15:8080: connect: connection refused" start-of-body= Sep 19 01:41:11.056473 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.056407 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6594f4c75-pp5zb" podUID="974c0136-3e54-465f-abd4-28e8044db26e" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.15:8080/\": dial tcp 10.133.0.15:8080: connect: connection refused" Sep 19 01:41:11.082762 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.082712 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-pp5zb" podStartSLOduration=1.197856683 podStartE2EDuration="20.082689851s" totalImagesPullingTime="18.884833168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:11.081328177 +0000 UTC m=+119.147231921" watchObservedRunningTime="2026-09-19 01:41:11.082689851 +0000 UTC m=+119.148593595" Sep 19 01:41:11.121216 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.121126 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j"] Sep 19 01:41:11.172500 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.172464 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:41:11.182379 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.182228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.188286 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.188258 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 19 01:41:11.188450 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.188336 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 19 01:41:11.190722 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.190693 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 19 01:41:11.190940 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.190922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 19 01:41:11.191012 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.190958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 19 01:41:11.191174 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.191155 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 19 01:41:11.191306 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.191287 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t44nl\"" Sep 19 01:41:11.191486 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.191155 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 19 01:41:11.191756 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.191733 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 19 01:41:11.191897 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.191235 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 19 01:41:11.192048 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.192028 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 19 01:41:11.192233 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.192218 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 19 01:41:11.193364 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.193319 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aj9icmkgqu1or\"" Sep 19 01:41:11.193566 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.193546 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 19 01:41:11.195071 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.195043 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 19 01:41:11.198506 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.198483 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 19 01:41:11.200122 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.200103 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:41:11.278207 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.278142 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:41:11.304207 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304207 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304207 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304119 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304207 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304518 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304518 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-web-config\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304518 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304518 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304518 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304518 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304518 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304518 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config-out\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs856\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-kube-api-access-qs856\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.304798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.305137 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.304832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405672 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405672 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405672 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config-out\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs856\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-kube-api-access-qs856\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.405926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.405998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.406034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.406057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.406100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.406122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-web-config\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.406146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.406172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.406333 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.406205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.407146 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.407117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.412368 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.407652 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.412368 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.408688 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.412368 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.409258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.412368 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.410122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.412368 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.412017 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.416455 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.412906 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.416455 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.413168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.416455 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.413332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.416455 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.413639 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.416455 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.415724 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-web-config\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.417204 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.417148 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.418468 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.418422 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config-out\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.420385 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.419422 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.424369 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.422146 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.424369 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.422152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.424369 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.422448 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.424369 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.422844 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.424758 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.424703 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.426808 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.426768 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs856\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-kube-api-access-qs856\") pod \"prometheus-k8s-0\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.498880 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.498834 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:11.824852 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:11.824373 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:41:12.063786 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:12.063707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" event={"ID":"92ca60a6-23af-4e4c-9ab4-124412095383","Type":"ContainerStarted","Data":"44dfca99977a6b51bb879bcfe31e170ee2607f45ceb5977318141416885a1f16"} Sep 19 01:41:12.070620 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:12.070395 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-pp5zb" Sep 19 01:41:12.117739 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:41:12.117611 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f3cb86_d090_4c81_b3d0_201b7a7c4739.slice/crio-3e57b868ee717d9bd2a4eec14a0f5f5bc338a9622eda1d9d96fa23d3ba468bdf WatchSource:0}: Error finding container 3e57b868ee717d9bd2a4eec14a0f5f5bc338a9622eda1d9d96fa23d3ba468bdf: Status 404 returned error can't find the container with id 3e57b868ee717d9bd2a4eec14a0f5f5bc338a9622eda1d9d96fa23d3ba468bdf Sep 19 01:41:13.071458 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:13.070882 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nrrh" event={"ID":"44a7926d-c14f-444e-a00e-639b4afd1e29","Type":"ContainerStarted","Data":"ab927c7a2ecda6a1e6bb405b0df4b9716513f29494f3df18f64a8796dbcf046c"} Sep 19 01:41:13.072566 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:13.072466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerStarted","Data":"3e57b868ee717d9bd2a4eec14a0f5f5bc338a9622eda1d9d96fa23d3ba468bdf"} Sep 19 01:41:14.080482 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:14.080451 2564 generic.go:356] "Generic (PLEG): container finished" podID="44a7926d-c14f-444e-a00e-639b4afd1e29" containerID="ab927c7a2ecda6a1e6bb405b0df4b9716513f29494f3df18f64a8796dbcf046c" exitCode=0 Sep 19 01:41:14.080921 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:14.080557 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nrrh" event={"ID":"44a7926d-c14f-444e-a00e-639b4afd1e29","Type":"ContainerDied","Data":"ab927c7a2ecda6a1e6bb405b0df4b9716513f29494f3df18f64a8796dbcf046c"} Sep 19 01:41:15.091143 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:15.090831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" event={"ID":"92ca60a6-23af-4e4c-9ab4-124412095383","Type":"ContainerStarted","Data":"b528bdf863cdde82f5212ea6873df8d8cbb73bb59331f1c36a8e6f068ea6c722"} Sep 19 01:41:15.094748 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:15.094171 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nrrh" event={"ID":"44a7926d-c14f-444e-a00e-639b4afd1e29","Type":"ContainerStarted","Data":"eb4398d84a8d2561e832ac22af646b2fd0314b2d6658e96ffa0ae50eb1becfc2"} Sep 19 01:41:15.094748 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:15.094228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9nrrh" event={"ID":"44a7926d-c14f-444e-a00e-639b4afd1e29","Type":"ContainerStarted","Data":"d741cc246692fe17dda8d7da7966a5ba11fdb7dcfa050476e1f6fd46748c087a"} Sep 19 01:41:15.096014 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:15.095985 2564 generic.go:356] "Generic (PLEG): container finished" podID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" exitCode=0 Sep 19 01:41:15.096129 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:15.096032 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerDied","Data":"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8"} Sep 19 01:41:15.130772 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:15.130712 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9nrrh" podStartSLOduration=9.423014013 podStartE2EDuration="11.130695081s" totalImagesPullingTime="1.609123411s" totalInitContainerRuntime="98.557657ms" isStatefulPod=true podCreationTimestamp="2026-09-19 01:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:15.129281851 +0000 UTC m=+123.195185632" watchObservedRunningTime="2026-09-19 01:41:15.130695081 +0000 UTC m=+123.196598835" Sep 19 01:41:15.130950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:15.130842 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" podStartSLOduration=3.249145495 podStartE2EDuration="6.130835922s" totalImagesPullingTime="2.881690427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:15.109766275 +0000 UTC m=+123.175670023" watchObservedRunningTime="2026-09-19 01:41:15.130835922 +0000 UTC m=+123.196739668" Sep 19 01:41:16.291280 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.291180 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" podUID="abd9e256-2e8c-4230-a105-d29fe90bf5f3" containerName="registry" containerID="cri-o://c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751" gracePeriod=30 Sep 19 01:41:16.598734 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.598421 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:41:16.665576 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.665535 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-bound-sa-token\") pod \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " Sep 19 01:41:16.665761 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.665601 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-image-registry-private-configuration\") pod \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " Sep 19 01:41:16.665761 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.665649 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn22s\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-kube-api-access-bn22s\") pod \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " Sep 19 01:41:16.665761 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.665681 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abd9e256-2e8c-4230-a105-d29fe90bf5f3-ca-trust-extracted\") pod \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " Sep 19 01:41:16.665761 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.665704 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-installation-pull-secrets\") pod \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " Sep 19 01:41:16.665761 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.665736 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-certificates\") pod \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " Sep 19 01:41:16.665761 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.665760 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-trusted-ca\") pod \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " Sep 19 01:41:16.666081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.665792 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") pod \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\" (UID: \"abd9e256-2e8c-4230-a105-d29fe90bf5f3\") " Sep 19 01:41:16.667466 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.666276 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "abd9e256-2e8c-4230-a105-d29fe90bf5f3" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:16.667466 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.666321 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "abd9e256-2e8c-4230-a105-d29fe90bf5f3" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:16.670882 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.670854 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "abd9e256-2e8c-4230-a105-d29fe90bf5f3" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:41:16.671016 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.670887 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "abd9e256-2e8c-4230-a105-d29fe90bf5f3" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:41:16.671423 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.671378 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "abd9e256-2e8c-4230-a105-d29fe90bf5f3" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:41:16.671635 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.671610 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-kube-api-access-bn22s" (OuterVolumeSpecName: "kube-api-access-bn22s") pod "abd9e256-2e8c-4230-a105-d29fe90bf5f3" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3"). InnerVolumeSpecName "kube-api-access-bn22s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:41:16.671826 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.671803 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "abd9e256-2e8c-4230-a105-d29fe90bf5f3" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:41:16.682770 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.682727 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abd9e256-2e8c-4230-a105-d29fe90bf5f3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "abd9e256-2e8c-4230-a105-d29fe90bf5f3" (UID: "abd9e256-2e8c-4230-a105-d29fe90bf5f3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:41:16.767062 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.766931 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abd9e256-2e8c-4230-a105-d29fe90bf5f3-ca-trust-extracted\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:16.767062 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.766967 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-installation-pull-secrets\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:16.767062 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.766981 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-certificates\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:16.767062 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.766994 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abd9e256-2e8c-4230-a105-d29fe90bf5f3-trusted-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:16.767062 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.767007 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-registry-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:16.767062 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.767015 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-bound-sa-token\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:16.767062 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.767028 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abd9e256-2e8c-4230-a105-d29fe90bf5f3-image-registry-private-configuration\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:16.767062 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:16.767037 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn22s\" (UniqueName: \"kubernetes.io/projected/abd9e256-2e8c-4230-a105-d29fe90bf5f3-kube-api-access-bn22s\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:17.110012 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.109973 2564 generic.go:356] "Generic (PLEG): container finished" podID="abd9e256-2e8c-4230-a105-d29fe90bf5f3" containerID="c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751" exitCode=0 Sep 19 01:41:17.110188 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.110062 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" Sep 19 01:41:17.110188 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.110131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" event={"ID":"abd9e256-2e8c-4230-a105-d29fe90bf5f3","Type":"ContainerDied","Data":"c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751"} Sep 19 01:41:17.110285 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.110199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b9b5668c-5nh6p" event={"ID":"abd9e256-2e8c-4230-a105-d29fe90bf5f3","Type":"ContainerDied","Data":"f01b2407f0e71d1e9351cc79406bb89182ca5291629366c1cfc5b9e983f4bdd6"} Sep 19 01:41:17.110285 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.110228 2564 scope.go:117] "RemoveContainer" containerID="c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751" Sep 19 01:41:17.122493 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.122468 2564 scope.go:117] "RemoveContainer" containerID="c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751" Sep 19 01:41:17.123965 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:41:17.123427 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751\": container with ID starting with c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751 not found: ID does not exist" containerID="c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751" Sep 19 01:41:17.123965 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.123470 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751"} err="failed to get container status \"c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751\": rpc error: code = NotFound desc = could not find container \"c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751\": container with ID starting with c7f2575dc9626d051b5ad1e84f15d26d4914288fcc60c8649a68d61f5abe8751 not found: ID does not exist" Sep 19 01:41:17.139132 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.139102 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b9b5668c-5nh6p"] Sep 19 01:41:17.153110 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:17.153033 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77b9b5668c-5nh6p"] Sep 19 01:41:18.383655 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:18.383613 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abd9e256-2e8c-4230-a105-d29fe90bf5f3" path="/var/lib/kubelet/pods/abd9e256-2e8c-4230-a105-d29fe90bf5f3/volumes" Sep 19 01:41:20.135076 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:20.134983 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerStarted","Data":"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9"} Sep 19 01:41:20.135076 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:20.135053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerStarted","Data":"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9"} Sep 19 01:41:21.129059 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:21.129025 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584ddf588f-jh6dj"] Sep 19 01:41:22.221923 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:22.221883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:41:22.224327 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:22.224304 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809e877-6cf8-43d4-9046-3ef68073edd6-metrics-certs\") pod \"network-metrics-daemon-mthbh\" (UID: \"1809e877-6cf8-43d4-9046-3ef68073edd6\") " pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:41:22.286918 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:22.286890 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9mflb\"" Sep 19 01:41:22.295184 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:22.295156 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mthbh" Sep 19 01:41:22.760900 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:22.760871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mthbh"] Sep 19 01:41:22.763792 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:41:22.763747 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1809e877_6cf8_43d4_9046_3ef68073edd6.slice/crio-a433e2a0e41f57ba128499de425cfa78c9395cd68dcdf3e6a1da467d77a0b058 WatchSource:0}: Error finding container a433e2a0e41f57ba128499de425cfa78c9395cd68dcdf3e6a1da467d77a0b058: Status 404 returned error can't find the container with id a433e2a0e41f57ba128499de425cfa78c9395cd68dcdf3e6a1da467d77a0b058 Sep 19 01:41:23.150061 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:23.149956 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerStarted","Data":"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923"} Sep 19 01:41:23.150249 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:23.150059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerStarted","Data":"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec"} Sep 19 01:41:23.150249 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:23.150160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerStarted","Data":"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220"} Sep 19 01:41:23.150249 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:23.150200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerStarted","Data":"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41"} Sep 19 01:41:23.151234 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:23.151207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mthbh" event={"ID":"1809e877-6cf8-43d4-9046-3ef68073edd6","Type":"ContainerStarted","Data":"a433e2a0e41f57ba128499de425cfa78c9395cd68dcdf3e6a1da467d77a0b058"} Sep 19 01:41:23.187280 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:23.187217 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.127420709 podStartE2EDuration="12.187201804s" totalImagesPullingTime="9.035094005s" totalInitContainerRuntime="24.68709ms" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:23.186802029 +0000 UTC m=+131.252705786" watchObservedRunningTime="2026-09-19 01:41:23.187201804 +0000 UTC m=+131.253105547" Sep 19 01:41:25.160502 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:25.160462 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mthbh" event={"ID":"1809e877-6cf8-43d4-9046-3ef68073edd6","Type":"ContainerStarted","Data":"1c4011eb5c64594fb45a387fc332e3fe8210530c1a291406d55298ee4dd32546"} Sep 19 01:41:25.160870 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:25.160513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mthbh" event={"ID":"1809e877-6cf8-43d4-9046-3ef68073edd6","Type":"ContainerStarted","Data":"cc84bc78aec69239b216528ca35506083e291c299567a3e1bd835ccd9db68cae"} Sep 19 01:41:25.177611 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:25.177554 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mthbh" podStartSLOduration=131.607147531 podStartE2EDuration="2m13.177536331s" totalImagesPullingTime="1.5703888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:25.176692178 +0000 UTC m=+133.242595924" watchObservedRunningTime="2026-09-19 01:41:25.177536331 +0000 UTC m=+133.243440074" Sep 19 01:41:26.500218 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:26.500182 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:41:29.470120 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:29.470087 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:29.470732 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:29.470156 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:30.181539 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:30.181504 2564 generic.go:356] "Generic (PLEG): container finished" podID="0d13f650-fdc9-44f8-92d6-d0ed0019e5a1" containerID="2ee3b18e3add15ba215c99b7a58e77587a5d8d5ccd3831a02b78dde6f3270328" exitCode=0 Sep 19 01:41:30.181823 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:30.181585 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" event={"ID":"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1","Type":"ContainerDied","Data":"2ee3b18e3add15ba215c99b7a58e77587a5d8d5ccd3831a02b78dde6f3270328"} Sep 19 01:41:30.182009 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:30.181993 2564 scope.go:117] "RemoveContainer" containerID="2ee3b18e3add15ba215c99b7a58e77587a5d8d5ccd3831a02b78dde6f3270328" Sep 19 01:41:31.186948 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:31.186912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-hkv2p" event={"ID":"0d13f650-fdc9-44f8-92d6-d0ed0019e5a1","Type":"ContainerStarted","Data":"7500546676c5c27f4f03752ad5b98158ff4ec133d2dfde99a4b70a8fe2149aee"} Sep 19 01:41:32.058400 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.058337 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-658f7b78b5-zrdv2" podUID="79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" containerName="console" containerID="cri-o://f15b716f762a80ae3662c707be9a3c023dfa161d6e9ebf23882b58e77ced204a" gracePeriod=15 Sep 19 01:41:32.193877 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.193840 2564 generic.go:356] "Generic (PLEG): container finished" podID="79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" containerID="f15b716f762a80ae3662c707be9a3c023dfa161d6e9ebf23882b58e77ced204a" exitCode=0 Sep 19 01:41:32.194209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.193911 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658f7b78b5-zrdv2" event={"ID":"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79","Type":"ContainerDied","Data":"f15b716f762a80ae3662c707be9a3c023dfa161d6e9ebf23882b58e77ced204a"} Sep 19 01:41:32.335076 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.335001 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:41:32.410748 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.410715 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-serving-cert\") pod \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " Sep 19 01:41:32.410948 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.410755 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-service-ca\") pod \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " Sep 19 01:41:32.410948 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.410777 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-oauth-serving-cert\") pod \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " Sep 19 01:41:32.410948 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.410800 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-oauth-config\") pod \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " Sep 19 01:41:32.410948 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.410852 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-config\") pod \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " Sep 19 01:41:32.410948 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.410923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d86q5\" (UniqueName: \"kubernetes.io/projected/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-kube-api-access-d86q5\") pod \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\" (UID: \"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79\") " Sep 19 01:41:32.411273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.411245 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-service-ca" (OuterVolumeSpecName: "service-ca") pod "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" (UID: "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:32.411273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.411256 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-config" (OuterVolumeSpecName: "console-config") pod "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" (UID: "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:32.411401 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.411253 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" (UID: "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:32.413250 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.413226 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-kube-api-access-d86q5" (OuterVolumeSpecName: "kube-api-access-d86q5") pod "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" (UID: "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79"). InnerVolumeSpecName "kube-api-access-d86q5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:41:32.413250 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.413236 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" (UID: "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:41:32.417503 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.417269 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" (UID: "79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:41:32.512326 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.512286 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-serving-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:32.512326 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.512320 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:32.512326 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.512331 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-oauth-serving-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:32.512569 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.512339 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-oauth-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:32.512569 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.512371 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-console-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:32.512569 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:32.512384 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d86q5\" (UniqueName: \"kubernetes.io/projected/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79-kube-api-access-d86q5\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:33.199127 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:33.199092 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658f7b78b5-zrdv2" event={"ID":"79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79","Type":"ContainerDied","Data":"9f8b8919ae1675d021963d8a4fba5078b566a7673613333aa299874eef279bdf"} Sep 19 01:41:33.199574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:33.199149 2564 scope.go:117] "RemoveContainer" containerID="f15b716f762a80ae3662c707be9a3c023dfa161d6e9ebf23882b58e77ced204a" Sep 19 01:41:33.199574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:33.199099 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658f7b78b5-zrdv2" Sep 19 01:41:33.218497 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:33.218467 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-658f7b78b5-zrdv2"] Sep 19 01:41:33.222535 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:33.222513 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-658f7b78b5-zrdv2"] Sep 19 01:41:34.373063 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:34.373033 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" path="/var/lib/kubelet/pods/79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79/volumes" Sep 19 01:41:41.362653 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:41.362613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n84hj_27d15022-5125-4ec5-a331-94a8885c003a/serve-healthcheck-canary/0.log" Sep 19 01:41:46.154854 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.154808 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-584ddf588f-jh6dj" podUID="1864d8d1-60d1-445f-8d47-9d812b5bcc11" containerName="console" containerID="cri-o://40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63" gracePeriod=15 Sep 19 01:41:46.438563 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.438533 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:41:46.527317 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527284 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-service-ca\") pod \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " Sep 19 01:41:46.527532 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527369 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48mzz\" (UniqueName: \"kubernetes.io/projected/1864d8d1-60d1-445f-8d47-9d812b5bcc11-kube-api-access-48mzz\") pod \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " Sep 19 01:41:46.527532 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527421 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-trusted-ca-bundle\") pod \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " Sep 19 01:41:46.527532 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527468 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-oauth-serving-cert\") pod \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " Sep 19 01:41:46.527532 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527492 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-oauth-config\") pod \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " Sep 19 01:41:46.527747 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527544 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-config\") pod \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " Sep 19 01:41:46.527747 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527570 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-serving-cert\") pod \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\" (UID: \"1864d8d1-60d1-445f-8d47-9d812b5bcc11\") " Sep 19 01:41:46.527851 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527793 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-service-ca" (OuterVolumeSpecName: "service-ca") pod "1864d8d1-60d1-445f-8d47-9d812b5bcc11" (UID: "1864d8d1-60d1-445f-8d47-9d812b5bcc11"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:46.527970 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527837 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1864d8d1-60d1-445f-8d47-9d812b5bcc11" (UID: "1864d8d1-60d1-445f-8d47-9d812b5bcc11"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:46.527970 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.527932 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1864d8d1-60d1-445f-8d47-9d812b5bcc11" (UID: "1864d8d1-60d1-445f-8d47-9d812b5bcc11"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:46.528142 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.528021 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-config" (OuterVolumeSpecName: "console-config") pod "1864d8d1-60d1-445f-8d47-9d812b5bcc11" (UID: "1864d8d1-60d1-445f-8d47-9d812b5bcc11"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:41:46.529763 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.529731 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1864d8d1-60d1-445f-8d47-9d812b5bcc11-kube-api-access-48mzz" (OuterVolumeSpecName: "kube-api-access-48mzz") pod "1864d8d1-60d1-445f-8d47-9d812b5bcc11" (UID: "1864d8d1-60d1-445f-8d47-9d812b5bcc11"). InnerVolumeSpecName "kube-api-access-48mzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:41:46.529845 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.529781 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1864d8d1-60d1-445f-8d47-9d812b5bcc11" (UID: "1864d8d1-60d1-445f-8d47-9d812b5bcc11"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:41:46.529845 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.529801 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1864d8d1-60d1-445f-8d47-9d812b5bcc11" (UID: "1864d8d1-60d1-445f-8d47-9d812b5bcc11"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:41:46.628356 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.628319 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:46.628531 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.628368 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-serving-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:46.628531 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.628379 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-service-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:46.628531 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.628388 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48mzz\" (UniqueName: \"kubernetes.io/projected/1864d8d1-60d1-445f-8d47-9d812b5bcc11-kube-api-access-48mzz\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:46.628531 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.628397 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-trusted-ca-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:46.628531 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.628414 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1864d8d1-60d1-445f-8d47-9d812b5bcc11-oauth-serving-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:46.628531 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:46.628422 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1864d8d1-60d1-445f-8d47-9d812b5bcc11-console-oauth-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:41:47.257316 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.257278 2564 generic.go:356] "Generic (PLEG): container finished" podID="1864d8d1-60d1-445f-8d47-9d812b5bcc11" containerID="40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63" exitCode=0 Sep 19 01:41:47.257756 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.257328 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584ddf588f-jh6dj" Sep 19 01:41:47.257756 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.257370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584ddf588f-jh6dj" event={"ID":"1864d8d1-60d1-445f-8d47-9d812b5bcc11","Type":"ContainerDied","Data":"40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63"} Sep 19 01:41:47.257756 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.257417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584ddf588f-jh6dj" event={"ID":"1864d8d1-60d1-445f-8d47-9d812b5bcc11","Type":"ContainerDied","Data":"a2f76987ebc4b3fe79942940ece5c33c8f90a835550ece4865676a7d451028df"} Sep 19 01:41:47.257756 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.257436 2564 scope.go:117] "RemoveContainer" containerID="40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63" Sep 19 01:41:47.266914 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.266896 2564 scope.go:117] "RemoveContainer" containerID="40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63" Sep 19 01:41:47.267209 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:41:47.267192 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63\": container with ID starting with 40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63 not found: ID does not exist" containerID="40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63" Sep 19 01:41:47.267267 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.267222 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63"} err="failed to get container status \"40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63\": rpc error: code = NotFound desc = could not find container \"40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63\": container with ID starting with 40a5f0ac6a9e2851aa41bb95b25ac6d8746874a95ee47a69ffaf5784f9676b63 not found: ID does not exist" Sep 19 01:41:47.280625 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.280594 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584ddf588f-jh6dj"] Sep 19 01:41:47.287562 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:47.287540 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-584ddf588f-jh6dj"] Sep 19 01:41:48.373257 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:48.373224 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1864d8d1-60d1-445f-8d47-9d812b5bcc11" path="/var/lib/kubelet/pods/1864d8d1-60d1-445f-8d47-9d812b5bcc11/volumes" Sep 19 01:41:49.475030 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:49.474989 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:41:49.478955 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:41:49.478927 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d9cc88bdf-q7v4j" Sep 19 01:42:11.500182 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:11.500098 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:11.520281 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:11.520256 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:12.376314 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:12.376288 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:29.565150 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.565109 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:42:29.565776 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.565526 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="prometheus" containerID="cri-o://8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" gracePeriod=600 Sep 19 01:42:29.565939 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.565908 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" gracePeriod=600 Sep 19 01:42:29.566074 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.566051 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="config-reloader" containerID="cri-o://30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" gracePeriod=600 Sep 19 01:42:29.567086 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.566367 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy" containerID="cri-o://8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" gracePeriod=600 Sep 19 01:42:29.567086 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.566494 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy-web" containerID="cri-o://91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" gracePeriod=600 Sep 19 01:42:29.567731 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.567424 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="thanos-sidecar" containerID="cri-o://1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" gracePeriod=600 Sep 19 01:42:29.816466 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.816405 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:29.888995 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.888551 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-trusted-ca-bundle\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.888995 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.888675 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-thanos-prometheus-http-client-file\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.888995 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.888715 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-0\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.888995 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.888761 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-db\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.888995 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.888904 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-tls\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.888995 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.888942 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-metrics-client-ca\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.888995 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.888950 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889017 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config-out\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889056 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-tls-assets\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889238 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889276 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-metrics-client-certs\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889315 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-2\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889379 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-kubelet-serving-ca-bundle\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889414 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-serving-certs-ca-bundle\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889449 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs856\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-kube-api-access-qs856\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889496 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889488 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889514 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-1\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889560 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-kube-rbac-proxy\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889596 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889628 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-grpc-tls\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889659 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-web-config\") pod \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\" (UID: \"c9f3cb86-d090-4c81-b3d0-201b7a7c4739\") " Sep 19 01:42:29.889909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889663 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:42:29.889909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889892 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.889909 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889910 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-db\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.890292 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889966 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:29.890292 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.889977 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:29.890292 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.890192 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:29.891882 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.891596 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.892335 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.892293 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:29.896366 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.893876 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:29.896366 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.893961 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.896366 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.894207 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 01:42:29.896366 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.895486 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.897578 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.897398 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.897578 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.897477 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-kube-api-access-qs856" (OuterVolumeSpecName: "kube-api-access-qs856") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "kube-api-access-qs856". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:42:29.897578 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.897541 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config" (OuterVolumeSpecName: "config") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.897779 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.897581 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.898249 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.898207 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.898249 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.898211 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:42:29.898509 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.898471 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config-out" (OuterVolumeSpecName: "config-out") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:42:29.899308 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.899277 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.908974 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.908947 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-web-config" (OuterVolumeSpecName: "web-config") pod "c9f3cb86-d090-4c81-b3d0-201b7a7c4739" (UID: "c9f3cb86-d090-4c81-b3d0-201b7a7c4739"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:42:29.990512 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990475 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990512 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990505 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs856\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-kube-api-access-qs856\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990512 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990516 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990526 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990536 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-kube-rbac-proxy\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990545 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990554 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-grpc-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990562 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-web-config\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990570 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990578 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990588 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990596 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-metrics-client-ca\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990604 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-config-out\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990612 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-tls-assets\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990620 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990627 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-secret-metrics-client-certs\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990636 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:29.990737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:29.990644 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9f3cb86-d090-4c81-b3d0-201b7a7c4739-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:42:30.432323 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432288 2564 generic.go:356] "Generic (PLEG): container finished" podID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" exitCode=0 Sep 19 01:42:30.432323 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432316 2564 generic.go:356] "Generic (PLEG): container finished" podID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" exitCode=0 Sep 19 01:42:30.432323 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432322 2564 generic.go:356] "Generic (PLEG): container finished" podID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" exitCode=0 Sep 19 01:42:30.432323 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432327 2564 generic.go:356] "Generic (PLEG): container finished" podID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" exitCode=0 Sep 19 01:42:30.432574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432335 2564 generic.go:356] "Generic (PLEG): container finished" podID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" exitCode=0 Sep 19 01:42:30.432574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432360 2564 generic.go:356] "Generic (PLEG): container finished" podID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" exitCode=0 Sep 19 01:42:30.432574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432391 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.432574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432383 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerDied","Data":"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923"} Sep 19 01:42:30.432574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerDied","Data":"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec"} Sep 19 01:42:30.432732 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerDied","Data":"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220"} Sep 19 01:42:30.432732 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432611 2564 scope.go:117] "RemoveContainer" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" Sep 19 01:42:30.432732 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432628 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerDied","Data":"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41"} Sep 19 01:42:30.432732 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432671 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerDied","Data":"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9"} Sep 19 01:42:30.432732 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerDied","Data":"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9"} Sep 19 01:42:30.432883 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.432761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c9f3cb86-d090-4c81-b3d0-201b7a7c4739","Type":"ContainerDied","Data":"3e57b868ee717d9bd2a4eec14a0f5f5bc338a9622eda1d9d96fa23d3ba468bdf"} Sep 19 01:42:30.440371 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.440354 2564 scope.go:117] "RemoveContainer" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" Sep 19 01:42:30.447375 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.447329 2564 scope.go:117] "RemoveContainer" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" Sep 19 01:42:30.454025 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.454005 2564 scope.go:117] "RemoveContainer" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" Sep 19 01:42:30.461175 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.461156 2564 scope.go:117] "RemoveContainer" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" Sep 19 01:42:30.468063 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.468049 2564 scope.go:117] "RemoveContainer" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" Sep 19 01:42:30.475645 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.475620 2564 scope.go:117] "RemoveContainer" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" Sep 19 01:42:30.482108 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.482091 2564 scope.go:117] "RemoveContainer" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" Sep 19 01:42:30.482397 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:42:30.482379 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": container with ID starting with e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923 not found: ID does not exist" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" Sep 19 01:42:30.482460 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.482405 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923"} err="failed to get container status \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": rpc error: code = NotFound desc = could not find container \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": container with ID starting with e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923 not found: ID does not exist" Sep 19 01:42:30.482460 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.482424 2564 scope.go:117] "RemoveContainer" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" Sep 19 01:42:30.482679 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:42:30.482663 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": container with ID starting with 8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec not found: ID does not exist" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" Sep 19 01:42:30.482718 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.482698 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec"} err="failed to get container status \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": rpc error: code = NotFound desc = could not find container \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": container with ID starting with 8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec not found: ID does not exist" Sep 19 01:42:30.482754 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.482717 2564 scope.go:117] "RemoveContainer" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" Sep 19 01:42:30.482945 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:42:30.482930 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": container with ID starting with 91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220 not found: ID does not exist" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" Sep 19 01:42:30.482998 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.482948 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220"} err="failed to get container status \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": rpc error: code = NotFound desc = could not find container \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": container with ID starting with 91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220 not found: ID does not exist" Sep 19 01:42:30.482998 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.482961 2564 scope.go:117] "RemoveContainer" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" Sep 19 01:42:30.483262 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:42:30.483241 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": container with ID starting with 1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41 not found: ID does not exist" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" Sep 19 01:42:30.483322 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.483268 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41"} err="failed to get container status \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": rpc error: code = NotFound desc = could not find container \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": container with ID starting with 1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41 not found: ID does not exist" Sep 19 01:42:30.483322 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.483287 2564 scope.go:117] "RemoveContainer" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" Sep 19 01:42:30.483604 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:42:30.483585 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": container with ID starting with 30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9 not found: ID does not exist" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" Sep 19 01:42:30.483674 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.483609 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9"} err="failed to get container status \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": rpc error: code = NotFound desc = could not find container \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": container with ID starting with 30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9 not found: ID does not exist" Sep 19 01:42:30.483674 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.483624 2564 scope.go:117] "RemoveContainer" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" Sep 19 01:42:30.483881 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:42:30.483865 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": container with ID starting with 8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9 not found: ID does not exist" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" Sep 19 01:42:30.483933 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.483885 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9"} err="failed to get container status \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": rpc error: code = NotFound desc = could not find container \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": container with ID starting with 8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9 not found: ID does not exist" Sep 19 01:42:30.483933 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.483898 2564 scope.go:117] "RemoveContainer" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" Sep 19 01:42:30.484114 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:42:30.484097 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": container with ID starting with 9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8 not found: ID does not exist" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" Sep 19 01:42:30.484174 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.484122 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8"} err="failed to get container status \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": rpc error: code = NotFound desc = could not find container \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": container with ID starting with 9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8 not found: ID does not exist" Sep 19 01:42:30.484174 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.484146 2564 scope.go:117] "RemoveContainer" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" Sep 19 01:42:30.484480 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.484461 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923"} err="failed to get container status \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": rpc error: code = NotFound desc = could not find container \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": container with ID starting with e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923 not found: ID does not exist" Sep 19 01:42:30.484539 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.484481 2564 scope.go:117] "RemoveContainer" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" Sep 19 01:42:30.484777 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.484758 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec"} err="failed to get container status \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": rpc error: code = NotFound desc = could not find container \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": container with ID starting with 8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec not found: ID does not exist" Sep 19 01:42:30.484777 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.484776 2564 scope.go:117] "RemoveContainer" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" Sep 19 01:42:30.485020 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485005 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220"} err="failed to get container status \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": rpc error: code = NotFound desc = could not find container \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": container with ID starting with 91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220 not found: ID does not exist" Sep 19 01:42:30.485020 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485020 2564 scope.go:117] "RemoveContainer" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" Sep 19 01:42:30.485243 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485225 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41"} err="failed to get container status \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": rpc error: code = NotFound desc = could not find container \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": container with ID starting with 1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41 not found: ID does not exist" Sep 19 01:42:30.485329 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485244 2564 scope.go:117] "RemoveContainer" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" Sep 19 01:42:30.485514 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485496 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9"} err="failed to get container status \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": rpc error: code = NotFound desc = could not find container \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": container with ID starting with 30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9 not found: ID does not exist" Sep 19 01:42:30.485582 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485517 2564 scope.go:117] "RemoveContainer" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" Sep 19 01:42:30.485774 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485756 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9"} err="failed to get container status \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": rpc error: code = NotFound desc = could not find container \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": container with ID starting with 8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9 not found: ID does not exist" Sep 19 01:42:30.485821 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485774 2564 scope.go:117] "RemoveContainer" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" Sep 19 01:42:30.485999 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.485980 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8"} err="failed to get container status \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": rpc error: code = NotFound desc = could not find container \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": container with ID starting with 9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8 not found: ID does not exist" Sep 19 01:42:30.486043 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486000 2564 scope.go:117] "RemoveContainer" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" Sep 19 01:42:30.486215 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486198 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923"} err="failed to get container status \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": rpc error: code = NotFound desc = could not find container \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": container with ID starting with e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923 not found: ID does not exist" Sep 19 01:42:30.486280 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486217 2564 scope.go:117] "RemoveContainer" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" Sep 19 01:42:30.486472 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486452 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec"} err="failed to get container status \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": rpc error: code = NotFound desc = could not find container \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": container with ID starting with 8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec not found: ID does not exist" Sep 19 01:42:30.486524 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486473 2564 scope.go:117] "RemoveContainer" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" Sep 19 01:42:30.486693 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486677 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220"} err="failed to get container status \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": rpc error: code = NotFound desc = could not find container \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": container with ID starting with 91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220 not found: ID does not exist" Sep 19 01:42:30.486737 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486694 2564 scope.go:117] "RemoveContainer" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" Sep 19 01:42:30.486972 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486952 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41"} err="failed to get container status \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": rpc error: code = NotFound desc = could not find container \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": container with ID starting with 1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41 not found: ID does not exist" Sep 19 01:42:30.487039 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.486974 2564 scope.go:117] "RemoveContainer" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" Sep 19 01:42:30.487401 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.487357 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9"} err="failed to get container status \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": rpc error: code = NotFound desc = could not find container \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": container with ID starting with 30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9 not found: ID does not exist" Sep 19 01:42:30.487500 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.487403 2564 scope.go:117] "RemoveContainer" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" Sep 19 01:42:30.487709 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.487688 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9"} err="failed to get container status \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": rpc error: code = NotFound desc = could not find container \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": container with ID starting with 8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9 not found: ID does not exist" Sep 19 01:42:30.487709 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.487708 2564 scope.go:117] "RemoveContainer" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" Sep 19 01:42:30.488047 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.488019 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8"} err="failed to get container status \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": rpc error: code = NotFound desc = could not find container \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": container with ID starting with 9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8 not found: ID does not exist" Sep 19 01:42:30.488047 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.488041 2564 scope.go:117] "RemoveContainer" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" Sep 19 01:42:30.488459 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.488399 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923"} err="failed to get container status \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": rpc error: code = NotFound desc = could not find container \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": container with ID starting with e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923 not found: ID does not exist" Sep 19 01:42:30.488459 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.488423 2564 scope.go:117] "RemoveContainer" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" Sep 19 01:42:30.488740 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.488713 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec"} err="failed to get container status \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": rpc error: code = NotFound desc = could not find container \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": container with ID starting with 8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec not found: ID does not exist" Sep 19 01:42:30.488740 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.488733 2564 scope.go:117] "RemoveContainer" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" Sep 19 01:42:30.489007 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.488969 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220"} err="failed to get container status \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": rpc error: code = NotFound desc = could not find container \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": container with ID starting with 91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220 not found: ID does not exist" Sep 19 01:42:30.489007 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.488995 2564 scope.go:117] "RemoveContainer" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" Sep 19 01:42:30.489288 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.489269 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41"} err="failed to get container status \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": rpc error: code = NotFound desc = could not find container \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": container with ID starting with 1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41 not found: ID does not exist" Sep 19 01:42:30.489288 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.489288 2564 scope.go:117] "RemoveContainer" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" Sep 19 01:42:30.489568 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.489548 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9"} err="failed to get container status \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": rpc error: code = NotFound desc = could not find container \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": container with ID starting with 30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9 not found: ID does not exist" Sep 19 01:42:30.489629 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.489578 2564 scope.go:117] "RemoveContainer" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" Sep 19 01:42:30.489674 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.489639 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:42:30.489824 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.489804 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9"} err="failed to get container status \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": rpc error: code = NotFound desc = could not find container \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": container with ID starting with 8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9 not found: ID does not exist" Sep 19 01:42:30.489869 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.489826 2564 scope.go:117] "RemoveContainer" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" Sep 19 01:42:30.490092 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.490073 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8"} err="failed to get container status \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": rpc error: code = NotFound desc = could not find container \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": container with ID starting with 9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8 not found: ID does not exist" Sep 19 01:42:30.490159 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.490094 2564 scope.go:117] "RemoveContainer" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" Sep 19 01:42:30.490358 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.490322 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923"} err="failed to get container status \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": rpc error: code = NotFound desc = could not find container \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": container with ID starting with e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923 not found: ID does not exist" Sep 19 01:42:30.490413 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.490357 2564 scope.go:117] "RemoveContainer" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" Sep 19 01:42:30.490620 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.490603 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec"} err="failed to get container status \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": rpc error: code = NotFound desc = could not find container \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": container with ID starting with 8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec not found: ID does not exist" Sep 19 01:42:30.490715 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.490621 2564 scope.go:117] "RemoveContainer" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" Sep 19 01:42:30.490836 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.490819 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220"} err="failed to get container status \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": rpc error: code = NotFound desc = could not find container \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": container with ID starting with 91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220 not found: ID does not exist" Sep 19 01:42:30.490880 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.490837 2564 scope.go:117] "RemoveContainer" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" Sep 19 01:42:30.491032 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491015 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41"} err="failed to get container status \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": rpc error: code = NotFound desc = could not find container \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": container with ID starting with 1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41 not found: ID does not exist" Sep 19 01:42:30.491076 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491032 2564 scope.go:117] "RemoveContainer" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" Sep 19 01:42:30.491220 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491205 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9"} err="failed to get container status \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": rpc error: code = NotFound desc = could not find container \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": container with ID starting with 30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9 not found: ID does not exist" Sep 19 01:42:30.491263 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491220 2564 scope.go:117] "RemoveContainer" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" Sep 19 01:42:30.491422 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491407 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9"} err="failed to get container status \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": rpc error: code = NotFound desc = could not find container \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": container with ID starting with 8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9 not found: ID does not exist" Sep 19 01:42:30.491463 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491422 2564 scope.go:117] "RemoveContainer" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" Sep 19 01:42:30.491616 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491600 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8"} err="failed to get container status \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": rpc error: code = NotFound desc = could not find container \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": container with ID starting with 9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8 not found: ID does not exist" Sep 19 01:42:30.491658 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491618 2564 scope.go:117] "RemoveContainer" containerID="e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923" Sep 19 01:42:30.491872 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491854 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923"} err="failed to get container status \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": rpc error: code = NotFound desc = could not find container \"e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923\": container with ID starting with e434b33809afa7b2df249268a610f179e13cc1bd7ea924156625a36f9281a923 not found: ID does not exist" Sep 19 01:42:30.491930 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.491873 2564 scope.go:117] "RemoveContainer" containerID="8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec" Sep 19 01:42:30.492108 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.492090 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec"} err="failed to get container status \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": rpc error: code = NotFound desc = could not find container \"8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec\": container with ID starting with 8442bc895c1ea4872f88c41155b94d001c8e7b51b71a9775349e4072c9f5e7ec not found: ID does not exist" Sep 19 01:42:30.492175 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.492120 2564 scope.go:117] "RemoveContainer" containerID="91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220" Sep 19 01:42:30.492395 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.492375 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220"} err="failed to get container status \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": rpc error: code = NotFound desc = could not find container \"91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220\": container with ID starting with 91617f280ebedd8ee173816e96ae2dd98cb13e995b2332f7b8bd28bd75e0f220 not found: ID does not exist" Sep 19 01:42:30.492453 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.492397 2564 scope.go:117] "RemoveContainer" containerID="1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41" Sep 19 01:42:30.492652 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.492629 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41"} err="failed to get container status \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": rpc error: code = NotFound desc = could not find container \"1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41\": container with ID starting with 1fed62c038a49a46c783eff636ce20d53598af3e7a2766155716155bba5d8c41 not found: ID does not exist" Sep 19 01:42:30.492739 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.492653 2564 scope.go:117] "RemoveContainer" containerID="30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9" Sep 19 01:42:30.492926 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.492908 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9"} err="failed to get container status \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": rpc error: code = NotFound desc = could not find container \"30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9\": container with ID starting with 30af84f18e447ae81e0c3b2373007e8e866fbf182c5e6cfe864780b549a843f9 not found: ID does not exist" Sep 19 01:42:30.492980 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.492928 2564 scope.go:117] "RemoveContainer" containerID="8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9" Sep 19 01:42:30.493153 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.493136 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9"} err="failed to get container status \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": rpc error: code = NotFound desc = could not find container \"8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9\": container with ID starting with 8570110ee91e477ea48f3b93abcfcc8e1de3c461cfe8f07c5b4dc56963f202e9 not found: ID does not exist" Sep 19 01:42:30.493203 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.493154 2564 scope.go:117] "RemoveContainer" containerID="9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8" Sep 19 01:42:30.493410 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.493389 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8"} err="failed to get container status \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": rpc error: code = NotFound desc = could not find container \"9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8\": container with ID starting with 9c36bab936dfff5714486f7ab487c36d3fec085aee392bb17f7004a1f329aba8 not found: ID does not exist" Sep 19 01:42:30.503280 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.503258 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:42:30.589370 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589328 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589612 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="prometheus" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589626 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="prometheus" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589642 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="config-reloader" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589648 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="config-reloader" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589653 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="thanos-sidecar" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589658 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="thanos-sidecar" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589667 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy-web" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589672 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy-web" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589680 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy" Sep 19 01:42:30.589682 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589684 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589692 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" containerName="console" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589697 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" containerName="console" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589706 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="init-config-reloader" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589715 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="init-config-reloader" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589723 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd9e256-2e8c-4230-a105-d29fe90bf5f3" containerName="registry" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589728 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd9e256-2e8c-4230-a105-d29fe90bf5f3" containerName="registry" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589736 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1864d8d1-60d1-445f-8d47-9d812b5bcc11" containerName="console" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589741 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1864d8d1-60d1-445f-8d47-9d812b5bcc11" containerName="console" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589747 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy-thanos" Sep 19 01:42:30.590042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.589752 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy-thanos" Sep 19 01:42:30.594980 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.590282 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="prometheus" Sep 19 01:42:30.595105 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.594999 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="thanos-sidecar" Sep 19 01:42:30.595105 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.595020 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="79bc4c77-cc2b-4efd-8d5c-2e3ebcfb2b79" containerName="console" Sep 19 01:42:30.595105 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.595030 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="abd9e256-2e8c-4230-a105-d29fe90bf5f3" containerName="registry" Sep 19 01:42:30.595105 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.595060 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="config-reloader" Sep 19 01:42:30.595105 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.595091 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy" Sep 19 01:42:30.595105 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.595102 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy-thanos" Sep 19 01:42:30.595397 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.595115 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1864d8d1-60d1-445f-8d47-9d812b5bcc11" containerName="console" Sep 19 01:42:30.595397 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.595124 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" containerName="kube-rbac-proxy-web" Sep 19 01:42:30.599509 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.599486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.604250 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.604230 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 19 01:42:30.604395 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.604257 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 19 01:42:30.604395 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.604333 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 19 01:42:30.604516 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.604384 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 19 01:42:30.604516 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.604403 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 19 01:42:30.604516 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.604499 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 19 01:42:30.604516 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.604512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 19 01:42:30.604930 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.604897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 19 01:42:30.605112 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.605095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t44nl\"" Sep 19 01:42:30.605201 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.605176 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 19 01:42:30.605273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.605218 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 19 01:42:30.605273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.605230 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 19 01:42:30.605401 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.605286 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aj9icmkgqu1or\"" Sep 19 01:42:30.605401 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.605305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 19 01:42:30.618295 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.618271 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 19 01:42:30.620810 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.620792 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 19 01:42:30.624562 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.624542 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:42:30.696402 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696402 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696339 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696402 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696657 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696657 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696657 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/600fe940-56ab-44e5-9533-566e959aa02c-config-out\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696657 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-config\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696657 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696657 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696657 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv8dr\" (UniqueName: \"kubernetes.io/projected/600fe940-56ab-44e5-9533-566e959aa02c-kube-api-access-pv8dr\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-web-config\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696770 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/600fe940-56ab-44e5-9533-566e959aa02c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696806 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.696954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.697243 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.696973 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.797756 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.797702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.797756 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.797761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798006 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.797782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798006 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.797958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/600fe940-56ab-44e5-9533-566e959aa02c-config-out\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798006 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.797983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-config\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798006 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.797998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv8dr\" (UniqueName: \"kubernetes.io/projected/600fe940-56ab-44e5-9533-566e959aa02c-kube-api-access-pv8dr\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-web-config\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/600fe940-56ab-44e5-9533-566e959aa02c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798209 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.798613 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.798500 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.799380 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.799334 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.800275 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.800198 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.802245 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.800451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.802245 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.800769 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.802245 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.801073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-config\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.802245 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.801265 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/600fe940-56ab-44e5-9533-566e959aa02c-config-out\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.802245 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.801653 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.802245 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.801669 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.802245 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.801820 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.802245 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.802045 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804591 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.802547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804591 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.803082 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804591 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.803158 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-web-config\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804591 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.803194 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804591 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.804561 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804591 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.804577 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804793 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.804564 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/600fe940-56ab-44e5-9533-566e959aa02c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804793 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.804637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/600fe940-56ab-44e5-9533-566e959aa02c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.804793 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.804657 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/600fe940-56ab-44e5-9533-566e959aa02c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.812522 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.812501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv8dr\" (UniqueName: \"kubernetes.io/projected/600fe940-56ab-44e5-9533-566e959aa02c-kube-api-access-pv8dr\") pod \"prometheus-k8s-0\" (UID: \"600fe940-56ab-44e5-9533-566e959aa02c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:30.909133 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:30.909083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:42:31.197280 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:31.197244 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 19 01:42:31.200875 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:42:31.200848 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600fe940_56ab_44e5_9533_566e959aa02c.slice/crio-d02a965d2a465ad9fc2c907d1e42e61a1dcd79e4803c7be0dc0290519e549bf1 WatchSource:0}: Error finding container d02a965d2a465ad9fc2c907d1e42e61a1dcd79e4803c7be0dc0290519e549bf1: Status 404 returned error can't find the container with id d02a965d2a465ad9fc2c907d1e42e61a1dcd79e4803c7be0dc0290519e549bf1 Sep 19 01:42:31.437927 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:31.437893 2564 generic.go:356] "Generic (PLEG): container finished" podID="600fe940-56ab-44e5-9533-566e959aa02c" containerID="35895b581cb5f1e2b4fee0240e91b273d12e477a39f5323747e1aaa63fd3f430" exitCode=0 Sep 19 01:42:31.438115 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:31.437986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600fe940-56ab-44e5-9533-566e959aa02c","Type":"ContainerDied","Data":"35895b581cb5f1e2b4fee0240e91b273d12e477a39f5323747e1aaa63fd3f430"} Sep 19 01:42:31.438115 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:31.438060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600fe940-56ab-44e5-9533-566e959aa02c","Type":"ContainerStarted","Data":"d02a965d2a465ad9fc2c907d1e42e61a1dcd79e4803c7be0dc0290519e549bf1"} Sep 19 01:42:32.374289 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:32.374257 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9f3cb86-d090-4c81-b3d0-201b7a7c4739" path="/var/lib/kubelet/pods/c9f3cb86-d090-4c81-b3d0-201b7a7c4739/volumes" Sep 19 01:42:32.447659 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:32.447623 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600fe940-56ab-44e5-9533-566e959aa02c","Type":"ContainerStarted","Data":"68b48c2e82c700e918b8130d506cf037da2bd0422c650131f02aad5cf69d12f1"} Sep 19 01:42:32.447792 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:32.447706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600fe940-56ab-44e5-9533-566e959aa02c","Type":"ContainerStarted","Data":"7d4c1cde896d27dfeb188eefcfd14a28f73700ee525952fa611f8188cf928c5d"} Sep 19 01:42:32.447792 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:32.447750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600fe940-56ab-44e5-9533-566e959aa02c","Type":"ContainerStarted","Data":"c9ed39c32b3a7792578b6cded2230d62a56cd31726bf347715f3ed58796c26bd"} Sep 19 01:42:32.447792 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:32.447785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600fe940-56ab-44e5-9533-566e959aa02c","Type":"ContainerStarted","Data":"b2b7324dd3fa965e0f41f18f7a6aae7efbe0cc856ae675a0c360eab6f050dd0f"} Sep 19 01:42:32.447916 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:32.447821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600fe940-56ab-44e5-9533-566e959aa02c","Type":"ContainerStarted","Data":"05f9040469fb6efe867f6859586f0daf2f58c72edb9634f4feeeacbb66e85488"} Sep 19 01:42:32.447916 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:32.447863 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"600fe940-56ab-44e5-9533-566e959aa02c","Type":"ContainerStarted","Data":"a41b96aba472e120cdde5a17a79d084cb2d3df83862c57d1084402d1ef9d92db"} Sep 19 01:42:32.485429 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:32.485333 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.466383619 podStartE2EDuration="2.485314476s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.930857ms" isStatefulPod=false podCreationTimestamp="2026-09-19 01:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:42:32.482424039 +0000 UTC m=+200.548327782" watchObservedRunningTime="2026-09-19 01:42:32.485314476 +0000 UTC m=+200.551218216" Sep 19 01:42:35.909734 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:42:35.909696 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:43:30.910089 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:43:30.910049 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:43:30.926300 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:43:30.926265 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:43:31.683649 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:43:31.683621 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 19 01:44:12.277033 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:44:12.277006 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:44:12.282111 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:44:12.282084 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:44:12.285447 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:44:12.285425 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:44:12.288696 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:44:12.288676 2564 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 01:44:12.290940 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:44:12.290922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:45:18.490295 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.490215 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mhvqj"] Sep 19 01:45:18.492313 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.492296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mhvqj" Sep 19 01:45:18.494775 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.494752 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 19 01:45:18.495148 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.495132 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 19 01:45:18.495273 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.495173 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rvjkn\"" Sep 19 01:45:18.503675 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.503648 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mhvqj"] Sep 19 01:45:18.623742 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.623707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5c9z\" (UniqueName: \"kubernetes.io/projected/c8ffff35-10c6-4498-aa52-e26126b3f18b-kube-api-access-h5c9z\") pod \"cert-manager-55b4d954d5-mhvqj\" (UID: \"c8ffff35-10c6-4498-aa52-e26126b3f18b\") " pod="cert-manager/cert-manager-55b4d954d5-mhvqj" Sep 19 01:45:18.623927 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.623771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8ffff35-10c6-4498-aa52-e26126b3f18b-bound-sa-token\") pod \"cert-manager-55b4d954d5-mhvqj\" (UID: \"c8ffff35-10c6-4498-aa52-e26126b3f18b\") " pod="cert-manager/cert-manager-55b4d954d5-mhvqj" Sep 19 01:45:18.724817 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.724777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8ffff35-10c6-4498-aa52-e26126b3f18b-bound-sa-token\") pod \"cert-manager-55b4d954d5-mhvqj\" (UID: \"c8ffff35-10c6-4498-aa52-e26126b3f18b\") " pod="cert-manager/cert-manager-55b4d954d5-mhvqj" Sep 19 01:45:18.724979 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.724855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5c9z\" (UniqueName: \"kubernetes.io/projected/c8ffff35-10c6-4498-aa52-e26126b3f18b-kube-api-access-h5c9z\") pod \"cert-manager-55b4d954d5-mhvqj\" (UID: \"c8ffff35-10c6-4498-aa52-e26126b3f18b\") " pod="cert-manager/cert-manager-55b4d954d5-mhvqj" Sep 19 01:45:18.734787 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.734763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8ffff35-10c6-4498-aa52-e26126b3f18b-bound-sa-token\") pod \"cert-manager-55b4d954d5-mhvqj\" (UID: \"c8ffff35-10c6-4498-aa52-e26126b3f18b\") " pod="cert-manager/cert-manager-55b4d954d5-mhvqj" Sep 19 01:45:18.734936 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.734847 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5c9z\" (UniqueName: \"kubernetes.io/projected/c8ffff35-10c6-4498-aa52-e26126b3f18b-kube-api-access-h5c9z\") pod \"cert-manager-55b4d954d5-mhvqj\" (UID: \"c8ffff35-10c6-4498-aa52-e26126b3f18b\") " pod="cert-manager/cert-manager-55b4d954d5-mhvqj" Sep 19 01:45:18.800973 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:18.800890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mhvqj" Sep 19 01:45:19.070410 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:19.070268 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mhvqj"] Sep 19 01:45:19.072962 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:45:19.072934 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8ffff35_10c6_4498_aa52_e26126b3f18b.slice/crio-b4a802d4311a545e9e3d79328d76eefe85b3ce14c6b51eb0d0bc84e950f296ca WatchSource:0}: Error finding container b4a802d4311a545e9e3d79328d76eefe85b3ce14c6b51eb0d0bc84e950f296ca: Status 404 returned error can't find the container with id b4a802d4311a545e9e3d79328d76eefe85b3ce14c6b51eb0d0bc84e950f296ca Sep 19 01:45:19.074935 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:19.074915 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:45:20.063104 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:20.063065 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mhvqj" event={"ID":"c8ffff35-10c6-4498-aa52-e26126b3f18b","Type":"ContainerStarted","Data":"b4a802d4311a545e9e3d79328d76eefe85b3ce14c6b51eb0d0bc84e950f296ca"} Sep 19 01:45:23.078970 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:23.078934 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mhvqj" event={"ID":"c8ffff35-10c6-4498-aa52-e26126b3f18b","Type":"ContainerStarted","Data":"8dc810d4d8363b6d0a3b1b8b631bbdb0dc4f2ea64e0308870299e257cae44164"} Sep 19 01:45:23.105270 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:23.105219 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mhvqj" podStartSLOduration=2.139219865 podStartE2EDuration="5.105202795s" totalImagesPullingTime="2.96598293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:23.103669584 +0000 UTC m=+371.169573327" watchObservedRunningTime="2026-09-19 01:45:23.105202795 +0000 UTC m=+371.171106539" Sep 19 01:45:43.142725 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.142686 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm"] Sep 19 01:45:43.145667 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.145649 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.148108 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.148084 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 19 01:45:43.148108 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.148081 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 19 01:45:43.148621 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.148598 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 19 01:45:43.148730 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.148601 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 19 01:45:43.148861 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.148848 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hlcdh\"" Sep 19 01:45:43.207930 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.207899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.208087 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.207941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.208087 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.207961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.208087 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.207984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mhb7\" (UniqueName: \"kubernetes.io/projected/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-kube-api-access-2mhb7\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.208087 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.208031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.272808 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.272774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm"] Sep 19 01:45:43.308672 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.308640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.308672 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.308683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.308921 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.308709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.308921 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.308735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mhb7\" (UniqueName: \"kubernetes.io/projected/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-kube-api-access-2mhb7\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.308921 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.308768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.309236 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.309217 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-manifests\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.311399 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.311333 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-tmp\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.311399 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.311394 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.311574 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.311506 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.320379 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.320329 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mhb7\" (UniqueName: \"kubernetes.io/projected/d095c9c2-a5e7-4bb2-856d-0ff53ded0607-kube-api-access-2mhb7\") pod \"opendatahub-operator-controller-manager-6dbf6995b9-qptrm\" (UID: \"d095c9c2-a5e7-4bb2-856d-0ff53ded0607\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.456361 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.456260 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:43.743650 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:43.743626 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm"] Sep 19 01:45:43.746471 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:45:43.746448 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd095c9c2_a5e7_4bb2_856d_0ff53ded0607.slice/crio-1a6c9fa7bffcf4d5e511b40d83a4bdbe5e45610e0c6dfe659e32807dd1d04dd5 WatchSource:0}: Error finding container 1a6c9fa7bffcf4d5e511b40d83a4bdbe5e45610e0c6dfe659e32807dd1d04dd5: Status 404 returned error can't find the container with id 1a6c9fa7bffcf4d5e511b40d83a4bdbe5e45610e0c6dfe659e32807dd1d04dd5 Sep 19 01:45:44.156612 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:44.156517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" event={"ID":"d095c9c2-a5e7-4bb2-856d-0ff53ded0607","Type":"ContainerStarted","Data":"1a6c9fa7bffcf4d5e511b40d83a4bdbe5e45610e0c6dfe659e32807dd1d04dd5"} Sep 19 01:45:47.171609 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:47.171511 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" event={"ID":"d095c9c2-a5e7-4bb2-856d-0ff53ded0607","Type":"ContainerStarted","Data":"238c3ad301757f0706661a700e7c136747764fa905b31dfd8e4fd2c99c4a37e6"} Sep 19 01:45:48.176434 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:48.176323 2564 generic.go:356] "Generic (PLEG): container finished" podID="d095c9c2-a5e7-4bb2-856d-0ff53ded0607" containerID="238c3ad301757f0706661a700e7c136747764fa905b31dfd8e4fd2c99c4a37e6" exitCode=0 Sep 19 01:45:48.176434 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:48.176415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" event={"ID":"d095c9c2-a5e7-4bb2-856d-0ff53ded0607","Type":"ContainerDied","Data":"238c3ad301757f0706661a700e7c136747764fa905b31dfd8e4fd2c99c4a37e6"} Sep 19 01:45:49.182221 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:49.182184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" event={"ID":"d095c9c2-a5e7-4bb2-856d-0ff53ded0607","Type":"ContainerStarted","Data":"1e417715218ed3aea54a62867121b1de977e648a5943c9ed208d5c0175c2b2f8"} Sep 19 01:45:49.182631 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:49.182306 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:45:49.209264 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:45:49.209217 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" podStartSLOduration=1.765102868 podStartE2EDuration="6.209202953s" totalImagesPullingTime="3.409423053s" totalInitContainerRuntime="1.034677032s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:49.208324267 +0000 UTC m=+397.274228013" watchObservedRunningTime="2026-09-19 01:45:49.209202953 +0000 UTC m=+397.275106696" Sep 19 01:46:00.187934 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.187900 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbf6995b9-qptrm" Sep 19 01:46:00.499841 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.499812 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq"] Sep 19 01:46:00.507098 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.507073 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.509795 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.509772 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 19 01:46:00.510024 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.509999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 19 01:46:00.510145 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.510126 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 19 01:46:00.510213 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.510147 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 19 01:46:00.510213 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.510191 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 19 01:46:00.510318 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.510301 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w27lw\"" Sep 19 01:46:00.512897 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.512873 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq"] Sep 19 01:46:00.547165 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.547134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-manager-config\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.547361 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.547256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-cert\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.547361 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.547303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-metrics-cert\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.547361 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.547325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbmlz\" (UniqueName: \"kubernetes.io/projected/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-kube-api-access-tbmlz\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.648702 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.648661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-cert\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.648702 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.648704 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-metrics-cert\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.648962 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.648721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbmlz\" (UniqueName: \"kubernetes.io/projected/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-kube-api-access-tbmlz\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.648962 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.648754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-manager-config\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.649403 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.649376 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-manager-config\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.651294 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.651275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-metrics-cert\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.651452 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.651433 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-cert\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.660579 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.660556 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbmlz\" (UniqueName: \"kubernetes.io/projected/3af2e101-0c8d-4af9-a4b7-d8eedf2042ff-kube-api-access-tbmlz\") pod \"lws-controller-manager-7fff7c5976-b5jdq\" (UID: \"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff\") " pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:00.818120 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:00.818034 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:01.096189 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:01.096096 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq"] Sep 19 01:46:01.099016 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:46:01.098988 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af2e101_0c8d_4af9_a4b7_d8eedf2042ff.slice/crio-f1a06551e0a16d9e47b4b35af34b25f18d6a46b3c72c28480c3f9234c405ca18 WatchSource:0}: Error finding container f1a06551e0a16d9e47b4b35af34b25f18d6a46b3c72c28480c3f9234c405ca18: Status 404 returned error can't find the container with id f1a06551e0a16d9e47b4b35af34b25f18d6a46b3c72c28480c3f9234c405ca18 Sep 19 01:46:01.228584 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:01.228544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" event={"ID":"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff","Type":"ContainerStarted","Data":"f1a06551e0a16d9e47b4b35af34b25f18d6a46b3c72c28480c3f9234c405ca18"} Sep 19 01:46:04.114061 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.114026 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b"] Sep 19 01:46:04.117748 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.117716 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.122488 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.122408 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 19 01:46:04.122627 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.122514 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 19 01:46:04.123138 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.123114 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qfvlb\"" Sep 19 01:46:04.123276 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.123226 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 19 01:46:04.126609 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.126583 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 19 01:46:04.164055 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.164027 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b"] Sep 19 01:46:04.180988 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.180960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-tmp\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.181151 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.181006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7vw7\" (UniqueName: \"kubernetes.io/projected/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-kube-api-access-j7vw7\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.181151 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.181076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-tls-certs\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.282220 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.282193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-tmp\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.282359 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.282249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vw7\" (UniqueName: \"kubernetes.io/projected/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-kube-api-access-j7vw7\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.282359 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.282304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-tls-certs\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.284577 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.284550 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-tmp\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.285039 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.285005 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-tls-certs\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.345031 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.345004 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vw7\" (UniqueName: \"kubernetes.io/projected/cfb40f50-a158-4d7f-8627-bb9d28b93dd1-kube-api-access-j7vw7\") pod \"kube-auth-proxy-54ff584cbc-2w24b\" (UID: \"cfb40f50-a158-4d7f-8627-bb9d28b93dd1\") " pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.431388 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.431272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" Sep 19 01:46:04.749558 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:46:04.749527 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb40f50_a158_4d7f_8627_bb9d28b93dd1.slice/crio-2564e4ec3f0f91543c59158c4228464965baf4d1957f334f16e4e2d6606bafd3 WatchSource:0}: Error finding container 2564e4ec3f0f91543c59158c4228464965baf4d1957f334f16e4e2d6606bafd3: Status 404 returned error can't find the container with id 2564e4ec3f0f91543c59158c4228464965baf4d1957f334f16e4e2d6606bafd3 Sep 19 01:46:04.751193 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:04.751148 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b"] Sep 19 01:46:05.248096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:05.248062 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" event={"ID":"cfb40f50-a158-4d7f-8627-bb9d28b93dd1","Type":"ContainerStarted","Data":"2564e4ec3f0f91543c59158c4228464965baf4d1957f334f16e4e2d6606bafd3"} Sep 19 01:46:05.249584 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:05.249558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" event={"ID":"3af2e101-0c8d-4af9-a4b7-d8eedf2042ff","Type":"ContainerStarted","Data":"7ebd6835db85b58277f2bd7fa0b14fa721e19c10706bb045c7d95c72e8b744c3"} Sep 19 01:46:05.249699 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:05.249677 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:46:08.268661 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:08.268625 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" event={"ID":"cfb40f50-a158-4d7f-8627-bb9d28b93dd1","Type":"ContainerStarted","Data":"1df588c5a52e2ab95b0987effbbcc1e661c2cbf79c618200331386ea855cbdc4"} Sep 19 01:46:08.293776 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:08.293728 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" podStartSLOduration=5.178236733 podStartE2EDuration="8.293711549s" totalImagesPullingTime="3.115474816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:05.308394466 +0000 UTC m=+413.374298209" watchObservedRunningTime="2026-09-19 01:46:08.293711549 +0000 UTC m=+416.359615295" Sep 19 01:46:08.293956 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:08.293938 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54ff584cbc-2w24b" podStartSLOduration=1.550939461 podStartE2EDuration="4.293933762s" totalImagesPullingTime="2.742994301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:46:08.292593751 +0000 UTC m=+416.358497494" watchObservedRunningTime="2026-09-19 01:46:08.293933762 +0000 UTC m=+416.359837506" Sep 19 01:46:16.259104 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:46:16.259070 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fff7c5976-b5jdq" Sep 19 01:47:51.756595 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.756560 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n"] Sep 19 01:47:51.759593 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.759577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:51.762298 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.762277 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 19 01:47:51.762420 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.762397 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 19 01:47:51.763151 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.763132 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 19 01:47:51.763247 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.763162 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 19 01:47:51.763247 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.763186 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qbctd\"" Sep 19 01:47:51.769954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.769926 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n"] Sep 19 01:47:51.927669 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.927627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjthc\" (UniqueName: \"kubernetes.io/projected/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-kube-api-access-kjthc\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:51.927854 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.927681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:51.927854 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:51.927769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:52.028590 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.028509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjthc\" (UniqueName: \"kubernetes.io/projected/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-kube-api-access-kjthc\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:52.028590 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.028551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:52.028889 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.028738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:52.029144 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.029126 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:52.031225 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.031207 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:52.038282 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.038258 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjthc\" (UniqueName: \"kubernetes.io/projected/37fb41ef-8bc7-47d2-bf1c-cf04b4e50662-kube-api-access-kjthc\") pod \"kuadrant-console-plugin-fbdd4f445-h2f4n\" (UID: \"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:52.068898 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.068871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" Sep 19 01:47:52.345596 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.345569 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n"] Sep 19 01:47:52.348040 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:47:52.348014 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37fb41ef_8bc7_47d2_bf1c_cf04b4e50662.slice/crio-0c1c86b140305b598ae93a057db554188df198126c01dc955f01a0b29c4c5d8b WatchSource:0}: Error finding container 0c1c86b140305b598ae93a057db554188df198126c01dc955f01a0b29c4c5d8b: Status 404 returned error can't find the container with id 0c1c86b140305b598ae93a057db554188df198126c01dc955f01a0b29c4c5d8b Sep 19 01:47:52.709454 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:47:52.709370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" event={"ID":"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662","Type":"ContainerStarted","Data":"0c1c86b140305b598ae93a057db554188df198126c01dc955f01a0b29c4c5d8b"} Sep 19 01:48:03.275174 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.275136 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb"] Sep 19 01:48:03.279558 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.279540 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.285815 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.285792 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sb9jk\"" Sep 19 01:48:03.307841 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.307806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb"] Sep 19 01:48:03.318630 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.318600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc398a80-4258-48ad-8627-25acd02e3746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ql6lb\" (UID: \"dc398a80-4258-48ad-8627-25acd02e3746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.318630 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.318634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrhx7\" (UniqueName: \"kubernetes.io/projected/dc398a80-4258-48ad-8627-25acd02e3746-kube-api-access-xrhx7\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ql6lb\" (UID: \"dc398a80-4258-48ad-8627-25acd02e3746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.420314 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.419842 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc398a80-4258-48ad-8627-25acd02e3746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ql6lb\" (UID: \"dc398a80-4258-48ad-8627-25acd02e3746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.420314 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.419897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrhx7\" (UniqueName: \"kubernetes.io/projected/dc398a80-4258-48ad-8627-25acd02e3746-kube-api-access-xrhx7\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ql6lb\" (UID: \"dc398a80-4258-48ad-8627-25acd02e3746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.420314 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.420249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc398a80-4258-48ad-8627-25acd02e3746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ql6lb\" (UID: \"dc398a80-4258-48ad-8627-25acd02e3746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.442596 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.442562 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb"] Sep 19 01:48:03.442743 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.442644 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb"] Sep 19 01:48:03.442952 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:48:03.442919 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xrhx7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" podUID="dc398a80-4258-48ad-8627-25acd02e3746" Sep 19 01:48:03.445772 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:48:03.445473 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xrhx7 for pod kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb: failed to fetch token: pods "kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" not found Sep 19 01:48:03.445772 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:48:03.445550 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc398a80-4258-48ad-8627-25acd02e3746-kube-api-access-xrhx7 podName:dc398a80-4258-48ad-8627-25acd02e3746 nodeName:}" failed. No retries permitted until 2026-09-19 01:48:03.945529404 +0000 UTC m=+532.011433144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xrhx7" (UniqueName: "kubernetes.io/projected/dc398a80-4258-48ad-8627-25acd02e3746-kube-api-access-xrhx7") pod "kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" (UID: "dc398a80-4258-48ad-8627-25acd02e3746") : failed to fetch token: pods "kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" not found Sep 19 01:48:03.492244 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.492151 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249"] Sep 19 01:48:03.496293 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.496271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.521026 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.520995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvg7m\" (UniqueName: \"kubernetes.io/projected/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-kube-api-access-vvg7m\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-j8249\" (UID: \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.521293 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.521268 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-j8249\" (UID: \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.524841 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.524816 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249"] Sep 19 01:48:03.555183 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.555088 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249"] Sep 19 01:48:03.555447 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:48:03.555421 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-vvg7m], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" podUID="15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9" Sep 19 01:48:03.622042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.622002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-j8249\" (UID: \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.622229 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.622076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvg7m\" (UniqueName: \"kubernetes.io/projected/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-kube-api-access-vvg7m\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-j8249\" (UID: \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.622933 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.622905 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-j8249\" (UID: \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.642750 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.641044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvg7m\" (UniqueName: \"kubernetes.io/projected/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-kube-api-access-vvg7m\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-j8249\" (UID: \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.760891 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.760255 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.760891 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.760644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.762954 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:48:03.762849 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-ql6lb\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" podUID="dc398a80-4258-48ad-8627-25acd02e3746" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.773524 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.773226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:03.775575 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.775477 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.787296 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:48:03.787190 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-ql6lb\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" podUID="dc398a80-4258-48ad-8627-25acd02e3746" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:03.823923 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.823828 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-extensions-socket-volume\") pod \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\" (UID: \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\") " Sep 19 01:48:03.824087 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.823923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc398a80-4258-48ad-8627-25acd02e3746-extensions-socket-volume\") pod \"dc398a80-4258-48ad-8627-25acd02e3746\" (UID: \"dc398a80-4258-48ad-8627-25acd02e3746\") " Sep 19 01:48:03.824087 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.824041 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvg7m\" (UniqueName: \"kubernetes.io/projected/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-kube-api-access-vvg7m\") pod \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\" (UID: \"15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9\") " Sep 19 01:48:03.824208 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.824148 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9" (UID: "15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:48:03.824318 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.824299 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrhx7\" (UniqueName: \"kubernetes.io/projected/dc398a80-4258-48ad-8627-25acd02e3746-kube-api-access-xrhx7\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:48:03.824407 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.824314 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc398a80-4258-48ad-8627-25acd02e3746-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dc398a80-4258-48ad-8627-25acd02e3746" (UID: "dc398a80-4258-48ad-8627-25acd02e3746"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 01:48:03.824407 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.824326 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-extensions-socket-volume\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:48:03.827172 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.827136 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-kube-api-access-vvg7m" (OuterVolumeSpecName: "kube-api-access-vvg7m") pod "15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9" (UID: "15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9"). InnerVolumeSpecName "kube-api-access-vvg7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:48:03.925782 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.925744 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvg7m\" (UniqueName: \"kubernetes.io/projected/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9-kube-api-access-vvg7m\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:48:03.925986 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:03.925828 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc398a80-4258-48ad-8627-25acd02e3746-extensions-socket-volume\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:48:04.375984 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:04.375950 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc398a80-4258-48ad-8627-25acd02e3746" path="/var/lib/kubelet/pods/dc398a80-4258-48ad-8627-25acd02e3746/volumes" Sep 19 01:48:04.765006 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:04.764974 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:04.765198 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:04.764974 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249" Sep 19 01:48:04.771776 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:48:04.771737 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-ql6lb\" is forbidden: User \"system:node:ip-10-0-128-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-63.ec2.internal' and this object" podUID="dc398a80-4258-48ad-8627-25acd02e3746" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ql6lb" Sep 19 01:48:04.803444 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:04.803406 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249"] Sep 19 01:48:04.810728 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:04.810699 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-j8249"] Sep 19 01:48:06.375186 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:06.375158 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9" path="/var/lib/kubelet/pods/15349516-b3a3-4cc3-ad17-a1eb7b6dfcd9/volumes" Sep 19 01:48:07.782091 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:07.782057 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" event={"ID":"37fb41ef-8bc7-47d2-bf1c-cf04b4e50662","Type":"ContainerStarted","Data":"6b1f44d42f9c39a95b183896d04a0a1ddb362ed2dc09a3fe08ddea4dc2d27c5d"} Sep 19 01:48:07.833788 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:07.833740 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-h2f4n" podStartSLOduration=2.010446679 podStartE2EDuration="16.833723259s" totalImagesPullingTime="14.82327658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:07.83313175 +0000 UTC m=+535.899035495" watchObservedRunningTime="2026-09-19 01:48:07.833723259 +0000 UTC m=+535.899627003" Sep 19 01:48:34.488193 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.488154 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:48:34.512579 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.512545 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:48:34.512756 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.512681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:34.514927 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.514894 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 19 01:48:34.515480 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.515459 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:48:34.592243 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.592204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpk4d\" (UniqueName: \"kubernetes.io/projected/428b9f18-a67e-4981-853d-eb16741336df-kube-api-access-kpk4d\") pod \"limitador-limitador-84994f7ffc-6rn4z\" (UID: \"428b9f18-a67e-4981-853d-eb16741336df\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:34.592450 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.592288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/428b9f18-a67e-4981-853d-eb16741336df-config-file\") pod \"limitador-limitador-84994f7ffc-6rn4z\" (UID: \"428b9f18-a67e-4981-853d-eb16741336df\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:34.693252 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.693201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/428b9f18-a67e-4981-853d-eb16741336df-config-file\") pod \"limitador-limitador-84994f7ffc-6rn4z\" (UID: \"428b9f18-a67e-4981-853d-eb16741336df\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:34.693478 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.693267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpk4d\" (UniqueName: \"kubernetes.io/projected/428b9f18-a67e-4981-853d-eb16741336df-kube-api-access-kpk4d\") pod \"limitador-limitador-84994f7ffc-6rn4z\" (UID: \"428b9f18-a67e-4981-853d-eb16741336df\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:34.693834 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.693812 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/428b9f18-a67e-4981-853d-eb16741336df-config-file\") pod \"limitador-limitador-84994f7ffc-6rn4z\" (UID: \"428b9f18-a67e-4981-853d-eb16741336df\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:34.701797 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.701777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpk4d\" (UniqueName: \"kubernetes.io/projected/428b9f18-a67e-4981-853d-eb16741336df-kube-api-access-kpk4d\") pod \"limitador-limitador-84994f7ffc-6rn4z\" (UID: \"428b9f18-a67e-4981-853d-eb16741336df\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:34.823423 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.823310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:34.841885 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.841861 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-85vr7"] Sep 19 01:48:34.845282 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.845263 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" Sep 19 01:48:34.847883 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.847859 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jf5fs\"" Sep 19 01:48:34.859866 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.859841 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-85vr7"] Sep 19 01:48:34.996720 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:34.996689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btt94\" (UniqueName: \"kubernetes.io/projected/efb9f5c3-a350-445a-bf49-f0a4ff7df850-kube-api-access-btt94\") pod \"authorino-7bcfd8f9cd-85vr7\" (UID: \"efb9f5c3-a350-445a-bf49-f0a4ff7df850\") " pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" Sep 19 01:48:35.096068 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:35.095991 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:48:35.097630 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:35.097608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btt94\" (UniqueName: \"kubernetes.io/projected/efb9f5c3-a350-445a-bf49-f0a4ff7df850-kube-api-access-btt94\") pod \"authorino-7bcfd8f9cd-85vr7\" (UID: \"efb9f5c3-a350-445a-bf49-f0a4ff7df850\") " pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" Sep 19 01:48:35.099713 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:48:35.099690 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428b9f18_a67e_4981_853d_eb16741336df.slice/crio-3a74b3189c51afc49878380b7ec63910ebc557fc04de500c18dc424e853a7f10 WatchSource:0}: Error finding container 3a74b3189c51afc49878380b7ec63910ebc557fc04de500c18dc424e853a7f10: Status 404 returned error can't find the container with id 3a74b3189c51afc49878380b7ec63910ebc557fc04de500c18dc424e853a7f10 Sep 19 01:48:35.106436 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:35.106405 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btt94\" (UniqueName: \"kubernetes.io/projected/efb9f5c3-a350-445a-bf49-f0a4ff7df850-kube-api-access-btt94\") pod \"authorino-7bcfd8f9cd-85vr7\" (UID: \"efb9f5c3-a350-445a-bf49-f0a4ff7df850\") " pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" Sep 19 01:48:35.154815 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:35.154773 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" Sep 19 01:48:35.424475 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:35.424447 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-85vr7"] Sep 19 01:48:35.426851 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:48:35.426826 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefb9f5c3_a350_445a_bf49_f0a4ff7df850.slice/crio-0d18f8083e38e47d584df339ff7e1ee742d993c4ae4390f60fec1852d39c8fd5 WatchSource:0}: Error finding container 0d18f8083e38e47d584df339ff7e1ee742d993c4ae4390f60fec1852d39c8fd5: Status 404 returned error can't find the container with id 0d18f8083e38e47d584df339ff7e1ee742d993c4ae4390f60fec1852d39c8fd5 Sep 19 01:48:35.903861 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:35.903819 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" event={"ID":"efb9f5c3-a350-445a-bf49-f0a4ff7df850","Type":"ContainerStarted","Data":"0d18f8083e38e47d584df339ff7e1ee742d993c4ae4390f60fec1852d39c8fd5"} Sep 19 01:48:35.905467 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:35.905441 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" event={"ID":"428b9f18-a67e-4981-853d-eb16741336df","Type":"ContainerStarted","Data":"3a74b3189c51afc49878380b7ec63910ebc557fc04de500c18dc424e853a7f10"} Sep 19 01:48:38.923565 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:38.923519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" event={"ID":"efb9f5c3-a350-445a-bf49-f0a4ff7df850","Type":"ContainerStarted","Data":"cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49"} Sep 19 01:48:38.925141 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:38.925119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" event={"ID":"428b9f18-a67e-4981-853d-eb16741336df","Type":"ContainerStarted","Data":"0ec776fce2c8d8b5232c8e745fec9aa02176df1e08ee7762f217e5d931e8e739"} Sep 19 01:48:38.925228 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:38.925177 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:38.940442 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:38.940397 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" podStartSLOduration=2.3348442289999998 podStartE2EDuration="4.940382128s" totalImagesPullingTime="2.605537899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:38.939237652 +0000 UTC m=+567.005141396" watchObservedRunningTime="2026-09-19 01:48:38.940382128 +0000 UTC m=+567.006285868" Sep 19 01:48:38.961808 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:38.961759 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" podStartSLOduration=2.034149271 podStartE2EDuration="4.961735798s" totalImagesPullingTime="2.927586527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:48:38.960523086 +0000 UTC m=+567.026426822" watchObservedRunningTime="2026-09-19 01:48:38.961735798 +0000 UTC m=+567.027639541" Sep 19 01:48:49.554260 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.554222 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-85vr7"] Sep 19 01:48:49.554689 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.554406 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" podUID="efb9f5c3-a350-445a-bf49-f0a4ff7df850" containerName="authorino" containerID="cri-o://cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49" gracePeriod=30 Sep 19 01:48:49.795287 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.795264 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" Sep 19 01:48:49.822844 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.822779 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btt94\" (UniqueName: \"kubernetes.io/projected/efb9f5c3-a350-445a-bf49-f0a4ff7df850-kube-api-access-btt94\") pod \"efb9f5c3-a350-445a-bf49-f0a4ff7df850\" (UID: \"efb9f5c3-a350-445a-bf49-f0a4ff7df850\") " Sep 19 01:48:49.825144 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.825112 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb9f5c3-a350-445a-bf49-f0a4ff7df850-kube-api-access-btt94" (OuterVolumeSpecName: "kube-api-access-btt94") pod "efb9f5c3-a350-445a-bf49-f0a4ff7df850" (UID: "efb9f5c3-a350-445a-bf49-f0a4ff7df850"). InnerVolumeSpecName "kube-api-access-btt94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:48:49.924691 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.924292 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btt94\" (UniqueName: \"kubernetes.io/projected/efb9f5c3-a350-445a-bf49-f0a4ff7df850-kube-api-access-btt94\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:48:49.931242 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.931217 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6rn4z" Sep 19 01:48:49.974184 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.974149 2564 generic.go:356] "Generic (PLEG): container finished" podID="efb9f5c3-a350-445a-bf49-f0a4ff7df850" containerID="cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49" exitCode=0 Sep 19 01:48:49.974330 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.974200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" event={"ID":"efb9f5c3-a350-445a-bf49-f0a4ff7df850","Type":"ContainerDied","Data":"cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49"} Sep 19 01:48:49.974330 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.974239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" event={"ID":"efb9f5c3-a350-445a-bf49-f0a4ff7df850","Type":"ContainerDied","Data":"0d18f8083e38e47d584df339ff7e1ee742d993c4ae4390f60fec1852d39c8fd5"} Sep 19 01:48:49.974330 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.974206 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-85vr7" Sep 19 01:48:49.974330 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.974260 2564 scope.go:117] "RemoveContainer" containerID="cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49" Sep 19 01:48:49.983037 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.983016 2564 scope.go:117] "RemoveContainer" containerID="cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49" Sep 19 01:48:49.983359 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:48:49.983322 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49\": container with ID starting with cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49 not found: ID does not exist" containerID="cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49" Sep 19 01:48:49.983447 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:49.983368 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49"} err="failed to get container status \"cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49\": rpc error: code = NotFound desc = could not find container \"cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49\": container with ID starting with cceb64fd3182718235738cf7627141ff9c8d1ac67de904d60ce3e8f112bfba49 not found: ID does not exist" Sep 19 01:48:50.003868 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:50.003837 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-85vr7"] Sep 19 01:48:50.007322 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:50.007299 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-85vr7"] Sep 19 01:48:50.373281 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:48:50.373248 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb9f5c3-a350-445a-bf49-f0a4ff7df850" path="/var/lib/kubelet/pods/efb9f5c3-a350-445a-bf49-f0a4ff7df850/volumes" Sep 19 01:49:08.177489 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.177457 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-krfg5"] Sep 19 01:49:08.177962 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.177749 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb9f5c3-a350-445a-bf49-f0a4ff7df850" containerName="authorino" Sep 19 01:49:08.177962 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.177762 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb9f5c3-a350-445a-bf49-f0a4ff7df850" containerName="authorino" Sep 19 01:49:08.177962 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.177820 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb9f5c3-a350-445a-bf49-f0a4ff7df850" containerName="authorino" Sep 19 01:49:08.183810 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.183787 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-krfg5" Sep 19 01:49:08.186446 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.186399 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jf5fs\"" Sep 19 01:49:08.188834 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.188811 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-krfg5"] Sep 19 01:49:08.287174 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.287135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg2jk\" (UniqueName: \"kubernetes.io/projected/b4749673-0bd2-43c1-9dfa-699981fb3b5e-kube-api-access-zg2jk\") pod \"authorino-557f876f69-krfg5\" (UID: \"b4749673-0bd2-43c1-9dfa-699981fb3b5e\") " pod="kuadrant-system/authorino-557f876f69-krfg5" Sep 19 01:49:08.320816 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.320783 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-krfg5"] Sep 19 01:49:08.321062 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:49:08.321037 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zg2jk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-krfg5" podUID="b4749673-0bd2-43c1-9dfa-699981fb3b5e" Sep 19 01:49:08.359922 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.359889 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pfbxz"] Sep 19 01:49:08.369374 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.369326 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:08.371783 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.371762 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 19 01:49:08.376576 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.376522 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pfbxz"] Sep 19 01:49:08.387627 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.387589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg2jk\" (UniqueName: \"kubernetes.io/projected/b4749673-0bd2-43c1-9dfa-699981fb3b5e-kube-api-access-zg2jk\") pod \"authorino-557f876f69-krfg5\" (UID: \"b4749673-0bd2-43c1-9dfa-699981fb3b5e\") " pod="kuadrant-system/authorino-557f876f69-krfg5" Sep 19 01:49:08.395872 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.395851 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg2jk\" (UniqueName: \"kubernetes.io/projected/b4749673-0bd2-43c1-9dfa-699981fb3b5e-kube-api-access-zg2jk\") pod \"authorino-557f876f69-krfg5\" (UID: \"b4749673-0bd2-43c1-9dfa-699981fb3b5e\") " pod="kuadrant-system/authorino-557f876f69-krfg5" Sep 19 01:49:08.430807 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.430728 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pfbxz"] Sep 19 01:49:08.431023 ip-10-0-128-63 kubenswrapper[2564]: E0919 01:49:08.431000 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-826vj tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-826vj tls-cert]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" podUID="0a34101e-6671-45c6-9b6f-763dddaafe7a" Sep 19 01:49:08.466084 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.466055 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5fc5b5b4f9-42jgq"] Sep 19 01:49:08.469796 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.469780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:49:08.479704 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.479683 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fc5b5b4f9-42jgq"] Sep 19 01:49:08.488791 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.488760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a34101e-6671-45c6-9b6f-763dddaafe7a-tls-cert\") pod \"authorino-6d4dfc649f-pfbxz\" (UID: \"0a34101e-6671-45c6-9b6f-763dddaafe7a\") " pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:08.488950 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.488928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-826vj\" (UniqueName: \"kubernetes.io/projected/0a34101e-6671-45c6-9b6f-763dddaafe7a-kube-api-access-826vj\") pod \"authorino-6d4dfc649f-pfbxz\" (UID: \"0a34101e-6671-45c6-9b6f-763dddaafe7a\") " pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:08.589639 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.589594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-826vj\" (UniqueName: \"kubernetes.io/projected/0a34101e-6671-45c6-9b6f-763dddaafe7a-kube-api-access-826vj\") pod \"authorino-6d4dfc649f-pfbxz\" (UID: \"0a34101e-6671-45c6-9b6f-763dddaafe7a\") " pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:08.589639 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.589644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9cfce20-d9cb-4051-97a3-3025e902cef7-tls-cert\") pod \"authorino-5fc5b5b4f9-42jgq\" (UID: \"c9cfce20-d9cb-4051-97a3-3025e902cef7\") " pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:49:08.589852 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.589676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a34101e-6671-45c6-9b6f-763dddaafe7a-tls-cert\") pod \"authorino-6d4dfc649f-pfbxz\" (UID: \"0a34101e-6671-45c6-9b6f-763dddaafe7a\") " pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:08.589852 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.589706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxmxh\" (UniqueName: \"kubernetes.io/projected/c9cfce20-d9cb-4051-97a3-3025e902cef7-kube-api-access-kxmxh\") pod \"authorino-5fc5b5b4f9-42jgq\" (UID: \"c9cfce20-d9cb-4051-97a3-3025e902cef7\") " pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:49:08.592226 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.592196 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a34101e-6671-45c6-9b6f-763dddaafe7a-tls-cert\") pod \"authorino-6d4dfc649f-pfbxz\" (UID: \"0a34101e-6671-45c6-9b6f-763dddaafe7a\") " pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:08.599646 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.599615 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-826vj\" (UniqueName: \"kubernetes.io/projected/0a34101e-6671-45c6-9b6f-763dddaafe7a-kube-api-access-826vj\") pod \"authorino-6d4dfc649f-pfbxz\" (UID: \"0a34101e-6671-45c6-9b6f-763dddaafe7a\") " pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:08.691147 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.691057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9cfce20-d9cb-4051-97a3-3025e902cef7-tls-cert\") pod \"authorino-5fc5b5b4f9-42jgq\" (UID: \"c9cfce20-d9cb-4051-97a3-3025e902cef7\") " pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:49:08.691147 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.691114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxmxh\" (UniqueName: \"kubernetes.io/projected/c9cfce20-d9cb-4051-97a3-3025e902cef7-kube-api-access-kxmxh\") pod \"authorino-5fc5b5b4f9-42jgq\" (UID: \"c9cfce20-d9cb-4051-97a3-3025e902cef7\") " pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:49:08.693815 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.693781 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9cfce20-d9cb-4051-97a3-3025e902cef7-tls-cert\") pod \"authorino-5fc5b5b4f9-42jgq\" (UID: \"c9cfce20-d9cb-4051-97a3-3025e902cef7\") " pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:49:08.700668 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.700648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxmxh\" (UniqueName: \"kubernetes.io/projected/c9cfce20-d9cb-4051-97a3-3025e902cef7-kube-api-access-kxmxh\") pod \"authorino-5fc5b5b4f9-42jgq\" (UID: \"c9cfce20-d9cb-4051-97a3-3025e902cef7\") " pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:49:08.781094 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:08.781061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:49:09.053300 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.053234 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fc5b5b4f9-42jgq"] Sep 19 01:49:09.055978 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:49:09.055950 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9cfce20_d9cb_4051_97a3_3025e902cef7.slice/crio-db169f6869702ab9374cd65d3d2438a7e3821597fe6a1ed724cd261fdb788415 WatchSource:0}: Error finding container db169f6869702ab9374cd65d3d2438a7e3821597fe6a1ed724cd261fdb788415: Status 404 returned error can't find the container with id db169f6869702ab9374cd65d3d2438a7e3821597fe6a1ed724cd261fdb788415 Sep 19 01:49:09.069785 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.069742 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" event={"ID":"c9cfce20-d9cb-4051-97a3-3025e902cef7","Type":"ContainerStarted","Data":"db169f6869702ab9374cd65d3d2438a7e3821597fe6a1ed724cd261fdb788415"} Sep 19 01:49:09.069785 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.069780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:09.069954 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.069787 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-krfg5" Sep 19 01:49:09.078758 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.078738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:09.081143 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.081128 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-krfg5" Sep 19 01:49:09.195145 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.195113 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a34101e-6671-45c6-9b6f-763dddaafe7a-tls-cert\") pod \"0a34101e-6671-45c6-9b6f-763dddaafe7a\" (UID: \"0a34101e-6671-45c6-9b6f-763dddaafe7a\") " Sep 19 01:49:09.195546 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.195166 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-826vj\" (UniqueName: \"kubernetes.io/projected/0a34101e-6671-45c6-9b6f-763dddaafe7a-kube-api-access-826vj\") pod \"0a34101e-6671-45c6-9b6f-763dddaafe7a\" (UID: \"0a34101e-6671-45c6-9b6f-763dddaafe7a\") " Sep 19 01:49:09.195546 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.195215 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg2jk\" (UniqueName: \"kubernetes.io/projected/b4749673-0bd2-43c1-9dfa-699981fb3b5e-kube-api-access-zg2jk\") pod \"b4749673-0bd2-43c1-9dfa-699981fb3b5e\" (UID: \"b4749673-0bd2-43c1-9dfa-699981fb3b5e\") " Sep 19 01:49:09.197319 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.197294 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a34101e-6671-45c6-9b6f-763dddaafe7a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0a34101e-6671-45c6-9b6f-763dddaafe7a" (UID: "0a34101e-6671-45c6-9b6f-763dddaafe7a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:49:09.197407 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.197327 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a34101e-6671-45c6-9b6f-763dddaafe7a-kube-api-access-826vj" (OuterVolumeSpecName: "kube-api-access-826vj") pod "0a34101e-6671-45c6-9b6f-763dddaafe7a" (UID: "0a34101e-6671-45c6-9b6f-763dddaafe7a"). InnerVolumeSpecName "kube-api-access-826vj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:49:09.197407 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.197332 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4749673-0bd2-43c1-9dfa-699981fb3b5e-kube-api-access-zg2jk" (OuterVolumeSpecName: "kube-api-access-zg2jk") pod "b4749673-0bd2-43c1-9dfa-699981fb3b5e" (UID: "b4749673-0bd2-43c1-9dfa-699981fb3b5e"). InnerVolumeSpecName "kube-api-access-zg2jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:49:09.295965 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.295930 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg2jk\" (UniqueName: \"kubernetes.io/projected/b4749673-0bd2-43c1-9dfa-699981fb3b5e-kube-api-access-zg2jk\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:49:09.295965 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.295958 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0a34101e-6671-45c6-9b6f-763dddaafe7a-tls-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:49:09.295965 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:09.295972 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-826vj\" (UniqueName: \"kubernetes.io/projected/0a34101e-6671-45c6-9b6f-763dddaafe7a-kube-api-access-826vj\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:49:10.077412 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.077383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-pfbxz" Sep 19 01:49:10.077412 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.077393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" event={"ID":"c9cfce20-d9cb-4051-97a3-3025e902cef7","Type":"ContainerStarted","Data":"b3f4196796f66ae975f5493704dce303f2d422259e2653ff3439a28065aefb04"} Sep 19 01:49:10.077666 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.077575 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-krfg5" Sep 19 01:49:10.099903 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.099859 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" podStartSLOduration=1.7331643890000001 podStartE2EDuration="2.099842729s" totalImagesPullingTime="366.67834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:49:10.098890163 +0000 UTC m=+598.164793908" watchObservedRunningTime="2026-09-19 01:49:10.099842729 +0000 UTC m=+598.165746473" Sep 19 01:49:10.123920 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.123889 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-krfg5"] Sep 19 01:49:10.135085 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.135055 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-krfg5"] Sep 19 01:49:10.166626 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.166595 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pfbxz"] Sep 19 01:49:10.168807 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.168766 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-pfbxz"] Sep 19 01:49:10.374476 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.374392 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a34101e-6671-45c6-9b6f-763dddaafe7a" path="/var/lib/kubelet/pods/0a34101e-6671-45c6-9b6f-763dddaafe7a/volumes" Sep 19 01:49:10.374921 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:10.374718 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4749673-0bd2-43c1-9dfa-699981fb3b5e" path="/var/lib/kubelet/pods/b4749673-0bd2-43c1-9dfa-699981fb3b5e/volumes" Sep 19 01:49:12.306710 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:12.306678 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:49:12.308769 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:12.308751 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:49:12.314265 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:12.314243 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:49:12.315915 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:12.315900 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:49:54.524790 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:49:54.524740 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:50:19.822160 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:19.822118 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:50:37.918104 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:37.918063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:50:45.723162 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.723126 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh"] Sep 19 01:50:45.725870 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.725855 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.728485 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.728464 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 19 01:50:45.729053 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.729033 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xrctz\"" Sep 19 01:50:45.729152 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.729138 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 19 01:50:45.729337 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.729325 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 19 01:50:45.754458 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.754430 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh"] Sep 19 01:50:45.836231 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.836192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.836410 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.836239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.836410 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.836279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.836410 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.836300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.836410 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.836325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt5md\" (UniqueName: \"kubernetes.io/projected/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-kube-api-access-xt5md\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.836410 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.836399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937108 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt5md\" (UniqueName: \"kubernetes.io/projected/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-kube-api-access-xt5md\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937108 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937388 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937388 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937388 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937388 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937628 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937610 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937690 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937676 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.937749 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.937710 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.939649 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.939624 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.939857 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.939839 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:45.946053 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:45.946028 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt5md\" (UniqueName: \"kubernetes.io/projected/c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0-kube-api-access-xt5md\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh\" (UID: \"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:46.036971 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:46.036878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:46.331294 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:46.331214 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh"] Sep 19 01:50:46.334865 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:50:46.334837 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49e19a0_cc0c_4d09_b36c_ed49fdcd54a0.slice/crio-06dac3b9e7a28bddf77d25e762d97de2e58a99a664a621b696313475ddc39688 WatchSource:0}: Error finding container 06dac3b9e7a28bddf77d25e762d97de2e58a99a664a621b696313475ddc39688: Status 404 returned error can't find the container with id 06dac3b9e7a28bddf77d25e762d97de2e58a99a664a621b696313475ddc39688 Sep 19 01:50:46.336263 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:46.336245 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 01:50:46.501975 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:46.501935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" event={"ID":"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0","Type":"ContainerStarted","Data":"06dac3b9e7a28bddf77d25e762d97de2e58a99a664a621b696313475ddc39688"} Sep 19 01:50:46.719956 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:46.719920 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:50:47.510185 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:47.510146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" event={"ID":"c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0","Type":"ContainerStarted","Data":"54de6d05d7fa0526f042a9ef50e1fa89be660c64ebe2a873b6790ec1457c78a1"} Sep 19 01:50:47.534197 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:47.534142 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" podStartSLOduration=1.459574789 podStartE2EDuration="2.534125575s" totalImagesPullingTime="1.074550786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:50:47.531599232 +0000 UTC m=+695.597502975" watchObservedRunningTime="2026-09-19 01:50:47.534125575 +0000 UTC m=+695.600029320" Sep 19 01:50:52.313110 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:52.313069 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:50:56.037608 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:56.037569 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:56.038082 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:56.037634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:56.050064 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:56.050042 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:50:56.562714 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:50:56.562686 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh" Sep 19 01:51:09.028214 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:09.028098 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:51:25.505251 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.505221 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c"] Sep 19 01:51:25.508548 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.508531 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.511059 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.511031 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 19 01:51:25.517811 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.517787 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c"] Sep 19 01:51:25.593132 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.593086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.593324 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.593151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.593324 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.593182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d49cd12a-878c-4d35-adbf-cd6acc2ea352-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.593324 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.593212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.593324 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.593299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f2fk\" (UniqueName: \"kubernetes.io/projected/d49cd12a-878c-4d35-adbf-cd6acc2ea352-kube-api-access-2f2fk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.593513 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.593364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.694570 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.694534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.694570 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.694574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2fk\" (UniqueName: \"kubernetes.io/projected/d49cd12a-878c-4d35-adbf-cd6acc2ea352-kube-api-access-2f2fk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.694799 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.694608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.694799 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.694649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.694799 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.694693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.694799 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.694722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d49cd12a-878c-4d35-adbf-cd6acc2ea352-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.694997 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.694976 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.695079 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.695062 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.695153 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.695135 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.697173 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.697153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d49cd12a-878c-4d35-adbf-cd6acc2ea352-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.697328 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.697310 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d49cd12a-878c-4d35-adbf-cd6acc2ea352-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.703156 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.703132 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2fk\" (UniqueName: \"kubernetes.io/projected/d49cd12a-878c-4d35-adbf-cd6acc2ea352-kube-api-access-2f2fk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrr4c\" (UID: \"d49cd12a-878c-4d35-adbf-cd6acc2ea352\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:25.819127 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:25.819037 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:26.096912 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:26.096882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c"] Sep 19 01:51:26.099383 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:51:26.099333 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49cd12a_878c_4d35_adbf_cd6acc2ea352.slice/crio-9051201d2f1c2d4e9b3f7b59de469ae1388ce48f4a6dcf0d05bc49f7c66b0992 WatchSource:0}: Error finding container 9051201d2f1c2d4e9b3f7b59de469ae1388ce48f4a6dcf0d05bc49f7c66b0992: Status 404 returned error can't find the container with id 9051201d2f1c2d4e9b3f7b59de469ae1388ce48f4a6dcf0d05bc49f7c66b0992 Sep 19 01:51:26.683548 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:26.683464 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" event={"ID":"d49cd12a-878c-4d35-adbf-cd6acc2ea352","Type":"ContainerStarted","Data":"2704424b4f4fd0ca595a0ba97f0cf8e5187466683fe42eb3df2f0d3d390d1c8c"} Sep 19 01:51:26.683548 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:26.683518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" event={"ID":"d49cd12a-878c-4d35-adbf-cd6acc2ea352","Type":"ContainerStarted","Data":"9051201d2f1c2d4e9b3f7b59de469ae1388ce48f4a6dcf0d05bc49f7c66b0992"} Sep 19 01:51:26.702850 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:26.702788 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" podStartSLOduration=1.4089742109999999 podStartE2EDuration="1.702771598s" totalImagesPullingTime="293.797387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:51:26.701147324 +0000 UTC m=+734.767051069" watchObservedRunningTime="2026-09-19 01:51:26.702771598 +0000 UTC m=+734.768675341" Sep 19 01:51:27.408130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:27.408091 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:51:35.820096 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:35.820062 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:35.820530 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:35.820380 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:35.832726 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:35.832700 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:36.742042 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:36.742013 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrr4c" Sep 19 01:51:42.648614 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.648579 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh"] Sep 19 01:51:42.651648 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.651631 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.659252 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.659232 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 19 01:51:42.704970 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.704941 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh"] Sep 19 01:51:42.751904 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.751867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.751904 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.751906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.752104 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.751932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b910f1-7ad3-4ca8-ab84-17772e29ffac-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.752104 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.752053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.752104 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.752087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.752222 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.752122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhzdz\" (UniqueName: \"kubernetes.io/projected/95b910f1-7ad3-4ca8-ab84-17772e29ffac-kube-api-access-qhzdz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.852567 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.852528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhzdz\" (UniqueName: \"kubernetes.io/projected/95b910f1-7ad3-4ca8-ab84-17772e29ffac-kube-api-access-qhzdz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.852567 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.852572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.852798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.852598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.852798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.852622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b910f1-7ad3-4ca8-ab84-17772e29ffac-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.852798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.852731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.852798 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.852773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.853057 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.853030 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.853111 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.853052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.853174 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.853116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.855162 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.855141 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95b910f1-7ad3-4ca8-ab84-17772e29ffac-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.855435 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.855417 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95b910f1-7ad3-4ca8-ab84-17772e29ffac-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.860441 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.860421 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhzdz\" (UniqueName: \"kubernetes.io/projected/95b910f1-7ad3-4ca8-ab84-17772e29ffac-kube-api-access-qhzdz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh\" (UID: \"95b910f1-7ad3-4ca8-ab84-17772e29ffac\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:42.960809 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:42.960714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:43.231717 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:43.231690 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh"] Sep 19 01:51:43.234158 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:51:43.234128 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95b910f1_7ad3_4ca8_ab84_17772e29ffac.slice/crio-fbbc47ba536aaa3c49bd39f0d031c7998f3adc9fa7a3de6187d95627e2fa4ea2 WatchSource:0}: Error finding container fbbc47ba536aaa3c49bd39f0d031c7998f3adc9fa7a3de6187d95627e2fa4ea2: Status 404 returned error can't find the container with id fbbc47ba536aaa3c49bd39f0d031c7998f3adc9fa7a3de6187d95627e2fa4ea2 Sep 19 01:51:43.763283 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:43.763242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" event={"ID":"95b910f1-7ad3-4ca8-ab84-17772e29ffac","Type":"ContainerStarted","Data":"16ee2d3b5051f6f8a859def7511484921d0144cb2dcb020684aa7d96083700aa"} Sep 19 01:51:43.763686 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:43.763292 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" event={"ID":"95b910f1-7ad3-4ca8-ab84-17772e29ffac","Type":"ContainerStarted","Data":"fbbc47ba536aaa3c49bd39f0d031c7998f3adc9fa7a3de6187d95627e2fa4ea2"} Sep 19 01:51:43.783546 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:43.783496 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" podStartSLOduration=1.5928234799999998 podStartE2EDuration="1.78348027s" totalImagesPullingTime="190.65679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:51:43.781692698 +0000 UTC m=+751.847596442" watchObservedRunningTime="2026-09-19 01:51:43.78348027 +0000 UTC m=+751.849384013" Sep 19 01:51:44.723355 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:44.723320 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6rn4z"] Sep 19 01:51:52.961396 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:52.961337 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:52.961799 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:52.961412 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:52.973807 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:52.973783 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:51:53.825499 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:51:53.825461 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh" Sep 19 01:53:30.123631 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.123584 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5fc5b5b4f9-42jgq"] Sep 19 01:53:30.124239 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.123815 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" podUID="c9cfce20-d9cb-4051-97a3-3025e902cef7" containerName="authorino" containerID="cri-o://b3f4196796f66ae975f5493704dce303f2d422259e2653ff3439a28065aefb04" gracePeriod=30 Sep 19 01:53:30.251112 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.251084 2564 generic.go:356] "Generic (PLEG): container finished" podID="c9cfce20-d9cb-4051-97a3-3025e902cef7" containerID="b3f4196796f66ae975f5493704dce303f2d422259e2653ff3439a28065aefb04" exitCode=0 Sep 19 01:53:30.251241 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.251162 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" event={"ID":"c9cfce20-d9cb-4051-97a3-3025e902cef7","Type":"ContainerDied","Data":"b3f4196796f66ae975f5493704dce303f2d422259e2653ff3439a28065aefb04"} Sep 19 01:53:30.372123 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.372097 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:53:30.494586 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.494556 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxmxh\" (UniqueName: \"kubernetes.io/projected/c9cfce20-d9cb-4051-97a3-3025e902cef7-kube-api-access-kxmxh\") pod \"c9cfce20-d9cb-4051-97a3-3025e902cef7\" (UID: \"c9cfce20-d9cb-4051-97a3-3025e902cef7\") " Sep 19 01:53:30.494586 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.494590 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9cfce20-d9cb-4051-97a3-3025e902cef7-tls-cert\") pod \"c9cfce20-d9cb-4051-97a3-3025e902cef7\" (UID: \"c9cfce20-d9cb-4051-97a3-3025e902cef7\") " Sep 19 01:53:30.496882 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.496846 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cfce20-d9cb-4051-97a3-3025e902cef7-kube-api-access-kxmxh" (OuterVolumeSpecName: "kube-api-access-kxmxh") pod "c9cfce20-d9cb-4051-97a3-3025e902cef7" (UID: "c9cfce20-d9cb-4051-97a3-3025e902cef7"). InnerVolumeSpecName "kube-api-access-kxmxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 01:53:30.505011 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.504988 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9cfce20-d9cb-4051-97a3-3025e902cef7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c9cfce20-d9cb-4051-97a3-3025e902cef7" (UID: "c9cfce20-d9cb-4051-97a3-3025e902cef7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 01:53:30.595811 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.595780 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxmxh\" (UniqueName: \"kubernetes.io/projected/c9cfce20-d9cb-4051-97a3-3025e902cef7-kube-api-access-kxmxh\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:53:30.595811 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:30.595808 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c9cfce20-d9cb-4051-97a3-3025e902cef7-tls-cert\") on node \"ip-10-0-128-63.ec2.internal\" DevicePath \"\"" Sep 19 01:53:31.256314 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:31.256282 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" Sep 19 01:53:31.256314 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:31.256295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc5b5b4f9-42jgq" event={"ID":"c9cfce20-d9cb-4051-97a3-3025e902cef7","Type":"ContainerDied","Data":"db169f6869702ab9374cd65d3d2438a7e3821597fe6a1ed724cd261fdb788415"} Sep 19 01:53:31.256858 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:31.256359 2564 scope.go:117] "RemoveContainer" containerID="b3f4196796f66ae975f5493704dce303f2d422259e2653ff3439a28065aefb04" Sep 19 01:53:31.279408 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:31.279376 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5fc5b5b4f9-42jgq"] Sep 19 01:53:31.286535 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:31.286512 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5fc5b5b4f9-42jgq"] Sep 19 01:53:32.373778 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:53:32.373744 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cfce20-d9cb-4051-97a3-3025e902cef7" path="/var/lib/kubelet/pods/c9cfce20-d9cb-4051-97a3-3025e902cef7/volumes" Sep 19 01:54:06.676429 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:06.676325 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-qptrm_d095c9c2-a5e7-4bb2-856d-0ff53ded0607/copy-manifests/0.log" Sep 19 01:54:06.683569 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:06.683539 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-qptrm_d095c9c2-a5e7-4bb2-856d-0ff53ded0607/manager/0.log" Sep 19 01:54:08.405463 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:08.405432 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-h2f4n_37fb41ef-8bc7-47d2-bf1c-cf04b4e50662/kuadrant-console-plugin/0.log" Sep 19 01:54:08.636791 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:08.636744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6rn4z_428b9f18-a67e-4981-853d-eb16741336df/limitador/0.log" Sep 19 01:54:09.317801 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:09.317775 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54ff584cbc-2w24b_cfb40f50-a158-4d7f-8627-bb9d28b93dd1/kube-auth-proxy/0.log" Sep 19 01:54:10.466488 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:10.466456 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-qqcxh_c49e19a0-cc0c-4d09-b36c-ed49fdcd54a0/main/0.log" Sep 19 01:54:10.810505 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:10.810407 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jrr4c_d49cd12a-878c-4d35-adbf-cd6acc2ea352/main/0.log" Sep 19 01:54:10.932335 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:10.932307 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-g9dvh_95b910f1-7ad3-4ca8-ab84-17772e29ffac/main/0.log" Sep 19 01:54:11.876907 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.876868 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26pck/must-gather-bx8lk"] Sep 19 01:54:11.877269 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.877184 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cfce20-d9cb-4051-97a3-3025e902cef7" containerName="authorino" Sep 19 01:54:11.877269 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.877194 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cfce20-d9cb-4051-97a3-3025e902cef7" containerName="authorino" Sep 19 01:54:11.877385 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.877278 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cfce20-d9cb-4051-97a3-3025e902cef7" containerName="authorino" Sep 19 01:54:11.880130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.880113 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pck/must-gather-bx8lk" Sep 19 01:54:11.882443 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.882422 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26pck\"/\"default-dockercfg-59ng7\"" Sep 19 01:54:11.882839 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.882639 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26pck\"/\"openshift-service-ca.crt\"" Sep 19 01:54:11.882839 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.882690 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26pck\"/\"kube-root-ca.crt\"" Sep 19 01:54:11.889939 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.889919 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pck/must-gather-bx8lk"] Sep 19 01:54:11.956819 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.956786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00e0d451-3d90-4b2b-b1a9-58eaa3419816-must-gather-output\") pod \"must-gather-bx8lk\" (UID: \"00e0d451-3d90-4b2b-b1a9-58eaa3419816\") " pod="openshift-must-gather-26pck/must-gather-bx8lk" Sep 19 01:54:11.956989 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:11.956826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxn69\" (UniqueName: \"kubernetes.io/projected/00e0d451-3d90-4b2b-b1a9-58eaa3419816-kube-api-access-dxn69\") pod \"must-gather-bx8lk\" (UID: \"00e0d451-3d90-4b2b-b1a9-58eaa3419816\") " pod="openshift-must-gather-26pck/must-gather-bx8lk" Sep 19 01:54:12.058082 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.058052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00e0d451-3d90-4b2b-b1a9-58eaa3419816-must-gather-output\") pod \"must-gather-bx8lk\" (UID: \"00e0d451-3d90-4b2b-b1a9-58eaa3419816\") " pod="openshift-must-gather-26pck/must-gather-bx8lk" Sep 19 01:54:12.058082 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.058091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxn69\" (UniqueName: \"kubernetes.io/projected/00e0d451-3d90-4b2b-b1a9-58eaa3419816-kube-api-access-dxn69\") pod \"must-gather-bx8lk\" (UID: \"00e0d451-3d90-4b2b-b1a9-58eaa3419816\") " pod="openshift-must-gather-26pck/must-gather-bx8lk" Sep 19 01:54:12.058439 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.058419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00e0d451-3d90-4b2b-b1a9-58eaa3419816-must-gather-output\") pod \"must-gather-bx8lk\" (UID: \"00e0d451-3d90-4b2b-b1a9-58eaa3419816\") " pod="openshift-must-gather-26pck/must-gather-bx8lk" Sep 19 01:54:12.069521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.069490 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxn69\" (UniqueName: \"kubernetes.io/projected/00e0d451-3d90-4b2b-b1a9-58eaa3419816-kube-api-access-dxn69\") pod \"must-gather-bx8lk\" (UID: \"00e0d451-3d90-4b2b-b1a9-58eaa3419816\") " pod="openshift-must-gather-26pck/must-gather-bx8lk" Sep 19 01:54:12.189466 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.189381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pck/must-gather-bx8lk" Sep 19 01:54:12.335106 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.335078 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:54:12.335382 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.335331 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:54:12.345399 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.345377 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:54:12.345559 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.345542 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvbq9_b3af8c78-dff6-4fc2-9ccc-749dc5fd7bd6/ovn-acl-logging/0.log" Sep 19 01:54:12.493396 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:12.493371 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pck/must-gather-bx8lk"] Sep 19 01:54:12.495938 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:54:12.495908 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00e0d451_3d90_4b2b_b1a9_58eaa3419816.slice/crio-5d873f528e6879593fa02c7e399fd38ee17c60823a5fb83a1ac83d5e16670342 WatchSource:0}: Error finding container 5d873f528e6879593fa02c7e399fd38ee17c60823a5fb83a1ac83d5e16670342: Status 404 returned error can't find the container with id 5d873f528e6879593fa02c7e399fd38ee17c60823a5fb83a1ac83d5e16670342 Sep 19 01:54:13.445638 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:13.445557 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/must-gather-bx8lk" event={"ID":"00e0d451-3d90-4b2b-b1a9-58eaa3419816","Type":"ContainerStarted","Data":"182c9d9615c8956656600511050187418428059d85883da30fa70e26520131f8"} Sep 19 01:54:13.445638 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:13.445597 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/must-gather-bx8lk" event={"ID":"00e0d451-3d90-4b2b-b1a9-58eaa3419816","Type":"ContainerStarted","Data":"f18fb960d364052d0f72133b05296d1ac3797cb0442f1e202fe5454dc7b56b7d"} Sep 19 01:54:13.445638 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:13.445610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/must-gather-bx8lk" event={"ID":"00e0d451-3d90-4b2b-b1a9-58eaa3419816","Type":"ContainerStarted","Data":"5d873f528e6879593fa02c7e399fd38ee17c60823a5fb83a1ac83d5e16670342"} Sep 19 01:54:13.464938 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:13.464870 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26pck/must-gather-bx8lk" podStartSLOduration=1.7901507049999998 podStartE2EDuration="2.464847205s" totalImagesPullingTime="674.6965ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:54:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:54:13.463945649 +0000 UTC m=+901.529849396" watchObservedRunningTime="2026-09-19 01:54:13.464847205 +0000 UTC m=+901.530750950" Sep 19 01:54:14.967677 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:14.967643 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z84pz_57d45a8d-f26e-46fe-b4ae-9885e8c21d37/global-pull-secret-syncer/0.log" Sep 19 01:54:15.106781 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:15.106746 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zrlqx_ccbbb000-17b0-48c6-9ef7-081f00d2129c/konnectivity-agent/0.log" Sep 19 01:54:15.139361 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:15.139318 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-63.ec2.internal_1676bf3cffcb415df1f65bf8ae4005f2/haproxy/0.log" Sep 19 01:54:20.229223 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:20.229172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-h2f4n_37fb41ef-8bc7-47d2-bf1c-cf04b4e50662/kuadrant-console-plugin/0.log" Sep 19 01:54:20.304380 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:20.304332 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6rn4z_428b9f18-a67e-4981-853d-eb16741336df/limitador/0.log" Sep 19 01:54:22.420369 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.420254 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d9cc88bdf-q7v4j_92ca60a6-23af-4e4c-9ab4-124412095383/metrics-server/0.log" Sep 19 01:54:22.569513 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.569480 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nrrh_44a7926d-c14f-444e-a00e-639b4afd1e29/node-exporter/0.log" Sep 19 01:54:22.618698 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.618659 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nrrh_44a7926d-c14f-444e-a00e-639b4afd1e29/kube-rbac-proxy/0.log" Sep 19 01:54:22.649369 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.648573 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9nrrh_44a7926d-c14f-444e-a00e-639b4afd1e29/init-textfile/0.log" Sep 19 01:54:22.878986 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.878955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600fe940-56ab-44e5-9533-566e959aa02c/prometheus/0.log" Sep 19 01:54:22.908625 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.908590 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600fe940-56ab-44e5-9533-566e959aa02c/config-reloader/0.log" Sep 19 01:54:22.936545 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.936496 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600fe940-56ab-44e5-9533-566e959aa02c/thanos-sidecar/0.log" Sep 19 01:54:22.967142 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.967112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600fe940-56ab-44e5-9533-566e959aa02c/kube-rbac-proxy-web/0.log" Sep 19 01:54:22.993268 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:22.993242 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600fe940-56ab-44e5-9533-566e959aa02c/kube-rbac-proxy/0.log" Sep 19 01:54:23.022647 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:23.022606 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600fe940-56ab-44e5-9533-566e959aa02c/kube-rbac-proxy-thanos/0.log" Sep 19 01:54:23.047916 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:23.047884 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_600fe940-56ab-44e5-9533-566e959aa02c/init-config-reloader/0.log" Sep 19 01:54:23.080792 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:23.080705 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-t64cl_65cc017c-c238-447e-83d2-91c6d0e7d202/prometheus-operator/0.log" Sep 19 01:54:23.102474 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:23.102441 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-t64cl_65cc017c-c238-447e-83d2-91c6d0e7d202/kube-rbac-proxy/0.log" Sep 19 01:54:23.136381 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:23.136327 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-zj66f_49d65ae9-7f46-4e14-98a2-c0498f92df83/prometheus-operator-admission-webhook/0.log" Sep 19 01:54:24.574636 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.574593 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-5jxjz_002d92fd-541e-4481-bcb9-a6fd0c9602f2/networking-console-plugin/0.log" Sep 19 01:54:24.671456 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.671415 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj"] Sep 19 01:54:24.677548 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.677517 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.689359 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.689249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj"] Sep 19 01:54:24.691921 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.691889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-proc\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.692030 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.691964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-lib-modules\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.692030 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.692016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-podres\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.692117 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.692062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-sys\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.692117 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.692101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k67fb\" (UniqueName: \"kubernetes.io/projected/e6479831-0955-424f-8212-1d49c71e3132-kube-api-access-k67fb\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.792945 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.792912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k67fb\" (UniqueName: \"kubernetes.io/projected/e6479831-0955-424f-8212-1d49c71e3132-kube-api-access-k67fb\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.793123 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.792967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-proc\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.793123 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.793020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-lib-modules\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.793123 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.793079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-podres\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.793286 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.793126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-sys\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.793286 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.793138 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-proc\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.793286 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.793200 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-sys\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.793286 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.793223 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-podres\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.793521 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.793439 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6479831-0955-424f-8212-1d49c71e3132-lib-modules\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.803299 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.803268 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k67fb\" (UniqueName: \"kubernetes.io/projected/e6479831-0955-424f-8212-1d49c71e3132-kube-api-access-k67fb\") pod \"perf-node-gather-daemonset-wqlsj\" (UID: \"e6479831-0955-424f-8212-1d49c71e3132\") " pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:24.996615 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:24.996576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:25.258130 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:25.258005 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/1.log" Sep 19 01:54:25.265713 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:25.265687 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-lc5nh_ae6411a5-1953-4b5a-a44b-03eeb4d833bd/console-operator/2.log" Sep 19 01:54:25.305483 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:25.305443 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj"] Sep 19 01:54:25.311409 ip-10-0-128-63 kubenswrapper[2564]: W0919 01:54:25.311337 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode6479831_0955_424f_8212_1d49c71e3132.slice/crio-1ef7fd1639486a7ef80e5b7a406302f9bb157af51a3ae5ccb83b2a6526d9c455 WatchSource:0}: Error finding container 1ef7fd1639486a7ef80e5b7a406302f9bb157af51a3ae5ccb83b2a6526d9c455: Status 404 returned error can't find the container with id 1ef7fd1639486a7ef80e5b7a406302f9bb157af51a3ae5ccb83b2a6526d9c455 Sep 19 01:54:25.530881 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:25.530794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" event={"ID":"e6479831-0955-424f-8212-1d49c71e3132","Type":"ContainerStarted","Data":"c6fb22c4ae7fca8bf9c5c91ea535e3aee4531f916e92be49e6ddd096cd29a56b"} Sep 19 01:54:25.530881 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:25.530867 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" event={"ID":"e6479831-0955-424f-8212-1d49c71e3132","Type":"ContainerStarted","Data":"1ef7fd1639486a7ef80e5b7a406302f9bb157af51a3ae5ccb83b2a6526d9c455"} Sep 19 01:54:25.531081 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:25.530953 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:25.549205 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:25.549136 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" podStartSLOduration=1.5491107610000001 podStartE2EDuration="1.549110761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:54:25.547773068 +0000 UTC m=+913.613676812" watchObservedRunningTime="2026-09-19 01:54:25.549110761 +0000 UTC m=+913.615014505" Sep 19 01:54:25.843119 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:25.843011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-pp5zb_974c0136-3e54-465f-abd4-28e8044db26e/download-server/0.log" Sep 19 01:54:27.704767 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:27.704720 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zjk5z_43575c24-a13f-496e-9439-5aecfa3a477e/dns/0.log" Sep 19 01:54:27.730163 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:27.730127 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zjk5z_43575c24-a13f-496e-9439-5aecfa3a477e/kube-rbac-proxy/0.log" Sep 19 01:54:27.757223 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:27.757200 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgzwk_3aaf6e24-c0ae-4d9a-adc5-95a03d983395/dns-node-resolver/0.log" Sep 19 01:54:28.428507 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:28.428454 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mvttq_f652b19d-2016-40dd-8f08-0a7d6e4d1e62/node-ca/0.log" Sep 19 01:54:29.504654 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:29.504611 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54ff584cbc-2w24b_cfb40f50-a158-4d7f-8627-bb9d28b93dd1/kube-auth-proxy/0.log" Sep 19 01:54:30.328434 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:30.328405 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n84hj_27d15022-5125-4ec5-a331-94a8885c003a/serve-healthcheck-canary/0.log" Sep 19 01:54:31.077425 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:31.077386 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6dc_31fc2811-c700-4742-a015-8c6ca2d7c53d/kube-rbac-proxy/0.log" Sep 19 01:54:31.104014 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:31.103984 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6dc_31fc2811-c700-4742-a015-8c6ca2d7c53d/exporter/0.log" Sep 19 01:54:31.135003 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:31.134965 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6dc_31fc2811-c700-4742-a015-8c6ca2d7c53d/extractor/0.log" Sep 19 01:54:31.553368 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:31.552526 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-26pck/perf-node-gather-daemonset-wqlsj" Sep 19 01:54:33.687275 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:33.687169 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-qptrm_d095c9c2-a5e7-4bb2-856d-0ff53ded0607/manager/0.log" Sep 19 01:54:33.710453 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:33.710421 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbf6995b9-qptrm_d095c9c2-a5e7-4bb2-856d-0ff53ded0607/copy-manifests/0.log" Sep 19 01:54:35.174707 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:35.174679 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fff7c5976-b5jdq_3af2e101-0c8d-4af9-a4b7-d8eedf2042ff/manager/0.log" Sep 19 01:54:35.753426 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:35.753386 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54ff584cbc-2w24b_cfb40f50-a158-4d7f-8627-bb9d28b93dd1/kube-auth-proxy/0.log" Sep 19 01:54:37.016669 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:37.016638 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54ff584cbc-2w24b_cfb40f50-a158-4d7f-8627-bb9d28b93dd1/kube-auth-proxy/0.log" Sep 19 01:54:40.713127 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:40.713096 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-hkv2p_0d13f650-fdc9-44f8-92d6-d0ed0019e5a1/kube-storage-version-migrator-operator/1.log" Sep 19 01:54:40.714795 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:40.714772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-hkv2p_0d13f650-fdc9-44f8-92d6-d0ed0019e5a1/kube-storage-version-migrator-operator/0.log" Sep 19 01:54:41.903612 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:41.903535 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8spjh_7e659224-116c-4447-9bc1-463998af3d79/kube-multus/0.log" Sep 19 01:54:41.928532 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:41.928508 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6rt9g_1f24796a-8c91-4070-9e1b-9a4d038ab457/kube-multus-additional-cni-plugins/0.log" Sep 19 01:54:41.954027 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:41.953993 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6rt9g_1f24796a-8c91-4070-9e1b-9a4d038ab457/egress-router-binary-copy/0.log" Sep 19 01:54:41.979084 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:41.979056 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6rt9g_1f24796a-8c91-4070-9e1b-9a4d038ab457/cni-plugins/0.log" Sep 19 01:54:42.008674 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:42.008639 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6rt9g_1f24796a-8c91-4070-9e1b-9a4d038ab457/bond-cni-plugin/0.log" Sep 19 01:54:42.033338 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:42.033312 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6rt9g_1f24796a-8c91-4070-9e1b-9a4d038ab457/routeoverride-cni/0.log" Sep 19 01:54:42.056671 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:42.056633 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6rt9g_1f24796a-8c91-4070-9e1b-9a4d038ab457/whereabouts-cni-bincopy/0.log" Sep 19 01:54:42.081851 ip-10-0-128-63 kubenswrapper[2564]: I0919 01:54:42.081827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6rt9g_1f24796a-8c91-4070-9e1b-9a4d038ab457/whereabouts-cni/0.log"