Sep 17 03:10:39.728734 ip-10-0-141-105 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 03:10:39.728747 ip-10-0-141-105 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 03:10:39.728755 ip-10-0-141-105 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 03:10:39.728905 ip-10-0-141-105 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 03:10:49.794750 ip-10-0-141-105 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 03:10:49.794767 ip-10-0-141-105 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2d92617df98e40bc88670c3a734f23a9 -- Sep 17 03:12:38.934067 ip-10-0-141-105 systemd[1]: Starting Kubernetes Kubelet... Sep 17 03:12:39.306561 ip-10-0-141-105 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:39.306561 ip-10-0-141-105 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 03:12:39.306561 ip-10-0-141-105 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:39.306561 ip-10-0-141-105 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 03:12:39.306561 ip-10-0-141-105 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:12:39.307558 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.307475 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 03:12:39.311340 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311325 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:39.311340 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311340 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311345 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311348 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311352 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311354 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311357 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311360 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311363 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311368 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311371 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311374 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311377 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311379 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311383 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311386 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311389 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311392 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311395 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311398 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311401 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:39.311402 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311404 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311406 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311410 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311413 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311416 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311419 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311422 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311424 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311427 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311430 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311433 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311436 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311438 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311441 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311443 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311446 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311448 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311451 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311454 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311457 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:39.311898 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311459 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311461 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311464 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311466 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311469 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311471 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311473 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311476 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311478 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311481 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311483 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311485 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311488 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311490 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311495 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311499 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311503 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311507 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311511 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:39.312472 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311514 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311516 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311519 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311522 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311525 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311528 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311530 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311533 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311535 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311538 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311540 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311543 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311546 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311548 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311551 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311553 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311555 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311558 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311560 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:39.312958 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311563 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311565 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311568 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311570 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311572 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311575 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311577 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311581 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311584 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311586 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311589 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311591 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311594 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311597 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311599 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311602 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311604 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311606 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311609 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:39.313441 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.311611 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313591 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313600 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313603 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313607 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313610 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313613 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313615 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313618 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313621 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313623 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313626 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313630 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313634 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313637 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313640 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313642 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313645 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313647 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313650 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:39.313909 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313653 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313655 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313658 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313660 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313663 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313666 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313668 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313670 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313673 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313676 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313678 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313680 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313683 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313685 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313689 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313691 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313694 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313696 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313698 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313701 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:39.314393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313704 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313707 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313709 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313712 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313714 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313717 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313734 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313737 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313739 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313742 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313744 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313747 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313750 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313753 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313755 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313758 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313760 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313763 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313767 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313771 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:39.314887 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313775 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313778 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313781 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313783 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313787 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313790 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313794 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313797 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313800 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313802 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313805 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313807 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313810 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313813 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313815 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313818 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313820 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313823 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313825 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:39.315376 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313828 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313830 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313832 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313835 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313838 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313840 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313843 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313845 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313847 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313850 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313852 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313855 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313858 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313861 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313863 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313866 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313868 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313871 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313873 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:39.315854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313876 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.313879 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314261 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314266 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314269 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314272 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314276 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314279 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314283 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314288 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314291 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314294 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314297 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314300 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314303 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314306 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314308 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314311 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314313 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:39.316319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314316 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314319 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314321 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314324 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314326 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314329 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314332 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314335 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314337 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314340 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314342 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314344 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314347 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314350 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314352 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314355 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314358 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314360 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314363 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314365 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:39.316802 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314368 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314371 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314373 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314376 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314378 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314380 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314383 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314386 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314389 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314391 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314393 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314396 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314399 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314401 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314404 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314406 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314409 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314412 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314414 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314417 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:39.317269 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314419 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314422 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314424 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314426 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314429 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314432 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314435 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314438 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314441 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314444 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314446 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314448 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314450 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314453 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314456 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314459 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314461 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314463 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314466 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:39.317765 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314468 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314470 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314473 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314475 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314477 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314480 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314482 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314485 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314488 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314492 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314495 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314497 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314500 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314502 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314505 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314508 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314512 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314514 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314517 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314519 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:39.318245 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314522 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314524 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.314527 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314590 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314621 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314628 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314632 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314637 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314640 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314645 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314649 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314652 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314655 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314658 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314661 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314664 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314667 2579 flags.go:64] FLAG: --cgroup-root="" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314670 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314673 2579 flags.go:64] FLAG: --client-ca-file="" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314675 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314678 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314684 2579 flags.go:64] FLAG: --cluster-domain="" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314687 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 03:12:39.318737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314690 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314693 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314696 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314700 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314702 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314705 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314708 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314711 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314714 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314717 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314733 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314736 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314748 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314751 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314753 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314757 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314760 2579 flags.go:64] FLAG: --enable-server="true" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314763 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314767 2579 flags.go:64] FLAG: --event-burst="100" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314770 2579 flags.go:64] FLAG: --event-qps="50" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314773 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314776 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314779 2579 flags.go:64] FLAG: --eviction-hard="" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314783 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 03:12:39.319282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314785 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314788 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314791 2579 flags.go:64] FLAG: --eviction-soft="" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314794 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314797 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314800 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314804 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314807 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314810 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314812 2579 flags.go:64] FLAG: --feature-gates="" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314816 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314819 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314822 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314825 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314828 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314831 2579 flags.go:64] FLAG: --help="false" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314834 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314837 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314840 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314842 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314846 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314849 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314852 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 03:12:39.319873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314856 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314859 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314862 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314865 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314869 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314872 2579 flags.go:64] FLAG: --kube-reserved="" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314874 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314877 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314880 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314883 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314885 2579 flags.go:64] FLAG: --lock-file="" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314888 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314891 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314894 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314899 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314904 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314907 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314910 2579 flags.go:64] FLAG: --logging-format="text" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314912 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314916 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314919 2579 flags.go:64] FLAG: --manifest-url="" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314921 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314929 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314932 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314937 2579 flags.go:64] FLAG: --max-pods="110" Sep 17 03:12:39.320448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314940 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314943 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314945 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314949 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314951 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314954 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314957 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314965 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314968 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314971 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314974 2579 flags.go:64] FLAG: --pod-cidr="" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314980 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314986 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314989 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314992 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314995 2579 flags.go:64] FLAG: --port="10250" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.314998 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315001 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a1f40c54382b530e" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315003 2579 flags.go:64] FLAG: --qos-reserved="" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315006 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315009 2579 flags.go:64] FLAG: --register-node="true" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315012 2579 flags.go:64] FLAG: --register-with-taints="" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315015 2579 flags.go:64] FLAG: --registry-burst="10" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315019 2579 flags.go:64] FLAG: --registry-qps="5" Sep 17 03:12:39.321091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315022 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315025 2579 flags.go:64] FLAG: --reserved-memory="" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315028 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315031 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315034 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315037 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315040 2579 flags.go:64] FLAG: --runonce="false" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315042 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315046 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315049 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315051 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315054 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315057 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315060 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315063 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315067 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315070 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315072 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315075 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315078 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315082 2579 flags.go:64] FLAG: --system-cgroups="" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315085 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315090 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315093 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315095 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 03:12:39.321711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315099 2579 flags.go:64] FLAG: --tls-min-version="" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315102 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315105 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315107 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315110 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315113 2579 flags.go:64] FLAG: --v="2" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315117 2579 flags.go:64] FLAG: --version="false" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315121 2579 flags.go:64] FLAG: --vmodule="" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315125 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.315128 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315249 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315252 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315255 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315259 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315262 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315265 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315267 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315270 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315272 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315283 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315287 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315290 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:39.322562 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315294 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315297 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315300 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315302 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315305 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315307 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315316 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315319 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315321 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315324 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315326 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315329 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315331 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315334 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315336 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315339 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315343 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315345 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315348 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315350 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:39.323509 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315353 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315355 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315358 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315360 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315363 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315365 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315368 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315370 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315373 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315375 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315378 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315380 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315384 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315387 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315389 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315392 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315394 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315397 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315399 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:39.324393 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315402 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315405 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315408 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315411 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315415 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315418 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315420 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315423 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315426 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315430 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315432 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315435 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315437 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315440 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315442 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315445 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315447 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315450 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315453 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:39.325202 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315455 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315458 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315460 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315462 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315465 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315468 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315471 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315474 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315477 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315479 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315482 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315484 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315487 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315489 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315493 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315495 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315498 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315501 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315504 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315506 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:39.325907 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315508 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315511 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315514 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315518 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315521 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315524 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315527 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315530 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.315533 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.316189 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.325399 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.325419 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.326148 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 03:12:39.326627 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.326167 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326918 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326929 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326933 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326935 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326938 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326941 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326944 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326947 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326950 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326952 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326955 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326958 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326961 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326963 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326966 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326968 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326971 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326975 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326979 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:39.327079 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326982 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326985 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326988 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326991 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326993 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326996 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.326999 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327002 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327004 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327007 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327010 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327013 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327019 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327022 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327025 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327028 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327031 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327033 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327036 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327039 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:39.327789 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327041 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327044 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327046 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327049 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327051 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327054 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327056 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327059 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327061 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327064 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327066 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327069 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327071 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327074 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327077 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327079 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327082 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327085 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327087 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327090 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:39.328291 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327093 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327096 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327098 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327101 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327103 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327106 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327109 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327112 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327114 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327118 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327121 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327124 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327127 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327129 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327132 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327134 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327137 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327140 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327142 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327145 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:39.328838 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327147 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327150 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327153 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327155 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327158 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327160 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327163 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327165 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327168 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327170 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327173 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327177 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327180 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327182 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327185 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327187 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327190 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327192 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327196 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:39.329319 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327198 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.327204 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327349 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327354 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327358 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327360 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327363 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327366 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327368 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327371 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327373 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327376 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327380 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327384 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:12:39.329795 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327387 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327390 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327393 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327395 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327398 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327401 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327403 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327406 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327408 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327411 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327413 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327415 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327418 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327420 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327423 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327425 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327428 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327431 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327434 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327437 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:12:39.330141 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327439 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327442 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327444 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327447 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327449 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327452 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327454 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327458 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327461 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327463 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327466 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327469 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327471 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327474 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327477 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327479 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327482 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327484 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327486 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:12:39.330657 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327489 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327492 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327494 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327497 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327499 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327502 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327505 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327507 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327509 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327512 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327515 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327518 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327520 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327523 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327525 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327528 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327530 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327533 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327536 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327538 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:12:39.331157 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327540 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327543 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327545 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327548 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327550 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327553 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327555 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327558 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327561 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327563 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327566 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327569 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327571 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327573 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327576 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327578 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327581 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327583 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327587 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:12:39.331641 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327590 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327593 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327595 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327598 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327601 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327604 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327606 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327609 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:39.327612 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.327616 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.327746 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.330071 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.330925 2579 server.go:1019] "Starting client certificate rotation" Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.331025 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:12:39.332118 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.331059 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:12:39.333195 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.333180 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:12:39.335181 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.335164 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:12:39.347598 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.347581 2579 log.go:25] "Validated CRI v1 runtime API" Sep 17 03:12:39.350566 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.350552 2579 log.go:25] "Validated CRI v1 image API" Sep 17 03:12:39.352809 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.352794 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 03:12:39.356442 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.356414 2579 fs.go:135] Filesystem UUIDs: map[182deca3-27e7-4d67-b7b9-803e1ff66dd3:/dev/nvme0n1p4 615aeb59-9d99-4e8c-8f43-a7072e64fd5f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 17 03:12:39.356504 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.356440 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 03:12:39.358472 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.358448 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:12:39.362056 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.361947 2579 manager.go:216] Machine: {Timestamp:2026-09-17 03:12:39.35993956 +0000 UTC m=+0.309053810 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101073 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec264f646a3ee2d4c3dcd81db76eed44 SystemUUID:ec264f64-6a3e-e2d4-c3dc-d81db76eed44 BootID:2d92617d-f98e-40bc-8867-0c3a734f23a9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:0b:22:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:0b:22:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:31:5e:20:dd:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 03:12:39.362056 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.362049 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 03:12:39.362186 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.362124 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 03:12:39.365207 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.365181 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 03:12:39.365368 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.365212 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 03:12:39.365972 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.365960 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 03:12:39.366037 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.365978 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 03:12:39.366037 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.365988 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:12:39.366611 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.366600 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:12:39.367638 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.367626 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 03:12:39.371808 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.371794 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:12:39.371934 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.371923 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 03:12:39.371998 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.371964 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 17 03:12:39.371998 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.371978 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 03:12:39.371998 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.371998 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 03:12:39.372115 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.372013 2579 kubelet.go:398] "Adding apiserver pod source" Sep 17 03:12:39.372115 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.372026 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 03:12:39.373014 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.372987 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:12:39.373091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.373019 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:12:39.376039 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.376015 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 03:12:39.378438 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.378422 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 03:12:39.378504 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.378453 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 03:12:39.380163 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380150 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 03:12:39.380228 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380168 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 03:12:39.380228 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380174 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 03:12:39.380228 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380181 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 03:12:39.380228 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380195 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 03:12:39.380228 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380202 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 03:12:39.380228 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380216 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 03:12:39.380228 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380221 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 03:12:39.380228 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380228 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 03:12:39.380510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380234 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 03:12:39.380510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380243 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 03:12:39.380510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.380248 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 03:12:39.381150 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.381138 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 03:12:39.381150 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.381148 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 03:12:39.382883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.382866 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sm86k" Sep 17 03:12:39.384179 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.384160 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 03:12:39.384878 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.384855 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 03:12:39.384948 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.384856 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 03:12:39.384990 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.384975 2579 server.go:1268] "Started kubelet" Sep 17 03:12:39.385078 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.385053 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 03:12:39.385266 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.385100 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 03:12:39.385514 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.385478 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 03:12:39.385989 ip-10-0-141-105 systemd[1]: Started Kubernetes Kubelet. Sep 17 03:12:39.387340 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.387283 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 17 03:12:39.389584 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.389567 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 03:12:39.391544 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.391519 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sm86k" Sep 17 03:12:39.392114 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.392091 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 03:12:39.394378 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.393587 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-105.ec2.internal.18d5fd2451ef9d2c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-105.ec2.internal,UID:ip-10-0-141-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-105.ec2.internal,},FirstTimestamp:2026-09-17 03:12:39.384948012 +0000 UTC m=+0.334062262,LastTimestamp:2026-09-17 03:12:39.384948012 +0000 UTC m=+0.334062262,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-105.ec2.internal,}" Sep 17 03:12:39.395450 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.395429 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 03:12:39.396033 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.395973 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 03:12:39.396621 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.396599 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:39.397322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.397304 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 03:12:39.397405 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.397327 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 03:12:39.397452 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.397304 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 03:12:39.397497 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.397452 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 17 03:12:39.397497 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.397459 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 17 03:12:39.398536 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.398521 2579 factory.go:153] Registering CRI-O factory Sep 17 03:12:39.398536 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.398538 2579 factory.go:223] Registration of the crio container factory successfully Sep 17 03:12:39.398683 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.398612 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 03:12:39.398683 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.398633 2579 factory.go:55] Registering systemd factory Sep 17 03:12:39.398683 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.398641 2579 factory.go:223] Registration of the systemd container factory successfully Sep 17 03:12:39.398683 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.398658 2579 factory.go:103] Registering Raw factory Sep 17 03:12:39.398683 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.398654 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 03:12:39.398683 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.398671 2579 manager.go:1196] Started watching for new ooms in manager Sep 17 03:12:39.398912 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.398707 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 03:12:39.399509 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.399497 2579 manager.go:349] Starting recovery of all containers Sep 17 03:12:39.411444 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.411420 2579 manager.go:354] Recovery completed Sep 17 03:12:39.416401 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.416388 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:39.418385 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.418369 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:39.418448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.418402 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:39.418448 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.418416 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:39.419032 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.419016 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 03:12:39.419032 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.419030 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 03:12:39.419136 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.419035 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:39.419136 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.419049 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:12:39.419709 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.419695 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:39.419775 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.419737 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:39.419775 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.419748 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:39.421201 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.421189 2579 policy_none.go:49] "None policy: Start" Sep 17 03:12:39.421250 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.421204 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 03:12:39.421250 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.421215 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 03:12:39.423419 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.423408 2579 policy_none.go:47] "Start" Sep 17 03:12:39.458317 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.458301 2579 manager.go:337] "Starting Device Plugin manager" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.458336 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.458347 2579 server.go:87] "Starting device plugin registration server" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.458640 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.458653 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.458894 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.458989 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.458998 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.459345 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 03:12:39.480242 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.459392 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:39.493680 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.493649 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 03:12:39.494903 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.494887 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 03:12:39.494964 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.494932 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 03:12:39.494964 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.494952 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 03:12:39.495050 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.494996 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 03:12:39.496970 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.496955 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:39.559140 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.559078 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:39.560086 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.560055 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:39.560086 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.560089 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:39.560237 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.560106 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:39.560237 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.560140 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.566051 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.566035 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.566109 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.566060 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-105.ec2.internal\": node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:39.579886 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.579865 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:39.595451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.595409 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"] Sep 17 03:12:39.595521 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.595501 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:39.596347 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.596333 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:39.596415 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.596362 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:39.596415 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.596372 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:39.598660 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.598648 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:39.598782 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.598767 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.598820 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.598797 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:39.599390 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.599377 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:39.599390 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.599386 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:39.599501 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.599402 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:39.599501 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.599404 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:39.599501 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.599412 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:39.599501 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.599414 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:39.601614 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.601597 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.601683 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.601625 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:12:39.602346 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.602321 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:12:39.602424 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.602350 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:12:39.602424 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.602365 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:12:39.631387 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.631361 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-105.ec2.internal\" not found" node="ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.635803 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.635786 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-105.ec2.internal\" not found" node="ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.680144 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.680122 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:39.698768 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.698736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/466709fffb065514ddf1d3dfe2c8d5d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"466709fffb065514ddf1d3dfe2c8d5d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.698874 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.698775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9ea5fe55135c7b1e5541fdd12fac4be-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"c9ea5fe55135c7b1e5541fdd12fac4be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.698874 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.698801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/466709fffb065514ddf1d3dfe2c8d5d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"466709fffb065514ddf1d3dfe2c8d5d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.781189 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.781167 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:39.799542 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.799521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/466709fffb065514ddf1d3dfe2c8d5d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"466709fffb065514ddf1d3dfe2c8d5d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.799619 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.799546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/466709fffb065514ddf1d3dfe2c8d5d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"466709fffb065514ddf1d3dfe2c8d5d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.799619 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.799571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9ea5fe55135c7b1e5541fdd12fac4be-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"c9ea5fe55135c7b1e5541fdd12fac4be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.799619 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.799598 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9ea5fe55135c7b1e5541fdd12fac4be-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"c9ea5fe55135c7b1e5541fdd12fac4be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.799717 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.799620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/466709fffb065514ddf1d3dfe2c8d5d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"466709fffb065514ddf1d3dfe2c8d5d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.799717 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.799620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/466709fffb065514ddf1d3dfe2c8d5d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"466709fffb065514ddf1d3dfe2c8d5d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.882012 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.881943 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:39.934491 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.934457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.939007 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:39.938992 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Sep 17 03:12:39.982893 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:39.982866 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:40.083482 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:40.083440 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:40.183992 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:40.183925 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:40.284529 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:40.284497 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:40.330955 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.330920 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 03:12:40.331373 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.331072 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 03:12:40.351124 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.351105 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:40.384913 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:40.384887 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Sep 17 03:12:40.396877 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.396847 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 03:07:40 +0000 UTC" deadline="2028-05-06 12:07:16.036838704 +0000 UTC" Sep 17 03:12:40.396877 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.396875 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14336h54m35.639966535s" Sep 17 03:12:40.484805 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.484711 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:40.497715 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.497691 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Sep 17 03:12:40.509444 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.509431 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:12:40.511022 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.511010 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Sep 17 03:12:40.523051 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.523026 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:12:40.700331 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:40.700294 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466709fffb065514ddf1d3dfe2c8d5d2.slice/crio-0d6586b3684be4d268d1491c87de91a7396734fdd2e3ccc597676e78ace7cbf4 WatchSource:0}: Error finding container 0d6586b3684be4d268d1491c87de91a7396734fdd2e3ccc597676e78ace7cbf4: Status 404 returned error can't find the container with id 0d6586b3684be4d268d1491c87de91a7396734fdd2e3ccc597676e78ace7cbf4 Sep 17 03:12:40.700587 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:40.700564 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ea5fe55135c7b1e5541fdd12fac4be.slice/crio-2c14b04f03baa0f27cc76da021e55d63acc5fd1e71ae6fa533d3e307bf0307e4 WatchSource:0}: Error finding container 2c14b04f03baa0f27cc76da021e55d63acc5fd1e71ae6fa533d3e307bf0307e4: Status 404 returned error can't find the container with id 2c14b04f03baa0f27cc76da021e55d63acc5fd1e71ae6fa533d3e307bf0307e4 Sep 17 03:12:40.704190 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:40.704177 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:12:42.328078 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.328049 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:42.781136 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.781098 2579 apiserver.go:52] "Watching apiserver" Sep 17 03:12:42.791514 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.791486 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 03:12:42.792012 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.791987 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-j76qf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal","openshift-network-operator/iptables-alerter-7bm7h","kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8","openshift-cluster-node-tuning-operator/tuned-j8k7z","openshift-multus/multus-additional-cni-plugins-mdgpz","openshift-multus/multus-qsllp","openshift-multus/network-metrics-daemon-rxmmr","openshift-network-diagnostics/network-check-target-b8ns5","openshift-ovn-kubernetes/ovnkube-node-g2dhb","kube-system/global-pull-secret-syncer-lqn4s","kube-system/konnectivity-agent-b2jc4","openshift-dns/node-resolver-zhp9t"] Sep 17 03:12:42.794772 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.794749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.797503 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.797479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:42.797623 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:42.797553 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:42.797697 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.797636 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qtz4w\"" Sep 17 03:12:42.797995 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.797972 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 03:12:42.798155 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.797974 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:12:42.799754 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.799735 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.802386 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.802269 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.804510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.803758 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 03:12:42.804510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.803901 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 03:12:42.804510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.804099 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 03:12:42.804510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.804249 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 03:12:42.804510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.804403 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mx645\"" Sep 17 03:12:42.805075 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.804564 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 03:12:42.805075 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.804731 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 03:12:42.805075 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.804953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.805300 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.805202 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 03:12:42.805671 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.805348 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5v6l5\"" Sep 17 03:12:42.805671 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.805419 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 03:12:42.805671 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.805514 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 03:12:42.812798 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.812775 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.813418 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.813396 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 03:12:42.813418 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.813417 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 03:12:42.813536 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.813505 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m7ndm\"" Sep 17 03:12:42.814092 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.813855 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 03:12:42.815391 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.815133 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.817354 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb6bk\" (UniqueName: \"kubernetes.io/projected/b593d1c3-6930-4400-b8b8-7d7783c21668-kube-api-access-mb6bk\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:42.817449 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5s96\" (UniqueName: \"kubernetes.io/projected/d9b6cd63-218c-4533-b9cf-76a68e8547ff-kube-api-access-f5s96\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.817449 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-kubernetes\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.817449 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-host\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.817449 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817444 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/363bb925-3859-4c95-9249-5af01eaebcca-tmp\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xqxc\" (UniqueName: \"kubernetes.io/projected/363bb925-3859-4c95-9249-5af01eaebcca-kube-api-access-6xqxc\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817488 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-etc-selinux\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-sys-fs\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9b6cd63-218c-4533-b9cf-76a68e8547ff-host-slash\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-socket-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-lib-modules\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.817647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/363bb925-3859-4c95-9249-5af01eaebcca-etc-tuned\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr5qb\" (UniqueName: \"kubernetes.io/projected/77feac74-a94d-4526-8b10-1ba3dc52ad02-kube-api-access-tr5qb\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysconfig\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817692 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysctl-d\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-sys\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-system-cni-dir\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817763 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817771 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-device-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysctl-conf\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817861 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-var-lib-kubelet\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49aaad79-7f59-4a60-99e4-b5d9007b6a85-host\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.817954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djlwg\" (UniqueName: \"kubernetes.io/projected/49aaad79-7f59-4a60-99e4-b5d9007b6a85-kube-api-access-djlwg\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.818088 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkmtl\" (UniqueName: \"kubernetes.io/projected/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-kube-api-access-jkmtl\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-modprobe-d\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-systemd\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cnibin\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-registration-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49aaad79-7f59-4a60-99e4-b5d9007b6a85-serviceca\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-run\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9b6cd63-218c-4533-b9cf-76a68e8547ff-iptables-alerter-script\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.818724 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:42.818796 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:42.818774 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:42.819399 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.819072 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 03:12:42.819399 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.819299 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 03:12:42.819399 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.819348 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n6j98\"" Sep 17 03:12:42.819643 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.819622 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 03:12:42.819722 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.819698 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.819776 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.819760 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jcvgx\"" Sep 17 03:12:42.821816 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.821769 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:12:42.822418 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.822395 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 03:12:42.822698 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.822682 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 03:12:42.822823 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.822807 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 03:12:42.822902 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.822868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:42.822966 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:42.822920 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:12:42.823408 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.823389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 03:12:42.823607 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.823591 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 03:12:42.824330 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.824308 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tvd6h\"" Sep 17 03:12:42.825036 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.824415 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 03:12:42.825036 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.824644 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:12:42.827111 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.827092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:42.827251 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.827237 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 03:12:42.827592 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.827573 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 03:12:42.827795 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.827772 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ktv5m\"" Sep 17 03:12:42.829831 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.829813 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 03:12:42.830207 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.830190 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dv9bk\"" Sep 17 03:12:42.830432 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.830410 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 03:12:42.842242 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.842223 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zswcd" Sep 17 03:12:42.849182 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.849164 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zswcd" Sep 17 03:12:42.906880 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.906857 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 03:12:42.908434 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.908387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" event={"ID":"c9ea5fe55135c7b1e5541fdd12fac4be","Type":"ContainerStarted","Data":"2c14b04f03baa0f27cc76da021e55d63acc5fd1e71ae6fa533d3e307bf0307e4"} Sep 17 03:12:42.909719 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.909687 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"466709fffb065514ddf1d3dfe2c8d5d2","Type":"ContainerStarted","Data":"0d6586b3684be4d268d1491c87de91a7396734fdd2e3ccc597676e78ace7cbf4"} Sep 17 03:12:42.919214 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.919321 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:42.919321 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-conf-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.919321 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-etc-kubernetes\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.919321 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-run-netns\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:42.919518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919351 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.919518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26df3765-8233-4f0a-93ad-22aaca3b7460-dbus\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:42.919518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-kubelet\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-systemd-units\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-etc-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b304f45-3678-4e3b-9a50-f562d4957f86-agent-certs\") pod \"konnectivity-agent-b2jc4\" (UID: \"9b304f45-3678-4e3b-9a50-f562d4957f86\") " pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:12:42.919518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-modprobe-d\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49aaad79-7f59-4a60-99e4-b5d9007b6a85-serviceca\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26df3765-8233-4f0a-93ad-22aaca3b7460-kubelet-config\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-cni-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-slash\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-systemd\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-cni-netd\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-cni-bin\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-log-socket\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919763 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4v7d\" (UniqueName: \"kubernetes.io/projected/7a101863-d5a8-4d6e-872d-43de5ac27fc3-kube-api-access-g4v7d\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-host\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-etc-selinux\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9b6cd63-218c-4533-b9cf-76a68e8547ff-host-slash\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.919883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-system-cni-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-kubelet\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovnkube-config\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:42.919938 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovn-node-metrics-cert\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-socket-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.919997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-lib-modules\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:42.920008 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:43.419993525 +0000 UTC m=+2.960685689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/363bb925-3859-4c95-9249-5af01eaebcca-etc-tuned\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4a61839-eb50-4c74-8640-6414c11ae80d-hosts-file\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr5qb\" (UniqueName: \"kubernetes.io/projected/77feac74-a94d-4526-8b10-1ba3dc52ad02-kube-api-access-tr5qb\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920113 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-lib-modules\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-netns\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920228 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-modprobe-d\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920264 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.920630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-ovn\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/49aaad79-7f59-4a60-99e4-b5d9007b6a85-serviceca\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-host\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920854 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-cni-bin\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysctl-d\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920906 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-etc-selinux\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920943 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9b6cd63-218c-4533-b9cf-76a68e8547ff-host-slash\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-device-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-socket-dir-parent\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.920994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysctl-conf\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-var-lib-kubelet\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921044 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-socket-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49aaad79-7f59-4a60-99e4-b5d9007b6a85-host\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921057 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djlwg\" (UniqueName: \"kubernetes.io/projected/49aaad79-7f59-4a60-99e4-b5d9007b6a85-kube-api-access-djlwg\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-cni-multus\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.921323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovnkube-script-lib\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b304f45-3678-4e3b-9a50-f562d4957f86-konnectivity-ca\") pod \"konnectivity-agent-b2jc4\" (UID: \"9b304f45-3678-4e3b-9a50-f562d4957f86\") " pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkmtl\" (UniqueName: \"kubernetes.io/projected/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-kube-api-access-jkmtl\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-systemd\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cnibin\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921292 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysctl-conf\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-registration-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-multus-certs\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-var-lib-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-run\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysctl-d\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9b6cd63-218c-4533-b9cf-76a68e8547ff-iptables-alerter-script\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bbsd\" (UniqueName: \"kubernetes.io/projected/a4da1c28-24f8-475f-a256-35018049771d-kube-api-access-6bbsd\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921528 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49aaad79-7f59-4a60-99e4-b5d9007b6a85-host\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921556 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-var-lib-kubelet\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922096 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921593 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-registration-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921617 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-device-dir\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921662 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-run\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921718 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-systemd\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb6bk\" (UniqueName: \"kubernetes.io/projected/b593d1c3-6930-4400-b8b8-7d7783c21668-kube-api-access-mb6bk\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5s96\" (UniqueName: \"kubernetes.io/projected/d9b6cd63-218c-4533-b9cf-76a68e8547ff-kube-api-access-f5s96\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921797 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-cnibin\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a61839-eb50-4c74-8640-6414c11ae80d-tmp-dir\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-cnibin\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921897 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-k8s-cni-cncf-io\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-hostroot\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4da1c28-24f8-475f-a256-35018049771d-cni-binary-copy\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.921997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-kubernetes\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/363bb925-3859-4c95-9249-5af01eaebcca-tmp\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922132 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9b6cd63-218c-4533-b9cf-76a68e8547ff-iptables-alerter-script\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xqxc\" (UniqueName: \"kubernetes.io/projected/363bb925-3859-4c95-9249-5af01eaebcca-kube-api-access-6xqxc\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.922668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922306 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-kubernetes\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922453 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-sys-fs\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-node-log\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922513 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77feac74-a94d-4526-8b10-1ba3dc52ad02-sys-fs\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptdk5\" (UniqueName: \"kubernetes.io/projected/b4a61839-eb50-4c74-8640-6414c11ae80d-kube-api-access-ptdk5\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4da1c28-24f8-475f-a256-35018049771d-multus-daemon-config\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-env-overrides\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysconfig\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-sys\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-system-cni-dir\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922684 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-etc-sysconfig\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922717 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/363bb925-3859-4c95-9249-5af01eaebcca-sys\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.922783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-system-cni-dir\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.923359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.923041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.925369 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.925349 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/363bb925-3859-4c95-9249-5af01eaebcca-etc-tuned\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.925476 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.925386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/363bb925-3859-4c95-9249-5af01eaebcca-tmp\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.934329 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.934307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr5qb\" (UniqueName: \"kubernetes.io/projected/77feac74-a94d-4526-8b10-1ba3dc52ad02-kube-api-access-tr5qb\") pod \"aws-ebs-csi-driver-node-9kck8\" (UID: \"77feac74-a94d-4526-8b10-1ba3dc52ad02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:42.935868 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.935828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xqxc\" (UniqueName: \"kubernetes.io/projected/363bb925-3859-4c95-9249-5af01eaebcca-kube-api-access-6xqxc\") pod \"tuned-j8k7z\" (UID: \"363bb925-3859-4c95-9249-5af01eaebcca\") " pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:42.936079 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.936045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb6bk\" (UniqueName: \"kubernetes.io/projected/b593d1c3-6930-4400-b8b8-7d7783c21668-kube-api-access-mb6bk\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:42.936468 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.936449 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djlwg\" (UniqueName: \"kubernetes.io/projected/49aaad79-7f59-4a60-99e4-b5d9007b6a85-kube-api-access-djlwg\") pod \"node-ca-j76qf\" (UID: \"49aaad79-7f59-4a60-99e4-b5d9007b6a85\") " pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:42.936574 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.936486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkmtl\" (UniqueName: \"kubernetes.io/projected/3626474d-05b8-4a4b-bfbe-36ea2c0bf623-kube-api-access-jkmtl\") pod \"multus-additional-cni-plugins-mdgpz\" (UID: \"3626474d-05b8-4a4b-bfbe-36ea2c0bf623\") " pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:42.936837 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:42.936814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5s96\" (UniqueName: \"kubernetes.io/projected/d9b6cd63-218c-4533-b9cf-76a68e8547ff-kube-api-access-f5s96\") pod \"iptables-alerter-7bm7h\" (UID: \"d9b6cd63-218c-4533-b9cf-76a68e8547ff\") " pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:43.023933 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.023904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-system-cni-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.023933 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.023936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-kubelet\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.023953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovnkube-config\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.023972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovn-node-metrics-cert\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.023999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4a61839-eb50-4c74-8640-6414c11ae80d-hosts-file\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-netns\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024031 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-kubelet\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-ovn\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024050 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-system-cni-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-cni-bin\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-ovn\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-socket-dir-parent\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-cni-multus\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024171 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-cni-bin\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovnkube-script-lib\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.024193 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b304f45-3678-4e3b-9a50-f562d4957f86-konnectivity-ca\") pod \"konnectivity-agent-b2jc4\" (UID: \"9b304f45-3678-4e3b-9a50-f562d4957f86\") " pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024222 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b4a61839-eb50-4c74-8640-6414c11ae80d-hosts-file\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-multus-certs\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-netns\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.024405 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024417 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-cni-multus\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024467 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-socket-dir-parent\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.024472 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret podName:26df3765-8233-4f0a-93ad-22aaca3b7460 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:43.524452081 +0000 UTC m=+3.065144264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret") pod "global-pull-secret-syncer-lqn4s" (UID: "26df3765-8233-4f0a-93ad-22aaca3b7460") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024629 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovnkube-config\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.024825 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024786 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-multus-certs\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025160 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.024966 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovnkube-script-lib\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025160 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b304f45-3678-4e3b-9a50-f562d4957f86-konnectivity-ca\") pod \"konnectivity-agent-b2jc4\" (UID: \"9b304f45-3678-4e3b-9a50-f562d4957f86\") " pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025165 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-var-lib-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bbsd\" (UniqueName: \"kubernetes.io/projected/a4da1c28-24f8-475f-a256-35018049771d-kube-api-access-6bbsd\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a61839-eb50-4c74-8640-6414c11ae80d-tmp-dir\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-cnibin\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-k8s-cni-cncf-io\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-hostroot\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4da1c28-24f8-475f-a256-35018049771d-cni-binary-copy\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-node-log\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdk5\" (UniqueName: \"kubernetes.io/projected/b4a61839-eb50-4c74-8640-6414c11ae80d-kube-api-access-ptdk5\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4da1c28-24f8-475f-a256-35018049771d-multus-daemon-config\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-env-overrides\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-conf-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-etc-kubernetes\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-run-netns\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025487 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-var-lib-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26df3765-8233-4f0a-93ad-22aaca3b7460-dbus\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-kubelet\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025572 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-systemd-units\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-etc-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b304f45-3678-4e3b-9a50-f562d4957f86-agent-certs\") pod \"konnectivity-agent-b2jc4\" (UID: \"9b304f45-3678-4e3b-9a50-f562d4957f86\") " pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:12:43.025731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26df3765-8233-4f0a-93ad-22aaca3b7460-kubelet-config\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-cni-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-slash\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-systemd\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-cni-netd\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-cni-bin\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-log-socket\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4v7d\" (UniqueName: \"kubernetes.io/projected/7a101863-d5a8-4d6e-872d-43de5ac27fc3-kube-api-access-g4v7d\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025878 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a61839-eb50-4c74-8640-6414c11ae80d-tmp-dir\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025934 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26df3765-8233-4f0a-93ad-22aaca3b7460-dbus\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025540 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-run-netns\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.025982 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-kubelet\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.026023 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-systemd-units\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.026062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-etc-kubernetes\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.026096 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-etc-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.026170 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-cnibin\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.026213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-run-k8s-cni-cncf-io\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.026543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.026254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-hostroot\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.027240 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.026754 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4da1c28-24f8-475f-a256-35018049771d-cni-binary-copy\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.027240 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.026817 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-node-log\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.027240 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.027008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a101863-d5a8-4d6e-872d-43de5ac27fc3-ovn-node-metrics-cert\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.027549 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.027527 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-conf-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.027970 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.027941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-openvswitch\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.027970 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.027957 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4da1c28-24f8-475f-a256-35018049771d-multus-daemon-config\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.028133 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028027 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-slash\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.028133 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26df3765-8233-4f0a-93ad-22aaca3b7460-kubelet-config\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:43.028133 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028075 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a101863-d5a8-4d6e-872d-43de5ac27fc3-env-overrides\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.028133 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028087 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-run-systemd\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.028133 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028110 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-multus-cni-dir\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.028377 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-host-cni-netd\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.028377 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028179 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4da1c28-24f8-475f-a256-35018049771d-host-var-lib-cni-bin\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.028377 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a101863-d5a8-4d6e-872d-43de5ac27fc3-log-socket\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.028677 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.028646 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b304f45-3678-4e3b-9a50-f562d4957f86-agent-certs\") pod \"konnectivity-agent-b2jc4\" (UID: \"9b304f45-3678-4e3b-9a50-f562d4957f86\") " pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:12:43.033004 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.032950 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:43.033004 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.032976 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:43.033004 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.032991 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fjcb7 for pod openshift-network-diagnostics/network-check-target-b8ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:43.033245 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.033072 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7 podName:6120ddfe-4f62-41b6-bd1f-31149386ea9b nodeName:}" failed. No retries permitted until 2026-09-17 03:12:43.533053648 +0000 UTC m=+3.073745835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcb7" (UniqueName: "kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7") pod "network-check-target-b8ns5" (UID: "6120ddfe-4f62-41b6-bd1f-31149386ea9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:43.033960 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.033938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bbsd\" (UniqueName: \"kubernetes.io/projected/a4da1c28-24f8-475f-a256-35018049771d-kube-api-access-6bbsd\") pod \"multus-qsllp\" (UID: \"a4da1c28-24f8-475f-a256-35018049771d\") " pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.034116 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.034094 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4v7d\" (UniqueName: \"kubernetes.io/projected/7a101863-d5a8-4d6e-872d-43de5ac27fc3-kube-api-access-g4v7d\") pod \"ovnkube-node-g2dhb\" (UID: \"7a101863-d5a8-4d6e-872d-43de5ac27fc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.035488 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.035464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptdk5\" (UniqueName: \"kubernetes.io/projected/b4a61839-eb50-4c74-8640-6414c11ae80d-kube-api-access-ptdk5\") pod \"node-resolver-zhp9t\" (UID: \"b4a61839-eb50-4c74-8640-6414c11ae80d\") " pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:43.114704 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.114660 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" Sep 17 03:12:43.120934 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.120911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" Sep 17 03:12:43.134830 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.134801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" Sep 17 03:12:43.140572 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.140551 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j76qf" Sep 17 03:12:43.149227 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.149204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bm7h" Sep 17 03:12:43.158833 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.158811 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qsllp" Sep 17 03:12:43.164553 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.164532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:12:43.173234 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.173211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:12:43.177932 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.177911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhp9t" Sep 17 03:12:43.428445 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.428368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:43.428615 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.428486 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:43.428615 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.428554 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:44.428534132 +0000 UTC m=+3.969226300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:43.529444 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.529340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:43.529619 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.529502 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:43.529619 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.529578 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret podName:26df3765-8233-4f0a-93ad-22aaca3b7460 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:44.529556953 +0000 UTC m=+4.070249121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret") pod "global-pull-secret-syncer-lqn4s" (UID: "26df3765-8233-4f0a-93ad-22aaca3b7460") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:43.629711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.629679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:43.629885 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.629865 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:43.629937 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.629892 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:43.629937 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.629905 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fjcb7 for pod openshift-network-diagnostics/network-check-target-b8ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:43.630007 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:43.629975 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7 podName:6120ddfe-4f62-41b6-bd1f-31149386ea9b nodeName:}" failed. No retries permitted until 2026-09-17 03:12:44.62995377 +0000 UTC m=+4.170645953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcb7" (UniqueName: "kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7") pod "network-check-target-b8ns5" (UID: "6120ddfe-4f62-41b6-bd1f-31149386ea9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:43.852124 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.852015 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:07:42 +0000 UTC" deadline="2028-04-03 15:12:16.686725984 +0000 UTC" Sep 17 03:12:43.852124 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:43.852076 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13547h59m32.83465295s" Sep 17 03:12:43.977526 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.977463 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3626474d_05b8_4a4b_bfbe_36ea2c0bf623.slice/crio-43043efc40ce0d7829b4ed4115b022385c5a7d8c7a07a93447f472760c1968a0 WatchSource:0}: Error finding container 43043efc40ce0d7829b4ed4115b022385c5a7d8c7a07a93447f472760c1968a0: Status 404 returned error can't find the container with id 43043efc40ce0d7829b4ed4115b022385c5a7d8c7a07a93447f472760c1968a0 Sep 17 03:12:43.979115 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.979085 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b6cd63_218c_4533_b9cf_76a68e8547ff.slice/crio-08b2d84676da14a7cfe669c19920f683bfe98c3a4fee927b8d27164850e8206a WatchSource:0}: Error finding container 08b2d84676da14a7cfe669c19920f683bfe98c3a4fee927b8d27164850e8206a: Status 404 returned error can't find the container with id 08b2d84676da14a7cfe669c19920f683bfe98c3a4fee927b8d27164850e8206a Sep 17 03:12:43.980677 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.980635 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363bb925_3859_4c95_9249_5af01eaebcca.slice/crio-8d241e28b63666b01d913a4038b03eb16d06034f228245b4248fe7bcca72d249 WatchSource:0}: Error finding container 8d241e28b63666b01d913a4038b03eb16d06034f228245b4248fe7bcca72d249: Status 404 returned error can't find the container with id 8d241e28b63666b01d913a4038b03eb16d06034f228245b4248fe7bcca72d249 Sep 17 03:12:43.983447 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.983427 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b304f45_3678_4e3b_9a50_f562d4957f86.slice/crio-387b31179ed41d91c1a4260303433ccbd35a85930ee61a7a3ef81a6c762fff7f WatchSource:0}: Error finding container 387b31179ed41d91c1a4260303433ccbd35a85930ee61a7a3ef81a6c762fff7f: Status 404 returned error can't find the container with id 387b31179ed41d91c1a4260303433ccbd35a85930ee61a7a3ef81a6c762fff7f Sep 17 03:12:43.986091 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.986070 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49aaad79_7f59_4a60_99e4_b5d9007b6a85.slice/crio-0f95197007d643c66682472c7aab0a83be7342e4a24af94bbf253efa3cbc7583 WatchSource:0}: Error finding container 0f95197007d643c66682472c7aab0a83be7342e4a24af94bbf253efa3cbc7583: Status 404 returned error can't find the container with id 0f95197007d643c66682472c7aab0a83be7342e4a24af94bbf253efa3cbc7583 Sep 17 03:12:43.986330 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.986272 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4da1c28_24f8_475f_a256_35018049771d.slice/crio-4ba8e71b0e86dca8128b7cb54eb1fe7e12333f62ffedfeebecf40be11963b557 WatchSource:0}: Error finding container 4ba8e71b0e86dca8128b7cb54eb1fe7e12333f62ffedfeebecf40be11963b557: Status 404 returned error can't find the container with id 4ba8e71b0e86dca8128b7cb54eb1fe7e12333f62ffedfeebecf40be11963b557 Sep 17 03:12:43.988119 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.988082 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a61839_eb50_4c74_8640_6414c11ae80d.slice/crio-a74e76b3bc0f2b82445d2bb3aa4cbb5a392011aa2627f124d8855f044b6bdd68 WatchSource:0}: Error finding container a74e76b3bc0f2b82445d2bb3aa4cbb5a392011aa2627f124d8855f044b6bdd68: Status 404 returned error can't find the container with id a74e76b3bc0f2b82445d2bb3aa4cbb5a392011aa2627f124d8855f044b6bdd68 Sep 17 03:12:43.989953 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.989632 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77feac74_a94d_4526_8b10_1ba3dc52ad02.slice/crio-3f7d7f21532647848f0a9c9a6987ebb3dae3f2f55d8ebcb64c95cb1e7301444f WatchSource:0}: Error finding container 3f7d7f21532647848f0a9c9a6987ebb3dae3f2f55d8ebcb64c95cb1e7301444f: Status 404 returned error can't find the container with id 3f7d7f21532647848f0a9c9a6987ebb3dae3f2f55d8ebcb64c95cb1e7301444f Sep 17 03:12:43.994005 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:12:43.993475 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a101863_d5a8_4d6e_872d_43de5ac27fc3.slice/crio-9e13bce4744d01352ae3afdbac653bfa8e819f6eb5d84d221433d2bdab8cad3d WatchSource:0}: Error finding container 9e13bce4744d01352ae3afdbac653bfa8e819f6eb5d84d221433d2bdab8cad3d: Status 404 returned error can't find the container with id 9e13bce4744d01352ae3afdbac653bfa8e819f6eb5d84d221433d2bdab8cad3d Sep 17 03:12:44.435098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.434939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:44.435280 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.435131 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:44.435280 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.435212 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:46.435192255 +0000 UTC m=+5.975884422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:44.535399 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.535359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:44.535578 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.535500 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:44.535578 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.535562 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret podName:26df3765-8233-4f0a-93ad-22aaca3b7460 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:46.535544386 +0000 UTC m=+6.076236558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret") pod "global-pull-secret-syncer-lqn4s" (UID: "26df3765-8233-4f0a-93ad-22aaca3b7460") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:44.636251 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.636212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:44.636450 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.636430 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:44.636510 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.636459 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:44.636510 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.636471 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fjcb7 for pod openshift-network-diagnostics/network-check-target-b8ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:44.636628 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.636527 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7 podName:6120ddfe-4f62-41b6-bd1f-31149386ea9b nodeName:}" failed. No retries permitted until 2026-09-17 03:12:46.636510707 +0000 UTC m=+6.177202892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcb7" (UniqueName: "kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7") pod "network-check-target-b8ns5" (UID: "6120ddfe-4f62-41b6-bd1f-31149386ea9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:44.852791 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.852700 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:07:42 +0000 UTC" deadline="2028-04-13 16:25:54.226795202 +0000 UTC" Sep 17 03:12:44.852791 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.852742 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13789h13m9.374057117s" Sep 17 03:12:44.906451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.906203 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:44.906451 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.906338 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:44.906781 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.906731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:44.906854 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.906823 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:44.906911 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.906894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:44.906996 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:44.906972 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:12:44.962581 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.962477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qsllp" event={"ID":"a4da1c28-24f8-475f-a256-35018049771d","Type":"ContainerStarted","Data":"4ba8e71b0e86dca8128b7cb54eb1fe7e12333f62ffedfeebecf40be11963b557"} Sep 17 03:12:44.965979 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.965810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b2jc4" event={"ID":"9b304f45-3678-4e3b-9a50-f562d4957f86","Type":"ContainerStarted","Data":"387b31179ed41d91c1a4260303433ccbd35a85930ee61a7a3ef81a6c762fff7f"} Sep 17 03:12:44.968772 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.968737 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bm7h" event={"ID":"d9b6cd63-218c-4533-b9cf-76a68e8547ff","Type":"ContainerStarted","Data":"08b2d84676da14a7cfe669c19920f683bfe98c3a4fee927b8d27164850e8206a"} Sep 17 03:12:44.988397 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.988359 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" event={"ID":"c9ea5fe55135c7b1e5541fdd12fac4be","Type":"ContainerStarted","Data":"e8caab7c28afbde9ca7144f140c9ca4510eefde948fa751f6a47bbc84d2d0803"} Sep 17 03:12:44.997843 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:44.997815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhp9t" event={"ID":"b4a61839-eb50-4c74-8640-6414c11ae80d","Type":"ContainerStarted","Data":"a74e76b3bc0f2b82445d2bb3aa4cbb5a392011aa2627f124d8855f044b6bdd68"} Sep 17 03:12:45.002654 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:45.002618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j76qf" event={"ID":"49aaad79-7f59-4a60-99e4-b5d9007b6a85","Type":"ContainerStarted","Data":"0f95197007d643c66682472c7aab0a83be7342e4a24af94bbf253efa3cbc7583"} Sep 17 03:12:45.015112 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:45.015081 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" event={"ID":"363bb925-3859-4c95-9249-5af01eaebcca","Type":"ContainerStarted","Data":"8d241e28b63666b01d913a4038b03eb16d06034f228245b4248fe7bcca72d249"} Sep 17 03:12:45.016746 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:45.016722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerStarted","Data":"43043efc40ce0d7829b4ed4115b022385c5a7d8c7a07a93447f472760c1968a0"} Sep 17 03:12:45.022929 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:45.022893 2579 generic.go:356] "Generic (PLEG): container finished" podID="466709fffb065514ddf1d3dfe2c8d5d2" containerID="d1c10e768572af0cb5dbf4ed4b03ed47d624be341cf39c655cb10642f39e7dcb" exitCode=0 Sep 17 03:12:45.023367 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:45.023165 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"466709fffb065514ddf1d3dfe2c8d5d2","Type":"ContainerDied","Data":"d1c10e768572af0cb5dbf4ed4b03ed47d624be341cf39c655cb10642f39e7dcb"} Sep 17 03:12:45.031665 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:45.031569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"9e13bce4744d01352ae3afdbac653bfa8e819f6eb5d84d221433d2bdab8cad3d"} Sep 17 03:12:45.038173 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:45.038048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" event={"ID":"77feac74-a94d-4526-8b10-1ba3dc52ad02","Type":"ContainerStarted","Data":"3f7d7f21532647848f0a9c9a6987ebb3dae3f2f55d8ebcb64c95cb1e7301444f"} Sep 17 03:12:45.042211 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:45.041793 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" podStartSLOduration=4.041774588 podStartE2EDuration="4.041774588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:12:45.00540111 +0000 UTC m=+4.546093300" watchObservedRunningTime="2026-09-17 03:12:45.041774588 +0000 UTC m=+4.582466776" Sep 17 03:12:46.053450 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:46.053413 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"466709fffb065514ddf1d3dfe2c8d5d2","Type":"ContainerStarted","Data":"67075e6f52bfb87b2ee5f7705a44e18e7ae4944b80d80154a3a74e108dde1cdd"} Sep 17 03:12:46.454211 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:46.454084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:46.454410 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.454256 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:46.454410 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.454317 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:50.454298989 +0000 UTC m=+9.994991178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:46.554721 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:46.554683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:46.554902 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.554834 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:46.554902 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.554898 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret podName:26df3765-8233-4f0a-93ad-22aaca3b7460 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:50.554879466 +0000 UTC m=+10.095571648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret") pod "global-pull-secret-syncer-lqn4s" (UID: "26df3765-8233-4f0a-93ad-22aaca3b7460") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:46.655723 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:46.655682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:46.655934 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.655917 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:46.656028 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.655938 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:46.656028 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.655950 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fjcb7 for pod openshift-network-diagnostics/network-check-target-b8ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:46.656028 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.656010 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7 podName:6120ddfe-4f62-41b6-bd1f-31149386ea9b nodeName:}" failed. No retries permitted until 2026-09-17 03:12:50.65599231 +0000 UTC m=+10.196684487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcb7" (UniqueName: "kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7") pod "network-check-target-b8ns5" (UID: "6120ddfe-4f62-41b6-bd1f-31149386ea9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:46.904339 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:46.904258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:46.904504 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.904405 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:46.904861 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:46.904813 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:46.904952 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.904912 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:46.905063 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:46.905048 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:46.905174 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:46.905134 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:12:48.905715 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:48.905241 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:48.905715 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:48.905268 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:48.905715 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:48.905376 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:12:48.905715 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:48.905397 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:48.905715 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:48.905507 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:48.905715 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:48.905607 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:50.491712 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:50.491438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:50.492135 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.491661 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:50.492135 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.491841 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:58.491818652 +0000 UTC m=+18.032510823 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:50.592672 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:50.592640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:50.592845 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.592783 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:50.592845 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.592844 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret podName:26df3765-8233-4f0a-93ad-22aaca3b7460 nodeName:}" failed. No retries permitted until 2026-09-17 03:12:58.592826453 +0000 UTC m=+18.133518631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret") pod "global-pull-secret-syncer-lqn4s" (UID: "26df3765-8233-4f0a-93ad-22aaca3b7460") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:50.693519 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:50.693479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:50.693712 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.693635 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:50.693712 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.693661 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:50.693712 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.693675 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fjcb7 for pod openshift-network-diagnostics/network-check-target-b8ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:50.693863 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.693732 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7 podName:6120ddfe-4f62-41b6-bd1f-31149386ea9b nodeName:}" failed. No retries permitted until 2026-09-17 03:12:58.69371292 +0000 UTC m=+18.234405094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcb7" (UniqueName: "kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7") pod "network-check-target-b8ns5" (UID: "6120ddfe-4f62-41b6-bd1f-31149386ea9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:50.905129 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:50.904538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:50.905129 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:50.904647 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:50.905129 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.904662 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:50.905129 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:50.904758 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:50.905129 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.904874 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:50.905129 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:50.904910 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:12:52.904629 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:52.904594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:52.904629 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:52.904629 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:52.905194 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:52.904599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:52.905194 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:52.904750 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:12:52.905194 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:52.904888 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:52.905194 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:52.904965 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:54.903861 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:54.903820 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:54.903861 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:54.903852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:54.904409 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:54.903829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:54.904409 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:54.903983 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:54.904409 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:54.904093 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:12:54.904409 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:54.904183 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:56.904449 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:56.904406 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:56.904907 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:56.904406 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:56.904907 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:56.904548 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:12:56.904907 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:56.904419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:56.904907 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:56.904653 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:56.904907 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:56.904736 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:58.552635 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:58.552599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:58.553052 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.552771 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:58.553052 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.552859 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:14.552835521 +0000 UTC m=+34.093527709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:12:58.653015 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:58.652975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:58.653201 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.653117 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:58.653201 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.653196 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret podName:26df3765-8233-4f0a-93ad-22aaca3b7460 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:14.653181179 +0000 UTC m=+34.193873346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret") pod "global-pull-secret-syncer-lqn4s" (UID: "26df3765-8233-4f0a-93ad-22aaca3b7460") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:12:58.754092 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:58.754048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:58.754274 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.754250 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:12:58.754354 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.754284 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:12:58.754354 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.754298 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fjcb7 for pod openshift-network-diagnostics/network-check-target-b8ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:58.754450 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.754365 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7 podName:6120ddfe-4f62-41b6-bd1f-31149386ea9b nodeName:}" failed. No retries permitted until 2026-09-17 03:13:14.754346003 +0000 UTC m=+34.295038181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcb7" (UniqueName: "kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7") pod "network-check-target-b8ns5" (UID: "6120ddfe-4f62-41b6-bd1f-31149386ea9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:12:58.904038 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:58.903964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:12:58.904212 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:58.903976 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:12:58.904212 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.904085 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:12:58.904212 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:12:58.903975 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:12:58.904212 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.904191 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:12:58.904454 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:12:58.904243 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:00.905185 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:00.905133 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:00.905641 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:00.905261 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:13:00.905641 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:00.905646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:00.905776 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:00.905736 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:13:00.905829 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:00.905789 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:00.905882 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:00.905859 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:02.086895 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.086862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qsllp" event={"ID":"a4da1c28-24f8-475f-a256-35018049771d","Type":"ContainerStarted","Data":"2357c418b6266363a06013d60e04e424b7d6aaac1694c0bc1906a5a38222bf69"} Sep 17 03:13:02.088565 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.088515 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b2jc4" event={"ID":"9b304f45-3678-4e3b-9a50-f562d4957f86","Type":"ContainerStarted","Data":"af7ccb5c085fec281d9a01bc5e72f7d0b32034abe827ec1bfe8578cf6a6ce046"} Sep 17 03:13:02.090240 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.090217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhp9t" event={"ID":"b4a61839-eb50-4c74-8640-6414c11ae80d","Type":"ContainerStarted","Data":"a24fc23b46b2522c1964542597fa33dd236a526b698fe7bfb747db030b4df87d"} Sep 17 03:13:02.091581 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.091557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j76qf" event={"ID":"49aaad79-7f59-4a60-99e4-b5d9007b6a85","Type":"ContainerStarted","Data":"54106059ba9a7a9f3d2047e2404f1a25c9a0c56b8db1b3540b59a37db936c725"} Sep 17 03:13:02.093013 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.092992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" event={"ID":"363bb925-3859-4c95-9249-5af01eaebcca","Type":"ContainerStarted","Data":"77d1df96355ec40703bbeadbf69a1811fdd0c0a63edd054eb2b56bd7304be625"} Sep 17 03:13:02.094603 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.094574 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerStarted","Data":"e9fd1dfa88431759cc40c3c61a661b87c1afd694eb431fd7e7d0fde491072f39"} Sep 17 03:13:02.096698 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.096669 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:13:02.097105 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.097084 2579 generic.go:356] "Generic (PLEG): container finished" podID="7a101863-d5a8-4d6e-872d-43de5ac27fc3" containerID="734dcb19d70408d665bf12b6ca87ec60e2859b3c726c3de7b15985bcc200ae62" exitCode=1 Sep 17 03:13:02.097225 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.097164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerDied","Data":"734dcb19d70408d665bf12b6ca87ec60e2859b3c726c3de7b15985bcc200ae62"} Sep 17 03:13:02.097225 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.097219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"56560048e43392f6ae496fd524047de1c5a7263dc29f58c47b3cf30bc75f570a"} Sep 17 03:13:02.098867 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.098847 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" event={"ID":"77feac74-a94d-4526-8b10-1ba3dc52ad02","Type":"ContainerStarted","Data":"143965aefe8f3d145d8d8b1e95078a25ef8467ac61a5887ac7dab1d67435c5d2"} Sep 17 03:13:02.117318 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.117117 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" podStartSLOduration=21.117088031 podStartE2EDuration="21.117088031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:12:46.069405271 +0000 UTC m=+5.610097459" watchObservedRunningTime="2026-09-17 03:13:02.117088031 +0000 UTC m=+21.657780210" Sep 17 03:13:02.117652 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.117626 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qsllp" podStartSLOduration=3.408516994 podStartE2EDuration="21.11761698s" totalImagesPullingTime="17.709099986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.117388494 +0000 UTC m=+21.658080662" watchObservedRunningTime="2026-09-17 03:13:02.11761698 +0000 UTC m=+21.658309170" Sep 17 03:13:02.137689 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.137669 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:13:02.138171 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.138157 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:13:02.141722 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.141685 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j8k7z" podStartSLOduration=4.474181367 podStartE2EDuration="22.141671757s" totalImagesPullingTime="17.66749039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.141401513 +0000 UTC m=+21.682093700" watchObservedRunningTime="2026-09-17 03:13:02.141671757 +0000 UTC m=+21.682363942" Sep 17 03:13:02.162989 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.162951 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b2jc4" podStartSLOduration=7.67247315 podStartE2EDuration="21.162938621s" totalImagesPullingTime="13.490465471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.1628062 +0000 UTC m=+21.703498387" watchObservedRunningTime="2026-09-17 03:13:02.162938621 +0000 UTC m=+21.703630807" Sep 17 03:13:02.220899 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.220840 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zhp9t" podStartSLOduration=3.562870451 podStartE2EDuration="21.220818529s" totalImagesPullingTime="17.657948078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.22047724 +0000 UTC m=+21.761169429" watchObservedRunningTime="2026-09-17 03:13:02.220818529 +0000 UTC m=+21.761510716" Sep 17 03:13:02.221020 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.220955 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j76qf" podStartSLOduration=3.560757187 podStartE2EDuration="21.220947029s" totalImagesPullingTime="17.660189842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:02.203764282 +0000 UTC m=+21.744456470" watchObservedRunningTime="2026-09-17 03:13:02.220947029 +0000 UTC m=+21.761639219" Sep 17 03:13:02.904631 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.904604 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:02.904827 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.904634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:02.905077 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:02.905027 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:02.907577 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:02.905228 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:13:02.907577 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:02.905255 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:02.907577 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:02.905614 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:13:03.104249 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.104219 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:13:03.105110 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.104670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"4415cb87b5a8a1995855c624e5496453d4bcda487d5b9f399b19a939049bff77"} Sep 17 03:13:03.105110 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.104766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"b805da714d2b51767e376914b0df636a1e6b8d640de91c0b5f5ec29855c8f03d"} Sep 17 03:13:03.105110 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.104817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"6f12cf524b81b541ae7027b9a75eeeac90bd4646a4b7fa5a85d6691fe766f142"} Sep 17 03:13:03.105110 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.104863 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"0a59753d9aff26162eb0ec5a6178fd47f48ea1a49237f6a2da081da6f290f37f"} Sep 17 03:13:03.106352 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.106180 2579 generic.go:356] "Generic (PLEG): container finished" podID="3626474d-05b8-4a4b-bfbe-36ea2c0bf623" containerID="e9fd1dfa88431759cc40c3c61a661b87c1afd694eb431fd7e7d0fde491072f39" exitCode=0 Sep 17 03:13:03.106352 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.106244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerDied","Data":"e9fd1dfa88431759cc40c3c61a661b87c1afd694eb431fd7e7d0fde491072f39"} Sep 17 03:13:03.233001 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.232865 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 03:13:03.879843 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.879736 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T03:13:03.232997554Z","UUID":"42c5bf22-ab55-4d52-a036-c2b436d1083a","Handler":null,"Name":"","Endpoint":""} Sep 17 03:13:03.881401 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.881375 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 03:13:03.881575 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:03.881410 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 03:13:04.111295 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:04.111261 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" event={"ID":"77feac74-a94d-4526-8b10-1ba3dc52ad02","Type":"ContainerStarted","Data":"505f0a4c3f417779230e95399f1653aa5e3dce03df685097ee8b0e4f13dfd8a7"} Sep 17 03:13:04.113223 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:04.113197 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 03:13:04.113360 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:04.113183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bm7h" event={"ID":"d9b6cd63-218c-4533-b9cf-76a68e8547ff","Type":"ContainerStarted","Data":"90bd463fd95b51200242918f1e6ca2130c92e2e6a3410ebdc9d405ff3772a4bf"} Sep 17 03:13:04.129226 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:04.129167 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7bm7h" podStartSLOduration=5.51125846 podStartE2EDuration="23.129134693s" totalImagesPullingTime="17.617876233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:04.128795275 +0000 UTC m=+23.669487473" watchObservedRunningTime="2026-09-17 03:13:04.129134693 +0000 UTC m=+23.669826880" Sep 17 03:13:04.903757 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:04.903725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:04.903757 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:04.903759 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:04.904012 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:04.903836 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:04.904012 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:04.903725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:04.904012 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:04.903974 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:13:04.904194 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:04.904030 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:13:05.118783 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:05.118748 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:13:05.119292 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:05.119267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"cd030ea128f1670877ed2617bd6de9ce2bb96aeb4284dcd98d178b6c1f4f5d4c"} Sep 17 03:13:05.121693 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:05.121663 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" event={"ID":"77feac74-a94d-4526-8b10-1ba3dc52ad02","Type":"ContainerStarted","Data":"ba6b4d081e7418127e439b8eaf0cd59abbd23fd445a448b3f4e527afa317ba6e"} Sep 17 03:13:05.139848 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:05.139799 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9kck8" podStartSLOduration=4.145345315 podStartE2EDuration="24.139785981s" totalImagesPullingTime="19.994440666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:05.139358715 +0000 UTC m=+24.680050903" watchObservedRunningTime="2026-09-17 03:13:05.139785981 +0000 UTC m=+24.680478168" Sep 17 03:13:06.903706 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:06.903619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:06.903706 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:06.903638 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:06.904171 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:06.903752 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:13:06.904171 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:06.903812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:06.904171 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:06.903912 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:06.904171 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:06.904004 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:13:07.622424 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:07.622191 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:13:07.622571 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:07.622514 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 03:13:07.622799 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:07.622771 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b2jc4" Sep 17 03:13:08.129831 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.129792 2579 generic.go:356] "Generic (PLEG): container finished" podID="3626474d-05b8-4a4b-bfbe-36ea2c0bf623" containerID="3ce7a6bafd0637c7335da3f595ad1debeb833ca73d5218606683630dc3f841ad" exitCode=0 Sep 17 03:13:08.130537 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.129885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerDied","Data":"3ce7a6bafd0637c7335da3f595ad1debeb833ca73d5218606683630dc3f841ad"} Sep 17 03:13:08.133716 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.133692 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:13:08.134097 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.134076 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"9deec696bf44d01e3c04fb37ac2e82d36e486bcaee44a0a2d027d087573dcf5f"} Sep 17 03:13:08.137442 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.134663 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:13:08.137442 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.134778 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:13:08.137442 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.134942 2579 scope.go:117] "RemoveContainer" containerID="734dcb19d70408d665bf12b6ca87ec60e2859b3c726c3de7b15985bcc200ae62" Sep 17 03:13:08.137442 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.134968 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:13:08.153418 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.153394 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:13:08.153524 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.153514 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:13:08.907687 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.907651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:08.907788 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.907772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:08.907842 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:08.907786 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:13:08.907842 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:08.907801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:08.907948 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:08.907885 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:08.908001 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:08.907968 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:13:09.139068 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.138827 2579 generic.go:356] "Generic (PLEG): container finished" podID="3626474d-05b8-4a4b-bfbe-36ea2c0bf623" containerID="48191ac228a56b594570c8069fc71c28d30140c649a447c0ceb8fd3608df5c9c" exitCode=0 Sep 17 03:13:09.139068 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.138922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerDied","Data":"48191ac228a56b594570c8069fc71c28d30140c649a447c0ceb8fd3608df5c9c"} Sep 17 03:13:09.143077 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.143059 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:13:09.143414 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.143395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" event={"ID":"7a101863-d5a8-4d6e-872d-43de5ac27fc3","Type":"ContainerStarted","Data":"3947ac8376760598bb4f12c2485868f90636aef4e7da92a22d6f1b70b740d95c"} Sep 17 03:13:09.196247 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.196198 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" podStartSLOduration=10.527209893 podStartE2EDuration="28.196185853s" totalImagesPullingTime="17.66897596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:09.19601653 +0000 UTC m=+28.736708716" watchObservedRunningTime="2026-09-17 03:13:09.196185853 +0000 UTC m=+28.736878040" Sep 17 03:13:09.266254 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.266221 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lqn4s"] Sep 17 03:13:09.266396 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.266373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:09.266504 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:09.266480 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:09.269483 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.269460 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b8ns5"] Sep 17 03:13:09.269619 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.269561 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:09.269619 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.269576 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxmmr"] Sep 17 03:13:09.269728 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:09.269629 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:13:09.269728 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:09.269670 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:09.269828 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:09.269759 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:13:10.148133 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:10.148050 2579 generic.go:356] "Generic (PLEG): container finished" podID="3626474d-05b8-4a4b-bfbe-36ea2c0bf623" containerID="f66d63d229233c2efb79aa01e5d2bd4e266c3e1af88e5cfbb6c82f747fd80fef" exitCode=0 Sep 17 03:13:10.148596 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:10.148131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerDied","Data":"f66d63d229233c2efb79aa01e5d2bd4e266c3e1af88e5cfbb6c82f747fd80fef"} Sep 17 03:13:10.904640 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:10.904608 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:10.904883 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:10.904730 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:10.904883 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:10.904752 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:10.904883 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:10.904807 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:13:10.905063 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:10.904885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:10.905063 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:10.905017 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:13:12.903821 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:12.903789 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:12.903821 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:12.903826 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:12.904342 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:12.903795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:12.904342 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:12.903916 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lqn4s" podUID="26df3765-8233-4f0a-93ad-22aaca3b7460" Sep 17 03:13:12.904342 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:12.904005 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:13:12.904342 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:12.904055 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b8ns5" podUID="6120ddfe-4f62-41b6-bd1f-31149386ea9b" Sep 17 03:13:14.565973 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.565940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:14.566358 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.566064 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:13:14.566358 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.566117 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:46.566102979 +0000 UTC m=+66.106795157 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:13:14.667042 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.667004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:14.667231 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.667126 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:13:14.667231 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.667206 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret podName:26df3765-8233-4f0a-93ad-22aaca3b7460 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:46.667186369 +0000 UTC m=+66.207878535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret") pod "global-pull-secret-syncer-lqn4s" (UID: "26df3765-8233-4f0a-93ad-22aaca3b7460") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:13:14.737117 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.737093 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeReady" Sep 17 03:13:14.737475 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.737266 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 03:13:14.768272 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.768240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:14.768446 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.768423 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:13:14.768518 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.768452 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:13:14.768518 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.768466 2579 projected.go:196] Error preparing data for projected volume kube-api-access-fjcb7 for pod openshift-network-diagnostics/network-check-target-b8ns5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:13:14.768598 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.768529 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7 podName:6120ddfe-4f62-41b6-bd1f-31149386ea9b nodeName:}" failed. No retries permitted until 2026-09-17 03:13:46.768509389 +0000 UTC m=+66.309201571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcb7" (UniqueName: "kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7") pod "network-check-target-b8ns5" (UID: "6120ddfe-4f62-41b6-bd1f-31149386ea9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:13:14.779552 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.779480 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6lgbn"] Sep 17 03:13:14.783944 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.783920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.786858 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.786834 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 03:13:14.786984 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.786870 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lg7wr\"" Sep 17 03:13:14.787068 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.787037 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m8jj5"] Sep 17 03:13:14.787183 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.787170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 03:13:14.789995 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.789967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m8jj5" Sep 17 03:13:14.793458 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.793437 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jwfhr\"" Sep 17 03:13:14.793669 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.793641 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 03:13:14.793833 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.793816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 03:13:14.794916 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.794899 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 03:13:14.795405 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.795383 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6lgbn"] Sep 17 03:13:14.801716 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.801696 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m8jj5"] Sep 17 03:13:14.869290 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.869258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f458e55-2a05-43ea-b1d7-bf292c53da3a-cert\") pod \"ingress-canary-m8jj5\" (UID: \"8f458e55-2a05-43ea-b1d7-bf292c53da3a\") " pod="openshift-ingress-canary/ingress-canary-m8jj5" Sep 17 03:13:14.869457 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.869305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h667k\" (UniqueName: \"kubernetes.io/projected/8f458e55-2a05-43ea-b1d7-bf292c53da3a-kube-api-access-h667k\") pod \"ingress-canary-m8jj5\" (UID: \"8f458e55-2a05-43ea-b1d7-bf292c53da3a\") " pod="openshift-ingress-canary/ingress-canary-m8jj5" Sep 17 03:13:14.869457 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.869328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e06810de-29ab-4710-bb7c-a7460788d700-config-volume\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.869457 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.869385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z7c2\" (UniqueName: \"kubernetes.io/projected/e06810de-29ab-4710-bb7c-a7460788d700-kube-api-access-6z7c2\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.869457 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.869428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.869617 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.869458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e06810de-29ab-4710-bb7c-a7460788d700-tmp-dir\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.903632 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.903606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:14.903803 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.903640 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:14.903957 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.903606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:14.909189 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.906832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:13:14.909189 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.906935 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:13:14.909189 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.907041 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gbwtv\"" Sep 17 03:13:14.909189 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.907124 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltdl9\"" Sep 17 03:13:14.909189 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.907254 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:13:14.909189 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.907377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:13:14.970704 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.970674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e06810de-29ab-4710-bb7c-a7460788d700-tmp-dir\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.970863 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.970745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f458e55-2a05-43ea-b1d7-bf292c53da3a-cert\") pod \"ingress-canary-m8jj5\" (UID: \"8f458e55-2a05-43ea-b1d7-bf292c53da3a\") " pod="openshift-ingress-canary/ingress-canary-m8jj5" Sep 17 03:13:14.970863 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.970777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h667k\" (UniqueName: \"kubernetes.io/projected/8f458e55-2a05-43ea-b1d7-bf292c53da3a-kube-api-access-h667k\") pod \"ingress-canary-m8jj5\" (UID: \"8f458e55-2a05-43ea-b1d7-bf292c53da3a\") " pod="openshift-ingress-canary/ingress-canary-m8jj5" Sep 17 03:13:14.970863 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.970801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e06810de-29ab-4710-bb7c-a7460788d700-config-volume\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.970863 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.970832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z7c2\" (UniqueName: \"kubernetes.io/projected/e06810de-29ab-4710-bb7c-a7460788d700-kube-api-access-6z7c2\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.971073 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.970926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.971073 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.971041 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:14.971208 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:14.971124 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:15.471104778 +0000 UTC m=+35.011796955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:13:14.971402 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.971379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e06810de-29ab-4710-bb7c-a7460788d700-tmp-dir\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.971642 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.971619 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e06810de-29ab-4710-bb7c-a7460788d700-config-volume\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:14.975404 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.975386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f458e55-2a05-43ea-b1d7-bf292c53da3a-cert\") pod \"ingress-canary-m8jj5\" (UID: \"8f458e55-2a05-43ea-b1d7-bf292c53da3a\") " pod="openshift-ingress-canary/ingress-canary-m8jj5" Sep 17 03:13:14.980279 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.980255 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h667k\" (UniqueName: \"kubernetes.io/projected/8f458e55-2a05-43ea-b1d7-bf292c53da3a-kube-api-access-h667k\") pod \"ingress-canary-m8jj5\" (UID: \"8f458e55-2a05-43ea-b1d7-bf292c53da3a\") " pod="openshift-ingress-canary/ingress-canary-m8jj5" Sep 17 03:13:14.980361 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:14.980291 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z7c2\" (UniqueName: \"kubernetes.io/projected/e06810de-29ab-4710-bb7c-a7460788d700-kube-api-access-6z7c2\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:15.103254 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:15.103216 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m8jj5" Sep 17 03:13:15.474797 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:15.474723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:15.474968 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:15.474905 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:15.475025 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:15.474993 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:16.474973407 +0000 UTC m=+36.015665586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:13:15.797748 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:15.797720 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m8jj5"] Sep 17 03:13:15.817404 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:13:15.817380 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f458e55_2a05_43ea_b1d7_bf292c53da3a.slice/crio-28eb3b1567b2d0b9dbeffad55c8c5c72462d9a75a75f899efd6fda69caebd0eb WatchSource:0}: Error finding container 28eb3b1567b2d0b9dbeffad55c8c5c72462d9a75a75f899efd6fda69caebd0eb: Status 404 returned error can't find the container with id 28eb3b1567b2d0b9dbeffad55c8c5c72462d9a75a75f899efd6fda69caebd0eb Sep 17 03:13:16.163430 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:16.163391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m8jj5" event={"ID":"8f458e55-2a05-43ea-b1d7-bf292c53da3a","Type":"ContainerStarted","Data":"28eb3b1567b2d0b9dbeffad55c8c5c72462d9a75a75f899efd6fda69caebd0eb"} Sep 17 03:13:16.166411 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:16.166378 2579 generic.go:356] "Generic (PLEG): container finished" podID="3626474d-05b8-4a4b-bfbe-36ea2c0bf623" containerID="3d2ae9b1883850896dbb7b48653417846cf7f81a27d7afa6c99b3877c3cbe7f4" exitCode=0 Sep 17 03:13:16.166411 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:16.166418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerDied","Data":"3d2ae9b1883850896dbb7b48653417846cf7f81a27d7afa6c99b3877c3cbe7f4"} Sep 17 03:13:16.482687 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:16.482595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:16.482859 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:16.482760 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:16.482859 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:16.482841 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:18.482816453 +0000 UTC m=+38.023508636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:13:17.172658 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:17.172617 2579 generic.go:356] "Generic (PLEG): container finished" podID="3626474d-05b8-4a4b-bfbe-36ea2c0bf623" containerID="ed9da0a1a572ede2da94a18b1635684bdf4977b6baf53cd10e2e9746542a5e70" exitCode=0 Sep 17 03:13:17.173126 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:17.172704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerDied","Data":"ed9da0a1a572ede2da94a18b1635684bdf4977b6baf53cd10e2e9746542a5e70"} Sep 17 03:13:18.180240 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:18.180016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" event={"ID":"3626474d-05b8-4a4b-bfbe-36ea2c0bf623","Type":"ContainerStarted","Data":"3216f6df53e0219713d8e8803ab34910d811f0bcb8cfdab82aa009e57e71dad7"} Sep 17 03:13:18.204865 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:18.204817 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mdgpz" podStartSLOduration=9.401539937999999 podStartE2EDuration="38.204801412s" totalImagesPullingTime="28.803261474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:18.203338037 +0000 UTC m=+37.744030224" watchObservedRunningTime="2026-09-17 03:13:18.204801412 +0000 UTC m=+37.745493607" Sep 17 03:13:18.360057 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:18.359976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:18.444431 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:18.444357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:18.498346 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:18.498319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:18.498474 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:18.498423 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:18.498522 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:18.498474 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:22.498459852 +0000 UTC m=+42.039152031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:13:19.057653 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:19.057623 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:19.124066 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:19.124033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:19.184680 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:19.184639 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m8jj5" event={"ID":"8f458e55-2a05-43ea-b1d7-bf292c53da3a","Type":"ContainerStarted","Data":"cc4a664f29a69d39573f6c1953ff4a39816d598047ed2f1ea34337372116cd93"} Sep 17 03:13:19.203081 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:19.203020 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m8jj5" podStartSLOduration=2.278584864 podStartE2EDuration="5.203000977s" totalImagesPullingTime="2.924416113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:19.202898445 +0000 UTC m=+38.743590644" watchObservedRunningTime="2026-09-17 03:13:19.203000977 +0000 UTC m=+38.743693162" Sep 17 03:13:19.263737 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:19.263704 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:19.318076 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:19.318010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:19.671575 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:19.671501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:19.728112 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:19.728073 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:20.009639 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:20.009563 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:20.059829 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:20.059796 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:20.177865 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:20.177833 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:20.427023 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:20.426985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:20.479783 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:20.479753 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:22.345017 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:22.344986 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:22.399899 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:22.399872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:22.526669 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:22.526639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:22.526807 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:22.526781 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:22.526855 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:22.526844 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:30.526827459 +0000 UTC m=+50.067519625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:13:30.580519 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:30.580473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:30.580982 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:30.580623 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:30.580982 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:30.580695 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:13:46.580676835 +0000 UTC m=+66.121369001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:13:40.159577 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:40.159545 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g2dhb" Sep 17 03:13:40.310582 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:40.310549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:40.411941 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:40.411865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:41.047201 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:41.047164 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:41.151675 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:41.151644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:41.256308 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:41.256273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:41.311554 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:41.311484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:41.657303 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:41.657225 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:41.712583 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:41.712560 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:46.593056 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.593015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:13:46.593056 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.593055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:13:46.593563 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:46.593177 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:13:46.593563 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:46.593238 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:14:18.59322349 +0000 UTC m=+98.133915655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:13:46.596460 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.596442 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:13:46.603927 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:46.603911 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:13:46.604014 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:13:46.603978 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:14:50.60395623 +0000 UTC m=+130.144648395 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : secret "metrics-daemon-secret" not found Sep 17 03:13:46.694128 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.694090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:46.698040 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.698023 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:13:46.707935 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.707900 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26df3765-8233-4f0a-93ad-22aaca3b7460-original-pull-secret\") pod \"global-pull-secret-syncer-lqn4s\" (UID: \"26df3765-8233-4f0a-93ad-22aaca3b7460\") " pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:46.728182 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.728154 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqn4s" Sep 17 03:13:46.794623 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.794594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:46.797718 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.797697 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:13:46.808082 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.808056 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:13:46.818832 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:46.818806 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjcb7\" (UniqueName: \"kubernetes.io/projected/6120ddfe-4f62-41b6-bd1f-31149386ea9b-kube-api-access-fjcb7\") pod \"network-check-target-b8ns5\" (UID: \"6120ddfe-4f62-41b6-bd1f-31149386ea9b\") " pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:47.019668 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:47.019600 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gbwtv\"" Sep 17 03:13:47.026494 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:47.026473 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:47.034374 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:47.034351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lqn4s"] Sep 17 03:13:47.037722 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:13:47.037699 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26df3765_8233_4f0a_93ad_22aaca3b7460.slice/crio-f9e963c78793b2385ab7a409d32e7d4655f478c12088ea594355b091ce83e4fe WatchSource:0}: Error finding container f9e963c78793b2385ab7a409d32e7d4655f478c12088ea594355b091ce83e4fe: Status 404 returned error can't find the container with id f9e963c78793b2385ab7a409d32e7d4655f478c12088ea594355b091ce83e4fe Sep 17 03:13:47.250775 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:47.250734 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lqn4s" event={"ID":"26df3765-8233-4f0a-93ad-22aaca3b7460","Type":"ContainerStarted","Data":"f9e963c78793b2385ab7a409d32e7d4655f478c12088ea594355b091ce83e4fe"} Sep 17 03:13:47.326740 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:47.326713 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b8ns5"] Sep 17 03:13:47.329385 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:13:47.329359 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6120ddfe_4f62_41b6_bd1f_31149386ea9b.slice/crio-18046090db40cc0d50e16389b1e58d382986e7a998a9c85ce07ded99b5691239 WatchSource:0}: Error finding container 18046090db40cc0d50e16389b1e58d382986e7a998a9c85ce07ded99b5691239: Status 404 returned error can't find the container with id 18046090db40cc0d50e16389b1e58d382986e7a998a9c85ce07ded99b5691239 Sep 17 03:13:48.254645 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:48.254576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b8ns5" event={"ID":"6120ddfe-4f62-41b6-bd1f-31149386ea9b","Type":"ContainerStarted","Data":"18046090db40cc0d50e16389b1e58d382986e7a998a9c85ce07ded99b5691239"} Sep 17 03:13:50.376164 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.376110 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b"] Sep 17 03:13:50.378284 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.378255 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf"] Sep 17 03:13:50.378430 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.378409 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.380435 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.380413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.382042 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.381804 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 03:13:50.382042 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.381866 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 17 03:13:50.382042 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.381956 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 03:13:50.382042 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.382031 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 03:13:50.384759 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.383920 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 17 03:13:50.384759 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.384118 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 17 03:13:50.384759 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.384321 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 17 03:13:50.384759 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.384511 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 17 03:13:50.389047 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.388993 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b"] Sep 17 03:13:50.391387 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.390969 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf"] Sep 17 03:13:50.423749 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.423708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.423919 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.423762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql4ft\" (UniqueName: \"kubernetes.io/projected/204704df-2c4c-4272-a93a-48052fb4da3a-kube-api-access-ql4ft\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.423919 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.423802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-ca\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.423919 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.423860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.423919 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.423903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/204704df-2c4c-4272-a93a-48052fb4da3a-klusterlet-config\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.424067 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.423946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2mtf\" (UniqueName: \"kubernetes.io/projected/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-kube-api-access-x2mtf\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.424067 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.423966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204704df-2c4c-4272-a93a-48052fb4da3a-tmp\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.424067 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.423987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-hub\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.424067 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.424028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.524743 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-hub\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.524743 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.525011 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.525011 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql4ft\" (UniqueName: \"kubernetes.io/projected/204704df-2c4c-4272-a93a-48052fb4da3a-kube-api-access-ql4ft\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.525011 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-ca\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.525011 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.525011 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/204704df-2c4c-4272-a93a-48052fb4da3a-klusterlet-config\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.525011 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2mtf\" (UniqueName: \"kubernetes.io/projected/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-kube-api-access-x2mtf\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.525011 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.524995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204704df-2c4c-4272-a93a-48052fb4da3a-tmp\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.525376 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.525340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204704df-2c4c-4272-a93a-48052fb4da3a-tmp\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.525921 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.525761 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.527992 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.527965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-hub\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.528105 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.528009 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.528105 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.528050 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.528745 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.528374 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/204704df-2c4c-4272-a93a-48052fb4da3a-klusterlet-config\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.528745 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.528694 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-ca\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.534044 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.534000 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql4ft\" (UniqueName: \"kubernetes.io/projected/204704df-2c4c-4272-a93a-48052fb4da3a-kube-api-access-ql4ft\") pod \"klusterlet-addon-workmgr-68f4df88c5-bcv4b\" (UID: \"204704df-2c4c-4272-a93a-48052fb4da3a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.534213 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.534185 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2mtf\" (UniqueName: \"kubernetes.io/projected/bc87ff27-09d9-4cd5-86cf-bb2f22b892a1-kube-api-access-x2mtf\") pod \"cluster-proxy-proxy-agent-5ff85b7477-q75tf\" (UID: \"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:50.691951 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.691856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:50.710484 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:50.710460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:13:52.147130 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.147077 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b"] Sep 17 03:13:52.150349 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:13:52.150314 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204704df_2c4c_4272_a93a_48052fb4da3a.slice/crio-5f35703e4d4df575bc6d86e6ba0796866e1993744db2d4f3dc37edcd629f1eae WatchSource:0}: Error finding container 5f35703e4d4df575bc6d86e6ba0796866e1993744db2d4f3dc37edcd629f1eae: Status 404 returned error can't find the container with id 5f35703e4d4df575bc6d86e6ba0796866e1993744db2d4f3dc37edcd629f1eae Sep 17 03:13:52.150349 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.150330 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf"] Sep 17 03:13:52.153926 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:13:52.153903 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc87ff27_09d9_4cd5_86cf_bb2f22b892a1.slice/crio-b17c11ee83dc4786ea3c608dbd4308c87ae8b4ac4a116795b3d4bb4807539457 WatchSource:0}: Error finding container b17c11ee83dc4786ea3c608dbd4308c87ae8b4ac4a116795b3d4bb4807539457: Status 404 returned error can't find the container with id b17c11ee83dc4786ea3c608dbd4308c87ae8b4ac4a116795b3d4bb4807539457 Sep 17 03:13:52.266252 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.266222 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" event={"ID":"204704df-2c4c-4272-a93a-48052fb4da3a","Type":"ContainerStarted","Data":"5f35703e4d4df575bc6d86e6ba0796866e1993744db2d4f3dc37edcd629f1eae"} Sep 17 03:13:52.267759 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.267730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lqn4s" event={"ID":"26df3765-8233-4f0a-93ad-22aaca3b7460","Type":"ContainerStarted","Data":"2fbc3980d38590955f34af101124a6cf9b0ee007e31b83b7412ed02e18de7aa1"} Sep 17 03:13:52.268851 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.268828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" event={"ID":"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1","Type":"ContainerStarted","Data":"b17c11ee83dc4786ea3c608dbd4308c87ae8b4ac4a116795b3d4bb4807539457"} Sep 17 03:13:52.270283 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.270262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b8ns5" event={"ID":"6120ddfe-4f62-41b6-bd1f-31149386ea9b","Type":"ContainerStarted","Data":"8515e3d98d2eb9ccc59d3743b2c846cd6c79c7dd5df8d6d537a3f7b96e297a4b"} Sep 17 03:13:52.270372 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.270355 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:13:52.284657 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.284616 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lqn4s" podStartSLOduration=66.435355243 podStartE2EDuration="1m11.284602604s" totalImagesPullingTime="4.849247361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:52.28363187 +0000 UTC m=+71.824324058" watchObservedRunningTime="2026-09-17 03:13:52.284602604 +0000 UTC m=+71.825294782" Sep 17 03:13:52.298256 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:52.298217 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b8ns5" podStartSLOduration=66.748944514 podStartE2EDuration="1m11.298206683s" totalImagesPullingTime="4.549262169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:52.297620643 +0000 UTC m=+71.838312829" watchObservedRunningTime="2026-09-17 03:13:52.298206683 +0000 UTC m=+71.838898864" Sep 17 03:13:54.465842 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:54.465812 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:13:58.291017 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:58.290983 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" event={"ID":"204704df-2c4c-4272-a93a-48052fb4da3a","Type":"ContainerStarted","Data":"ec89ad522d1b49a92f0bdf0eaf8f373b024c9b2151a005a206df8a999e3bfdb7"} Sep 17 03:13:58.291474 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:58.291192 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:58.293216 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:58.293192 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:13:58.293425 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:58.293410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" event={"ID":"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1","Type":"ContainerStarted","Data":"99b4e0998c6279b23037f20d6b3ae65c15bbd40803f890f93cc54a8a19a44da3"} Sep 17 03:13:58.293472 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:58.293433 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" event={"ID":"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1","Type":"ContainerStarted","Data":"7658425eb2184c817deefcbbcbf4478a4b7549c0a45cc88007e11b162f87b4a6"} Sep 17 03:13:58.293472 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:58.293445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" event={"ID":"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1","Type":"ContainerStarted","Data":"04f51325d7232c69449f2c231535b9a87e524d68377cb9e0699d68ec7e7dd388"} Sep 17 03:13:58.309112 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:58.309056 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" podStartSLOduration=2.766217102 podStartE2EDuration="8.309042336s" totalImagesPullingTime="5.542825234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:58.307759915 +0000 UTC m=+77.848452103" watchObservedRunningTime="2026-09-17 03:13:58.309042336 +0000 UTC m=+77.849734523" Sep 17 03:13:58.342152 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:13:58.342099 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" podStartSLOduration=2.801286236 podStartE2EDuration="8.342080312s" totalImagesPullingTime="5.540794076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:13:58.341788626 +0000 UTC m=+77.882480814" watchObservedRunningTime="2026-09-17 03:13:58.342080312 +0000 UTC m=+77.882772499" Sep 17 03:14:18.611685 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:14:18.611645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:14:18.612197 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:14:18.611796 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:14:18.612197 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:14:18.611859 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:15:22.611843204 +0000 UTC m=+162.152535368 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:14:23.276994 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:14:23.276961 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b8ns5" Sep 17 03:14:50.628568 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:14:50.628513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:14:50.629059 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:14:50.628669 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:14:50.629059 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:14:50.628738 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:16:52.62872014 +0000 UTC m=+252.169412306 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : secret "metrics-daemon-secret" not found Sep 17 03:15:17.797116 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:15:17.797067 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6lgbn" podUID="e06810de-29ab-4710-bb7c-a7460788d700" Sep 17 03:15:17.922189 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:15:17.922124 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:15:18.520680 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:18.520651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lgbn" Sep 17 03:15:22.655532 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:22.655498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:15:22.655989 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:15:22.655620 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:15:22.655989 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:15:22.655684 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls podName:e06810de-29ab-4710-bb7c-a7460788d700 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:24.655670348 +0000 UTC m=+284.196362512 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls") pod "dns-default-6lgbn" (UID: "e06810de-29ab-4710-bb7c-a7460788d700") : secret "dns-default-metrics-tls" not found Sep 17 03:15:32.903861 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:32.903772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:15:58.292130 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:58.292088 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" podUID="204704df-2c4c-4272-a93a-48052fb4da3a" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Sep 17 03:15:58.636433 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:58.636352 2579 generic.go:356] "Generic (PLEG): container finished" podID="204704df-2c4c-4272-a93a-48052fb4da3a" containerID="ec89ad522d1b49a92f0bdf0eaf8f373b024c9b2151a005a206df8a999e3bfdb7" exitCode=1 Sep 17 03:15:58.636433 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:58.636396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" event={"ID":"204704df-2c4c-4272-a93a-48052fb4da3a","Type":"ContainerDied","Data":"ec89ad522d1b49a92f0bdf0eaf8f373b024c9b2151a005a206df8a999e3bfdb7"} Sep 17 03:15:58.636698 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:58.636686 2579 scope.go:117] "RemoveContainer" containerID="ec89ad522d1b49a92f0bdf0eaf8f373b024c9b2151a005a206df8a999e3bfdb7" Sep 17 03:15:59.641085 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:59.641045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" event={"ID":"204704df-2c4c-4272-a93a-48052fb4da3a","Type":"ContainerStarted","Data":"97f7076ae8e2acff436ef27474765c8017f92c9ace43a0edee5744dbed6ae916"} Sep 17 03:15:59.641478 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:59.641325 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:15:59.641919 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:15:59.641902 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-68f4df88c5-bcv4b" Sep 17 03:16:52.647560 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:16:52.647519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:16:52.648077 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:16:52.647676 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 03:16:52.648077 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:16:52.647753 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs podName:b593d1c3-6930-4400-b8b8-7d7783c21668 nodeName:}" failed. No retries permitted until 2026-09-17 03:18:54.647737289 +0000 UTC m=+374.188429453 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs") pod "network-metrics-daemon-rxmmr" (UID: "b593d1c3-6930-4400-b8b8-7d7783c21668") : secret "metrics-daemon-secret" not found Sep 17 03:16:56.597844 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:16:56.597816 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:16:58.069964 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:16:58.069929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:16:59.698349 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:16:59.698305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:16:59.762114 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:16:59.762082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:00.428487 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.428450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:00.487075 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.487046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:00.600906 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.600876 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:00.767961 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.767879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:00.870534 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.870506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:00.901696 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.901668 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-llh9t"] Sep 17 03:17:00.905169 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.905135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:00.908257 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.908236 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 03:17:00.908257 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.908261 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 03:17:00.908420 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.908271 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 03:17:00.909911 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.909895 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 03:17:00.910030 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.910014 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v629g\"" Sep 17 03:17:00.915165 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.915119 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-llh9t"] Sep 17 03:17:00.938629 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:00.938604 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:01.002719 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.002698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c28tb\" (UniqueName: \"kubernetes.io/projected/70134c4c-d910-40d5-9000-7b948919c514-kube-api-access-c28tb\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.002806 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.002725 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.002806 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.002756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70134c4c-d910-40d5-9000-7b948919c514-data-volume\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.002875 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.002824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70134c4c-d910-40d5-9000-7b948919c514-crio-socket\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.002875 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.002849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.103291 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.103258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70134c4c-d910-40d5-9000-7b948919c514-crio-socket\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.103422 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.103299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.103422 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.103333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c28tb\" (UniqueName: \"kubernetes.io/projected/70134c4c-d910-40d5-9000-7b948919c514-kube-api-access-c28tb\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.103422 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.103363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.103422 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.103377 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/70134c4c-d910-40d5-9000-7b948919c514-crio-socket\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.103422 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:01.103387 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:01.103621 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.103454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70134c4c-d910-40d5-9000-7b948919c514-data-volume\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.103621 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:01.103470 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.103621 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:01.103475 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:01.603452848 +0000 UTC m=+261.144145029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : configmap "kube-rbac-proxy" not found Sep 17 03:17:01.103621 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:01.103552 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:01.603531222 +0000 UTC m=+261.144223390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.103748 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.103715 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/70134c4c-d910-40d5-9000-7b948919c514-data-volume\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.116960 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.116933 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c28tb\" (UniqueName: \"kubernetes.io/projected/70134c4c-d910-40d5-9000-7b948919c514-kube-api-access-c28tb\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.128961 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.128940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:01.197104 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.197080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:01.606397 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.606368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.606551 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:01.606412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:01.606551 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:01.606494 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:01.606551 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:01.606537 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.606652 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:01.606595 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:02.606578086 +0000 UTC m=+262.147270253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:01.606652 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:01.606609 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:02.606602746 +0000 UTC m=+262.147294910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : configmap "kube-rbac-proxy" not found Sep 17 03:17:02.614516 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:02.614466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:02.614516 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:02.614526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:02.614946 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:02.614598 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:02.614946 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:02.614621 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:02.614946 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:02.614677 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.614661251 +0000 UTC m=+264.155353416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : configmap "kube-rbac-proxy" not found Sep 17 03:17:02.614946 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:02.614692 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:04.614685948 +0000 UTC m=+264.155378113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:02.730442 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:02.730413 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:02.825636 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:02.825600 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:03.631601 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:03.631566 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:03.869646 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:03.869622 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhp9t_b4a61839-eb50-4c74-8640-6414c11ae80d/dns-node-resolver/0.log" Sep 17 03:17:04.447771 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:04.447730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:04.559070 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:04.559042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:04.630712 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:04.630683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:04.630890 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:04.630726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:04.630890 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:04.630813 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:04.630890 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:04.630819 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:04.630890 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:04.630872 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:08.630858039 +0000 UTC m=+268.171550204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:04.630890 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:04.630885 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:08.630878742 +0000 UTC m=+268.171570907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : configmap "kube-rbac-proxy" not found Sep 17 03:17:04.667425 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:04.667398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:04.765831 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:04.765750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:04.866022 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:04.865993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:04.869399 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:04.869376 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j76qf_49aaad79-7f59-4a60-99e4-b5d9007b6a85/node-ca/0.log" Sep 17 03:17:05.670294 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:05.670264 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m8jj5_8f458e55-2a05-43ea-b1d7-bf292c53da3a/serve-healthcheck-canary/0.log" Sep 17 03:17:05.748755 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:05.748729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:06.155722 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:06.155692 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:06.355349 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:06.355321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:06.455436 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:06.455356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:06.556783 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:06.556750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:06.618787 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:06.618764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:06.772641 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:06.772579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:06.961880 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:06.961849 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:07.746975 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:07.746943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:08.149753 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:08.149723 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:08.343573 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:08.343543 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:08.401772 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:08.401689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:08.547886 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:08.547857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:08.650778 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:08.650752 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:08.659923 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:08.659854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:08.659923 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:08.659893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:08.660106 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:08.659988 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:17:08.660106 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:08.659992 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:17:08.660106 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:08.660044 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:16.660032167 +0000 UTC m=+276.200724331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : secret "insights-runtime-extractor-tls" not found Sep 17 03:17:08.660106 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:08.660056 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm podName:70134c4c-d910-40d5-9000-7b948919c514 nodeName:}" failed. No retries permitted until 2026-09-17 03:17:16.660050635 +0000 UTC m=+276.200742800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm") pod "insights-runtime-extractor-llh9t" (UID: "70134c4c-d910-40d5-9000-7b948919c514") : configmap "kube-rbac-proxy" not found Sep 17 03:17:08.749855 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:08.749826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:09.944954 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:09.944927 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:10.115167 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:10.115126 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:10.216612 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:10.216529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:10.346399 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:10.346357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:10.548932 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:10.548901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:10.745549 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:10.745516 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:11.439172 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:11.439122 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:11.544202 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:11.544138 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:11.746123 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:11.746035 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:12.147681 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:12.147634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:12.968819 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:12.968787 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:13.345524 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:13.345500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:13.556792 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:13.556754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:13.752227 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:13.752129 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:13.807415 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:13.807386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:14.149417 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:14.149383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:14.754928 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:14.754896 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:15.033375 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:15.033284 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:15.128413 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:15.128374 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:15.229098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:15.229067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:15.279208 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:15.279181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:15.559504 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:15.559469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:16.719907 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:16.719872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:16.720392 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:16.719921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:16.720392 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:16.720380 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/70134c4c-d910-40d5-9000-7b948919c514-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:16.722461 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:16.722438 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/70134c4c-d910-40d5-9000-7b948919c514-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llh9t\" (UID: \"70134c4c-d910-40d5-9000-7b948919c514\") " pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:16.813927 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:16.813887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-llh9t" Sep 17 03:17:17.086980 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:17.086894 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-llh9t"] Sep 17 03:17:17.090008 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:17:17.089985 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70134c4c_d910_40d5_9000_7b948919c514.slice/crio-4999556a592fdf6a6d3d6b395e76d6751b988bd03b05d1413886d646a37ad479 WatchSource:0}: Error finding container 4999556a592fdf6a6d3d6b395e76d6751b988bd03b05d1413886d646a37ad479: Status 404 returned error can't find the container with id 4999556a592fdf6a6d3d6b395e76d6751b988bd03b05d1413886d646a37ad479 Sep 17 03:17:17.865540 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:17.865503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llh9t" event={"ID":"70134c4c-d910-40d5-9000-7b948919c514","Type":"ContainerStarted","Data":"1447364671b7eddf01ac05c4f2b1e68f39288722c432d1c72bd0965ddaa2f133"} Sep 17 03:17:17.865911 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:17.865559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llh9t" event={"ID":"70134c4c-d910-40d5-9000-7b948919c514","Type":"ContainerStarted","Data":"4999556a592fdf6a6d3d6b395e76d6751b988bd03b05d1413886d646a37ad479"} Sep 17 03:17:18.333438 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:18.333414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:18.870417 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:18.870384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llh9t" event={"ID":"70134c4c-d910-40d5-9000-7b948919c514","Type":"ContainerStarted","Data":"f4a19ea480e70aca5c1daee2d4c55b60e65b33c1222b984655b174b64f26e0df"} Sep 17 03:17:19.876130 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:19.876103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llh9t" event={"ID":"70134c4c-d910-40d5-9000-7b948919c514","Type":"ContainerStarted","Data":"bfb0eb22b7afa55113496dc610075d1609db867dd8c22d60d80fb6eb0eaf250f"} Sep 17 03:17:19.895442 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:19.895397 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-llh9t" podStartSLOduration=17.349629141 podStartE2EDuration="19.895380635s" totalImagesPullingTime="2.545751494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:17:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:19.893466507 +0000 UTC m=+279.434158720" watchObservedRunningTime="2026-09-17 03:17:19.895380635 +0000 UTC m=+279.436072852" Sep 17 03:17:21.521277 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:21.521240 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6lgbn" podUID="e06810de-29ab-4710-bb7c-a7460788d700" Sep 17 03:17:21.882534 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:21.882508 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lgbn" Sep 17 03:17:22.345976 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:22.345940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:22.448295 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:22.448263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:22.978335 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:22.978303 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:23.079315 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:23.079284 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:24.674227 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.674197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:17:24.676724 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.676693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e06810de-29ab-4710-bb7c-a7460788d700-metrics-tls\") pod \"dns-default-6lgbn\" (UID: \"e06810de-29ab-4710-bb7c-a7460788d700\") " pod="openshift-dns/dns-default-6lgbn" Sep 17 03:17:24.700243 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.700218 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54667bf9b4-9dn5h"] Sep 17 03:17:24.703341 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.703326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.706331 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.706311 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 03:17:24.706418 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.706327 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xl2rt\"" Sep 17 03:17:24.706418 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.706333 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 03:17:24.706418 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.706369 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 03:17:24.712888 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.712868 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 03:17:24.714634 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.714614 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54667bf9b4-9dn5h"] Sep 17 03:17:24.776183 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.776134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:24.875600 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.875565 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/897be0b4-b25f-4e3d-823f-7c69493ee9dc-trusted-ca\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.875600 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.875599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-bound-sa-token\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.875814 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.875637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-registry-tls\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.875814 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.875658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clv9x\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-kube-api-access-clv9x\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.875814 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.875706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/897be0b4-b25f-4e3d-823f-7c69493ee9dc-image-registry-private-configuration\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.875814 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.875770 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/897be0b4-b25f-4e3d-823f-7c69493ee9dc-registry-certificates\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.875967 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.875828 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/897be0b4-b25f-4e3d-823f-7c69493ee9dc-ca-trust-extracted\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.875967 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.875849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/897be0b4-b25f-4e3d-823f-7c69493ee9dc-installation-pull-secrets\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.882004 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.881963 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:24.885620 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.885604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lg7wr\"" Sep 17 03:17:24.892960 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.892943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lgbn" Sep 17 03:17:24.976240 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/897be0b4-b25f-4e3d-823f-7c69493ee9dc-image-registry-private-configuration\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.976378 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/897be0b4-b25f-4e3d-823f-7c69493ee9dc-registry-certificates\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.976378 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/897be0b4-b25f-4e3d-823f-7c69493ee9dc-ca-trust-extracted\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.976378 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/897be0b4-b25f-4e3d-823f-7c69493ee9dc-installation-pull-secrets\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.976378 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/897be0b4-b25f-4e3d-823f-7c69493ee9dc-trusted-ca\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.976378 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-bound-sa-token\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.976648 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-registry-tls\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.976648 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clv9x\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-kube-api-access-clv9x\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.976648 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.976585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/897be0b4-b25f-4e3d-823f-7c69493ee9dc-ca-trust-extracted\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.977443 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.977417 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/897be0b4-b25f-4e3d-823f-7c69493ee9dc-registry-certificates\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.977561 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.977459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/897be0b4-b25f-4e3d-823f-7c69493ee9dc-trusted-ca\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.978787 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.978757 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/897be0b4-b25f-4e3d-823f-7c69493ee9dc-installation-pull-secrets\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.978884 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.978827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/897be0b4-b25f-4e3d-823f-7c69493ee9dc-image-registry-private-configuration\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.978968 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.978951 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-registry-tls\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.986579 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.986557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clv9x\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-kube-api-access-clv9x\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:24.986579 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:24.986575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/897be0b4-b25f-4e3d-823f-7c69493ee9dc-bound-sa-token\") pod \"image-registry-54667bf9b4-9dn5h\" (UID: \"897be0b4-b25f-4e3d-823f-7c69493ee9dc\") " pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:25.012802 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:25.012785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:25.165187 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:25.165137 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6lgbn"] Sep 17 03:17:25.168911 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:17:25.168886 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06810de_29ab_4710_bb7c_a7460788d700.slice/crio-1d41cc6b920af858dc3cb9a77cdd19e0c4dc19b59576897a2570c1f6f10bb1f9 WatchSource:0}: Error finding container 1d41cc6b920af858dc3cb9a77cdd19e0c4dc19b59576897a2570c1f6f10bb1f9: Status 404 returned error can't find the container with id 1d41cc6b920af858dc3cb9a77cdd19e0c4dc19b59576897a2570c1f6f10bb1f9 Sep 17 03:17:25.284109 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:25.284040 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54667bf9b4-9dn5h"] Sep 17 03:17:25.287243 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:17:25.287215 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897be0b4_b25f_4e3d_823f_7c69493ee9dc.slice/crio-9106c3520aa3cc878126eaecddbc8f7688c95413c56126bf924046e3d3c7eb54 WatchSource:0}: Error finding container 9106c3520aa3cc878126eaecddbc8f7688c95413c56126bf924046e3d3c7eb54: Status 404 returned error can't find the container with id 9106c3520aa3cc878126eaecddbc8f7688c95413c56126bf924046e3d3c7eb54 Sep 17 03:17:25.895650 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:25.895609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" event={"ID":"897be0b4-b25f-4e3d-823f-7c69493ee9dc","Type":"ContainerStarted","Data":"0b2ab2a608307969fdda6f11452f5bd9879d4e6f9c77cee551b8b5da323575a9"} Sep 17 03:17:25.896086 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:25.895679 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" event={"ID":"897be0b4-b25f-4e3d-823f-7c69493ee9dc","Type":"ContainerStarted","Data":"9106c3520aa3cc878126eaecddbc8f7688c95413c56126bf924046e3d3c7eb54"} Sep 17 03:17:25.896086 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:25.895740 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:25.896978 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:25.896949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lgbn" event={"ID":"e06810de-29ab-4710-bb7c-a7460788d700","Type":"ContainerStarted","Data":"1d41cc6b920af858dc3cb9a77cdd19e0c4dc19b59576897a2570c1f6f10bb1f9"} Sep 17 03:17:26.902178 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:26.902123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lgbn" event={"ID":"e06810de-29ab-4710-bb7c-a7460788d700","Type":"ContainerStarted","Data":"92d8a79ddb1b05843fb8edbac430e80d537c01a5db35b881c8f8ccea5bf4851a"} Sep 17 03:17:27.906687 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:27.906644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lgbn" event={"ID":"e06810de-29ab-4710-bb7c-a7460788d700","Type":"ContainerStarted","Data":"a36632eb40ee7b66626cf06d63d5932b219ccb13e85e171e2d68bce13c5ab2e8"} Sep 17 03:17:27.907090 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:27.906719 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6lgbn" Sep 17 03:17:27.927098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:27.927055 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6lgbn" podStartSLOduration=252.34734075 podStartE2EDuration="4m13.927041231s" totalImagesPullingTime="1.579700481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:27.925324226 +0000 UTC m=+287.466016412" watchObservedRunningTime="2026-09-17 03:17:27.927041231 +0000 UTC m=+287.467733417" Sep 17 03:17:27.927262 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:27.927246 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" podStartSLOduration=3.92724218 podStartE2EDuration="3.92724218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:25.917649536 +0000 UTC m=+285.458341724" watchObservedRunningTime="2026-09-17 03:17:27.92724218 +0000 UTC m=+287.467934367" Sep 17 03:17:28.249047 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:28.248969 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:28.349344 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:28.349311 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:28.793352 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:28.793324 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:30.728762 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:30.728734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:30.790403 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:30.790344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:31.433378 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:31.433352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:33.394558 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.394523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:33.596079 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.596048 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:33.682293 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.682222 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8lxh2"] Sep 17 03:17:33.686757 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.686740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.689744 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.689721 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qmnn9\"" Sep 17 03:17:33.690930 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.690903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:33.691029 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.691015 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 03:17:33.691242 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.691220 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 03:17:33.691429 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.691225 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 03:17:33.691517 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.691249 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 03:17:33.691517 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.691260 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 03:17:33.691605 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.691262 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 03:17:33.735729 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.735835 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-sys\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.735835 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.735835 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-root\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.735949 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-tls\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.735949 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slbns\" (UniqueName: \"kubernetes.io/projected/22097a94-19a8-43f0-bf74-781e3568ff4e-kube-api-access-slbns\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.735949 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-textfile\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.735949 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-wtmp\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.736089 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.735959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22097a94-19a8-43f0-bf74-781e3568ff4e-metrics-client-ca\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.759416 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.759393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:33.836955 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.836932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slbns\" (UniqueName: \"kubernetes.io/projected/22097a94-19a8-43f0-bf74-781e3568ff4e-kube-api-access-slbns\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.836955 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.836959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-textfile\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837198 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.836983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-wtmp\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837198 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22097a94-19a8-43f0-bf74-781e3568ff4e-metrics-client-ca\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837198 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837198 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-sys\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837198 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837198 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837170 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-wtmp\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837198 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-root\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837638 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837209 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-sys\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837638 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-tls\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837638 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837255 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/22097a94-19a8-43f0-bf74-781e3568ff4e-root\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837638 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:33.837358 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 03:17:33.837638 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837351 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-textfile\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837638 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:33.837429 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-tls podName:22097a94-19a8-43f0-bf74-781e3568ff4e nodeName:}" failed. No retries permitted until 2026-09-17 03:17:34.337412634 +0000 UTC m=+293.878104800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-tls") pod "node-exporter-8lxh2" (UID: "22097a94-19a8-43f0-bf74-781e3568ff4e") : secret "node-exporter-tls" not found Sep 17 03:17:33.837896 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837654 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22097a94-19a8-43f0-bf74-781e3568ff4e-metrics-client-ca\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.837896 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.837758 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.839400 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.839382 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.846181 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.846134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slbns\" (UniqueName: \"kubernetes.io/projected/22097a94-19a8-43f0-bf74-781e3568ff4e-kube-api-access-slbns\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:33.895477 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.895445 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:33.998631 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:33.998553 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:34.108936 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.108904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:34.271442 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.271368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:34.341527 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.341501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-tls\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:34.343855 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.343828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/22097a94-19a8-43f0-bf74-781e3568ff4e-node-exporter-tls\") pod \"node-exporter-8lxh2\" (UID: \"22097a94-19a8-43f0-bf74-781e3568ff4e\") " pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:34.596108 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.596076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8lxh2" Sep 17 03:17:34.609087 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:17:34.609027 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22097a94_19a8_43f0_bf74_781e3568ff4e.slice/crio-2771888dd6dc549c8a26e485afae605133de5726708680c6348c84a5af744a70 WatchSource:0}: Error finding container 2771888dd6dc549c8a26e485afae605133de5726708680c6348c84a5af744a70: Status 404 returned error can't find the container with id 2771888dd6dc549c8a26e485afae605133de5726708680c6348c84a5af744a70 Sep 17 03:17:34.620957 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.620913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:34.699194 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.699166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:34.788551 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.788522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:34.927809 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:34.927731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lxh2" event={"ID":"22097a94-19a8-43f0-bf74-781e3568ff4e","Type":"ContainerStarted","Data":"2771888dd6dc549c8a26e485afae605133de5726708680c6348c84a5af744a70"} Sep 17 03:17:35.904882 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:17:35.904844 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rxmmr" podUID="b593d1c3-6930-4400-b8b8-7d7783c21668" Sep 17 03:17:35.933344 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:35.933262 2579 generic.go:356] "Generic (PLEG): container finished" podID="22097a94-19a8-43f0-bf74-781e3568ff4e" containerID="e019317e82a663b921d9b948f95d7364e808e998951ef57fcae4e84db4503b9e" exitCode=0 Sep 17 03:17:35.933344 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:35.933331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lxh2" event={"ID":"22097a94-19a8-43f0-bf74-781e3568ff4e","Type":"ContainerDied","Data":"e019317e82a663b921d9b948f95d7364e808e998951ef57fcae4e84db4503b9e"} Sep 17 03:17:36.570302 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:36.570271 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:36.648359 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:36.648329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:36.707341 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:36.707305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:36.942575 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:36.942498 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lxh2" event={"ID":"22097a94-19a8-43f0-bf74-781e3568ff4e","Type":"ContainerStarted","Data":"7192794e11879b0cadc164225ea8bb6a776d75ffe2f66694b4cd514bf2b5cea0"} Sep 17 03:17:36.942575 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:36.942567 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8lxh2" event={"ID":"22097a94-19a8-43f0-bf74-781e3568ff4e","Type":"ContainerStarted","Data":"80fbad7929211c0c3498938cb55ca4aad848e868ffde0a91999151ad2e380d32"} Sep 17 03:17:36.964392 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:36.964351 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8lxh2" podStartSLOduration=2.836769001 podStartE2EDuration="3.964336574s" totalImagesPullingTime="1.058174809s" totalInitContainerRuntime="69.392764ms" isStatefulPod=true podCreationTimestamp="2026-09-17 03:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:17:36.962020367 +0000 UTC m=+296.502712596" watchObservedRunningTime="2026-09-17 03:17:36.964336574 +0000 UTC m=+296.505028761" Sep 17 03:17:37.162127 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:37.162093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:37.913378 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:37.913344 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6lgbn" Sep 17 03:17:38.408479 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:38.408447 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:39.039332 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:39.039301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:39.857492 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:39.857460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:40.815987 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:40.815956 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:17:40.816880 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:40.816858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:17:40.822797 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:40.822779 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 03:17:44.115904 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:44.115866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:44.175466 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:44.175435 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:45.017520 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:45.017489 2579 patch_prober.go:28] interesting pod/image-registry-54667bf9b4-9dn5h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 03:17:45.017676 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:45.017545 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" podUID="897be0b4-b25f-4e3d-823f-7c69493ee9dc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 03:17:45.945693 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:45.945660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:46.002690 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:46.002664 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:46.847107 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:46.847080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:46.908385 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:46.908362 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54667bf9b4-9dn5h" Sep 17 03:17:47.024339 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:47.024301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:47.082115 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:47.082089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:47.150554 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:47.150490 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:47.205682 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:47.205658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:48.904138 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:48.904104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:17:52.544535 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:52.544505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:52.642802 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:52.642774 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:52.700068 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:52.700044 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:52.840484 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:52.840401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:53.216576 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:53.216494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:53.278035 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:53.278002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:53.418177 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:53.418013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:53.485103 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:53.485029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:53.625712 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:53.625681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:53.815440 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:53.815401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:53.869585 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:53.869562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:54.027257 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:54.027229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:54.428708 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:54.428676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:54.529110 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:54.529082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:55.866357 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:55.866318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:55.966398 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:55.966367 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:56.066917 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:56.066885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:56.133678 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:56.133602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:58.161463 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:58.161431 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:17:58.216070 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:17:58.216041 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:00.712413 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:00.712377 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" podUID="bc87ff27-09d9-4cd5-86cf-bb2f22b892a1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 03:18:02.040656 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.040623 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c79d9c68-djllh"] Sep 17 03:18:02.043595 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.043580 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.048645 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.048571 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 03:18:02.048645 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.048620 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 03:18:02.048867 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.048644 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 03:18:02.048867 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.048571 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 03:18:02.048867 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.048572 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 03:18:02.048867 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.048652 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 03:18:02.048867 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.048833 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 03:18:02.049200 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.049183 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bl97j\"" Sep 17 03:18:02.054812 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.054795 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c79d9c68-djllh"] Sep 17 03:18:02.141405 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.141374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-serving-cert\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.141545 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.141417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-oauth-serving-cert\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.141545 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.141502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-oauth-config\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.141545 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.141536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-service-ca\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.141663 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.141553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbtgs\" (UniqueName: \"kubernetes.io/projected/a21a4b6f-994e-49e4-b5eb-213d957a3698-kube-api-access-fbtgs\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.141663 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.141588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-config\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.242463 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.242428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-oauth-serving-cert\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.242637 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.242490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-oauth-config\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.242637 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.242512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-service-ca\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.242637 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.242527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbtgs\" (UniqueName: \"kubernetes.io/projected/a21a4b6f-994e-49e4-b5eb-213d957a3698-kube-api-access-fbtgs\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.242637 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.242560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-config\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.242637 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.242591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-serving-cert\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.243441 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.243234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-service-ca\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.243441 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.243255 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-oauth-serving-cert\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.243441 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.243310 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-config\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.245090 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.245069 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-oauth-config\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.245229 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.245214 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-serving-cert\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.252349 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.252325 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbtgs\" (UniqueName: \"kubernetes.io/projected/a21a4b6f-994e-49e4-b5eb-213d957a3698-kube-api-access-fbtgs\") pod \"console-64c79d9c68-djllh\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.352539 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.352462 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:02.625130 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.625108 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c79d9c68-djllh"] Sep 17 03:18:02.627614 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:18:02.627587 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21a4b6f_994e_49e4_b5eb_213d957a3698.slice/crio-eda50349d714bbe247793cd17c234f8aa0460a1e547de9cc8e952b0387de7fa2 WatchSource:0}: Error finding container eda50349d714bbe247793cd17c234f8aa0460a1e547de9cc8e952b0387de7fa2: Status 404 returned error can't find the container with id eda50349d714bbe247793cd17c234f8aa0460a1e547de9cc8e952b0387de7fa2 Sep 17 03:18:02.629547 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:02.629533 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:18:03.019585 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:03.019505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c79d9c68-djllh" event={"ID":"a21a4b6f-994e-49e4-b5eb-213d957a3698","Type":"ContainerStarted","Data":"eda50349d714bbe247793cd17c234f8aa0460a1e547de9cc8e952b0387de7fa2"} Sep 17 03:18:06.032014 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:06.031975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c79d9c68-djllh" event={"ID":"a21a4b6f-994e-49e4-b5eb-213d957a3698","Type":"ContainerStarted","Data":"06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50"} Sep 17 03:18:06.051011 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:06.050963 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c79d9c68-djllh" podStartSLOduration=1.147539703 podStartE2EDuration="4.050950084s" totalImagesPullingTime="2.903410381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:18:06.0489223 +0000 UTC m=+325.589614487" watchObservedRunningTime="2026-09-17 03:18:06.050950084 +0000 UTC m=+325.591642271" Sep 17 03:18:07.228363 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:07.228325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:07.327322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:07.327283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:07.395588 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:07.395531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:07.455849 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:07.455815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:10.448563 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:10.448536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:10.503029 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:10.502985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:10.712554 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:10.712477 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" podUID="bc87ff27-09d9-4cd5-86cf-bb2f22b892a1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 03:18:12.352818 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:12.352773 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:12.353263 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:12.352876 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:12.357646 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:12.357621 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:13.057673 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:13.057644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:14.863684 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:14.863653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:14.963673 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:14.963622 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:15.664369 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:15.664339 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:15.721664 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:15.721631 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:18.255440 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:18.255402 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:20.712066 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:20.712027 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" podUID="bc87ff27-09d9-4cd5-86cf-bb2f22b892a1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 03:18:20.712505 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:20.712104 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" Sep 17 03:18:20.712578 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:20.712552 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"99b4e0998c6279b23037f20d6b3ae65c15bbd40803f890f93cc54a8a19a44da3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 17 03:18:20.712629 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:20.712602 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" podUID="bc87ff27-09d9-4cd5-86cf-bb2f22b892a1" containerName="service-proxy" containerID="cri-o://99b4e0998c6279b23037f20d6b3ae65c15bbd40803f890f93cc54a8a19a44da3" gracePeriod=30 Sep 17 03:18:20.881983 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:20.881956 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c79d9c68-djllh"] Sep 17 03:18:20.988386 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:20.988314 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:21.081765 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:21.081730 2579 generic.go:356] "Generic (PLEG): container finished" podID="bc87ff27-09d9-4cd5-86cf-bb2f22b892a1" containerID="99b4e0998c6279b23037f20d6b3ae65c15bbd40803f890f93cc54a8a19a44da3" exitCode=2 Sep 17 03:18:21.081919 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:21.081802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" event={"ID":"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1","Type":"ContainerDied","Data":"99b4e0998c6279b23037f20d6b3ae65c15bbd40803f890f93cc54a8a19a44da3"} Sep 17 03:18:21.081919 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:21.081842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff85b7477-q75tf" event={"ID":"bc87ff27-09d9-4cd5-86cf-bb2f22b892a1","Type":"ContainerStarted","Data":"4dd1378940a680e0e9afdaf54d5143d992d32aa5a809c4a2b56f8ced729829df"} Sep 17 03:18:21.085126 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:21.085084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:21.186322 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:21.186259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:22.351843 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:22.351810 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:22.410897 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:22.410872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:25.576000 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:25.575968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:25.677455 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:25.677429 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:25.738312 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:25.738282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:45.902663 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:45.902549 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64c79d9c68-djllh" podUID="a21a4b6f-994e-49e4-b5eb-213d957a3698" containerName="console" containerID="cri-o://06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50" gracePeriod=15 Sep 17 03:18:46.138293 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.138267 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:46.163183 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.163103 2579 generic.go:356] "Generic (PLEG): container finished" podID="a21a4b6f-994e-49e4-b5eb-213d957a3698" containerID="06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50" exitCode=0 Sep 17 03:18:46.163291 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.163175 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c79d9c68-djllh" Sep 17 03:18:46.163291 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.163191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c79d9c68-djllh" event={"ID":"a21a4b6f-994e-49e4-b5eb-213d957a3698","Type":"ContainerDied","Data":"06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50"} Sep 17 03:18:46.163291 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.163244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c79d9c68-djllh" event={"ID":"a21a4b6f-994e-49e4-b5eb-213d957a3698","Type":"ContainerDied","Data":"eda50349d714bbe247793cd17c234f8aa0460a1e547de9cc8e952b0387de7fa2"} Sep 17 03:18:46.163291 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.163268 2579 scope.go:117] "RemoveContainer" containerID="06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50" Sep 17 03:18:46.171705 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.171687 2579 scope.go:117] "RemoveContainer" containerID="06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50" Sep 17 03:18:46.172002 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:18:46.171983 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50\": container with ID starting with 06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50 not found: ID does not exist" containerID="06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50" Sep 17 03:18:46.172063 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.172010 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50"} err="failed to get container status \"06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50\": rpc error: code = NotFound desc = could not find container \"06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50\": container with ID starting with 06675cb32d41ae52663d1bee6ffbac255942bc8d89883e7a9518d4fba8a9bb50 not found: ID does not exist" Sep 17 03:18:46.274845 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.274814 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-oauth-config\") pod \"a21a4b6f-994e-49e4-b5eb-213d957a3698\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " Sep 17 03:18:46.274845 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.274849 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-config\") pod \"a21a4b6f-994e-49e4-b5eb-213d957a3698\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " Sep 17 03:18:46.275057 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.274869 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-serving-cert\") pod \"a21a4b6f-994e-49e4-b5eb-213d957a3698\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " Sep 17 03:18:46.275057 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.274899 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-service-ca\") pod \"a21a4b6f-994e-49e4-b5eb-213d957a3698\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " Sep 17 03:18:46.275057 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.274982 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbtgs\" (UniqueName: \"kubernetes.io/projected/a21a4b6f-994e-49e4-b5eb-213d957a3698-kube-api-access-fbtgs\") pod \"a21a4b6f-994e-49e4-b5eb-213d957a3698\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " Sep 17 03:18:46.275057 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.275028 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-oauth-serving-cert\") pod \"a21a4b6f-994e-49e4-b5eb-213d957a3698\" (UID: \"a21a4b6f-994e-49e4-b5eb-213d957a3698\") " Sep 17 03:18:46.275398 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.275293 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-config" (OuterVolumeSpecName: "console-config") pod "a21a4b6f-994e-49e4-b5eb-213d957a3698" (UID: "a21a4b6f-994e-49e4-b5eb-213d957a3698"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:46.275398 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.275380 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-service-ca" (OuterVolumeSpecName: "service-ca") pod "a21a4b6f-994e-49e4-b5eb-213d957a3698" (UID: "a21a4b6f-994e-49e4-b5eb-213d957a3698"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:46.275577 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.275496 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a21a4b6f-994e-49e4-b5eb-213d957a3698" (UID: "a21a4b6f-994e-49e4-b5eb-213d957a3698"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:18:46.277223 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.277195 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21a4b6f-994e-49e4-b5eb-213d957a3698-kube-api-access-fbtgs" (OuterVolumeSpecName: "kube-api-access-fbtgs") pod "a21a4b6f-994e-49e4-b5eb-213d957a3698" (UID: "a21a4b6f-994e-49e4-b5eb-213d957a3698"). InnerVolumeSpecName "kube-api-access-fbtgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:18:46.277625 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.277598 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a21a4b6f-994e-49e4-b5eb-213d957a3698" (UID: "a21a4b6f-994e-49e4-b5eb-213d957a3698"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:46.277625 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.277613 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a21a4b6f-994e-49e4-b5eb-213d957a3698" (UID: "a21a4b6f-994e-49e4-b5eb-213d957a3698"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:18:46.375783 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.375752 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:18:46.375783 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.375778 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbtgs\" (UniqueName: \"kubernetes.io/projected/a21a4b6f-994e-49e4-b5eb-213d957a3698-kube-api-access-fbtgs\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:18:46.375783 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.375789 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-oauth-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:18:46.375992 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.375800 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-oauth-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:18:46.375992 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.375809 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:18:46.375992 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.375818 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a21a4b6f-994e-49e4-b5eb-213d957a3698-console-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:18:46.484312 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.484274 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c79d9c68-djllh"] Sep 17 03:18:46.486024 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.486001 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c79d9c68-djllh"] Sep 17 03:18:46.908333 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:46.908302 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a21a4b6f-994e-49e4-b5eb-213d957a3698" path="/var/lib/kubelet/pods/a21a4b6f-994e-49e4-b5eb-213d957a3698/volumes" Sep 17 03:18:52.891713 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:52.891673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:53.173721 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:53.173640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:54.734603 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:54.734566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:18:54.737128 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:54.737103 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b593d1c3-6930-4400-b8b8-7d7783c21668-metrics-certs\") pod \"network-metrics-daemon-rxmmr\" (UID: \"b593d1c3-6930-4400-b8b8-7d7783c21668\") " pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:18:54.908318 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:54.908292 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltdl9\"" Sep 17 03:18:54.915793 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:54.915777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxmmr" Sep 17 03:18:55.187336 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:55.187309 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxmmr"] Sep 17 03:18:55.190525 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:18:55.190501 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb593d1c3_6930_4400_b8b8_7d7783c21668.slice/crio-0da27790a3bf0e4e704c92cae7cf711428fd81bdc20923b646fb0b6f50770aae WatchSource:0}: Error finding container 0da27790a3bf0e4e704c92cae7cf711428fd81bdc20923b646fb0b6f50770aae: Status 404 returned error can't find the container with id 0da27790a3bf0e4e704c92cae7cf711428fd81bdc20923b646fb0b6f50770aae Sep 17 03:18:56.198112 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:56.198083 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxmmr" event={"ID":"b593d1c3-6930-4400-b8b8-7d7783c21668","Type":"ContainerStarted","Data":"571b0f164fc4ab58c3c1c9296d78028ed479c5c8cf05c86c039bfd492f82a2ea"} Sep 17 03:18:56.198436 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:56.198161 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxmmr" event={"ID":"b593d1c3-6930-4400-b8b8-7d7783c21668","Type":"ContainerStarted","Data":"0da27790a3bf0e4e704c92cae7cf711428fd81bdc20923b646fb0b6f50770aae"} Sep 17 03:18:56.318794 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:56.318758 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:56.372200 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:56.372171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:57.203168 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.203116 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxmmr" event={"ID":"b593d1c3-6930-4400-b8b8-7d7783c21668","Type":"ContainerStarted","Data":"c1f286ba91c0586f777ccc77a00242b924800e164aaed4a921874f0981798407"} Sep 17 03:18:57.220840 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.220788 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rxmmr" podStartSLOduration=376.378099824 podStartE2EDuration="6m17.220772986s" totalImagesPullingTime="842.673162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:18:57.219290499 +0000 UTC m=+376.759982686" watchObservedRunningTime="2026-09-17 03:18:57.220772986 +0000 UTC m=+376.761465203" Sep 17 03:18:57.307829 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.307803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:57.408973 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.408944 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:57.974249 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.974218 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9"] Sep 17 03:18:57.974459 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.974447 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21a4b6f-994e-49e4-b5eb-213d957a3698" containerName="console" Sep 17 03:18:57.974507 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.974461 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21a4b6f-994e-49e4-b5eb-213d957a3698" containerName="console" Sep 17 03:18:57.974507 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.974502 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a21a4b6f-994e-49e4-b5eb-213d957a3698" containerName="console" Sep 17 03:18:57.977449 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.977433 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:57.980705 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.980674 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 17 03:18:57.980705 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.980680 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 17 03:18:57.980955 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.980720 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bxxl2\"" Sep 17 03:18:57.980955 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.980807 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 17 03:18:57.980955 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.980817 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 17 03:18:57.981073 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.981057 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 17 03:18:57.986836 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.986815 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 17 03:18:57.993299 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:57.991782 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9"] Sep 17 03:18:58.059694 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.059658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-metrics-client-ca\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.059694 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.059702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-secret-telemeter-client\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.059940 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.059720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-federate-client-tls\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.059940 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.059737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.059940 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.059800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-serving-certs-ca-bundle\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.059940 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.059848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.059940 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.059907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvctq\" (UniqueName: \"kubernetes.io/projected/e3d5dfe4-889e-4009-a65c-7435d3b8487d-kube-api-access-hvctq\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.060122 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.059944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-telemeter-client-tls\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.100825 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.100798 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:58.160317 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.160289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-secret-telemeter-client\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.160451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.160324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-federate-client-tls\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.160451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.160349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.160451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.160373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-serving-certs-ca-bundle\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.160451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.160397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.160451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.160446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvctq\" (UniqueName: \"kubernetes.io/projected/e3d5dfe4-889e-4009-a65c-7435d3b8487d-kube-api-access-hvctq\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.160717 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.160482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-telemeter-client-tls\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.160717 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.160515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-metrics-client-ca\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.161410 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.161345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.161616 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.161588 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-serving-certs-ca-bundle\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.161731 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.161709 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d5dfe4-889e-4009-a65c-7435d3b8487d-metrics-client-ca\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.162979 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.162954 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-secret-telemeter-client\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.163107 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.163082 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.163174 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.163157 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-federate-client-tls\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.163908 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.163878 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3d5dfe4-889e-4009-a65c-7435d3b8487d-telemeter-client-tls\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.168970 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.168948 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvctq\" (UniqueName: \"kubernetes.io/projected/e3d5dfe4-889e-4009-a65c-7435d3b8487d-kube-api-access-hvctq\") pod \"telemeter-client-754d5dd9c9-mb7v9\" (UID: \"e3d5dfe4-889e-4009-a65c-7435d3b8487d\") " pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.183658 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.183636 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:18:58.286828 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.286809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" Sep 17 03:18:58.565051 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:58.564972 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9"] Sep 17 03:18:58.568220 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:18:58.568194 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d5dfe4_889e_4009_a65c_7435d3b8487d.slice/crio-bd12a998c513a69ec0f06c04c440dbf67fa42c03cf1cff6a38364376b246a032 WatchSource:0}: Error finding container bd12a998c513a69ec0f06c04c440dbf67fa42c03cf1cff6a38364376b246a032: Status 404 returned error can't find the container with id bd12a998c513a69ec0f06c04c440dbf67fa42c03cf1cff6a38364376b246a032 Sep 17 03:18:59.214175 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:18:59.214122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" event={"ID":"e3d5dfe4-889e-4009-a65c-7435d3b8487d","Type":"ContainerStarted","Data":"bd12a998c513a69ec0f06c04c440dbf67fa42c03cf1cff6a38364376b246a032"} Sep 17 03:19:02.227969 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:02.227928 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" event={"ID":"e3d5dfe4-889e-4009-a65c-7435d3b8487d","Type":"ContainerStarted","Data":"c5a8b0392c6c8fb64db2167ea5bb2f57ab090c653f387451300b832f3d1a3d06"} Sep 17 03:19:03.237880 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:03.237839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" event={"ID":"e3d5dfe4-889e-4009-a65c-7435d3b8487d","Type":"ContainerStarted","Data":"51513fd702ffad120d01b42781b97c72ec321f34a46bf9e03f4ffe755471f9f8"} Sep 17 03:19:03.238286 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:03.237941 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" event={"ID":"e3d5dfe4-889e-4009-a65c-7435d3b8487d","Type":"ContainerStarted","Data":"5b61f1d36621f3e6044efe29d45dd640c2a602c05d556ede3daf9a4c8bde8c52"} Sep 17 03:19:03.261543 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:03.261501 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-754d5dd9c9-mb7v9" podStartSLOduration=2.247591749 podStartE2EDuration="6.261487238s" totalImagesPullingTime="4.013895489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:18:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:19:03.260726166 +0000 UTC m=+382.801418368" watchObservedRunningTime="2026-09-17 03:19:03.261487238 +0000 UTC m=+382.802179451" Sep 17 03:19:03.396403 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:03.396358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:19:03.462778 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:03.462742 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:19:14.189678 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:14.189618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:19:14.247630 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:14.247575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:19:14.302961 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:19:14.302920 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:01.089709 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:01.089671 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:01.191090 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:01.191053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:08.123658 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.123625 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:08.177020 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.176952 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:08.841900 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.841862 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f9b8bf974-w7zck"] Sep 17 03:20:08.845234 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.845203 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:08.850818 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.850789 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 03:20:08.851265 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.850793 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bl97j\"" Sep 17 03:20:08.851265 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.850789 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 03:20:08.851265 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.850852 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 03:20:08.851265 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.850860 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 03:20:08.851265 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.850879 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 03:20:08.851265 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.850910 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 03:20:08.851265 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.850976 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 03:20:08.856491 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.856225 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 03:20:08.857331 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.857308 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9b8bf974-w7zck"] Sep 17 03:20:08.898044 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.898009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:08.951589 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.951560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-serving-cert\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:08.951589 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.951593 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl7fb\" (UniqueName: \"kubernetes.io/projected/34836c06-9635-45d9-9e5f-5d29b9f95eae-kube-api-access-gl7fb\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:08.951787 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.951611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-config\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:08.951787 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.951712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-trusted-ca-bundle\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:08.951787 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.951742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-oauth-config\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:08.951787 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.951767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-service-ca\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:08.951787 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.951786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-oauth-serving-cert\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:08.954554 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:08.954535 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:09.048333 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.048302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:09.052797 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.052779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl7fb\" (UniqueName: \"kubernetes.io/projected/34836c06-9635-45d9-9e5f-5d29b9f95eae-kube-api-access-gl7fb\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.052856 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.052807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-config\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.052891 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.052857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-trusted-ca-bundle\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.052923 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.052887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-oauth-config\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.052923 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.052917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-service-ca\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.053004 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.052938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-oauth-serving-cert\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.053004 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.052985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-serving-cert\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.053726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.053617 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-config\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.053726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.053658 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-service-ca\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.053726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.053731 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-oauth-serving-cert\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.053726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.053743 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-trusted-ca-bundle\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.055497 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.055477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-serving-cert\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.055633 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.055618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-oauth-config\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.061908 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.061877 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl7fb\" (UniqueName: \"kubernetes.io/projected/34836c06-9635-45d9-9e5f-5d29b9f95eae-kube-api-access-gl7fb\") pod \"console-f9b8bf974-w7zck\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.160355 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.160261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:09.339077 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.339025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:09.433729 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.433707 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f9b8bf974-w7zck"] Sep 17 03:20:09.436055 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:20:09.436022 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34836c06_9635_45d9_9e5f_5d29b9f95eae.slice/crio-92473df88a06bb7ba4305d9df03b556c1c236b6af439fb8bce911eee59e06a89 WatchSource:0}: Error finding container 92473df88a06bb7ba4305d9df03b556c1c236b6af439fb8bce911eee59e06a89: Status 404 returned error can't find the container with id 92473df88a06bb7ba4305d9df03b556c1c236b6af439fb8bce911eee59e06a89 Sep 17 03:20:09.465121 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.465092 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b8bf974-w7zck" event={"ID":"34836c06-9635-45d9-9e5f-5d29b9f95eae","Type":"ContainerStarted","Data":"92473df88a06bb7ba4305d9df03b556c1c236b6af439fb8bce911eee59e06a89"} Sep 17 03:20:09.645758 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.645729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:09.721551 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:09.721467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:10.471181 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:10.471111 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b8bf974-w7zck" event={"ID":"34836c06-9635-45d9-9e5f-5d29b9f95eae","Type":"ContainerStarted","Data":"7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24"} Sep 17 03:20:10.495381 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:10.495341 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f9b8bf974-w7zck" podStartSLOduration=2.4953258 podStartE2EDuration="2.4953258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:20:10.493746608 +0000 UTC m=+450.034438819" watchObservedRunningTime="2026-09-17 03:20:10.4953258 +0000 UTC m=+450.036017968" Sep 17 03:20:19.160738 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:19.160630 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:19.160738 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:19.160716 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:19.165575 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:19.165556 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:19.504087 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:19.504016 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:20:19.644040 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:19.644009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:19.704067 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:19.704037 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:19.762233 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:19.762137 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:20.058697 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:20.058674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:20.159924 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:20.159872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:37.358805 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:37.358754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:37.458534 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:37.458489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:20:37.683876 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:20:37.683786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:08.804846 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:08.804807 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:08.858556 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:08.858523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:13.176128 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:13.176046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:22.258027 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:22.257992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:22.359539 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:22.359503 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:43.762503 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:43.762372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:45.128216 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:45.128172 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:47.378971 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:47.378928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:47.480546 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:47.480522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:48.939970 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:48.939935 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:49.033254 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:49.033200 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:49.156504 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:49.156461 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:49.257667 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:49.257588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:51.261503 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:51.261467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:51.467568 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:51.467534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:54.360874 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:54.360838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:54.463797 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:54.463766 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:58.394039 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:58.394003 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:21:59.748966 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:21:59.748937 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:05.388854 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:05.388822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:05.482771 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:05.482736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:11.432852 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:11.432817 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:11.533616 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:11.533580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:13.647538 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:13.647510 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:17.157068 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:17.157030 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:27.620890 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:27.620858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:27.720529 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:27.720499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:28.194759 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.194719 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:28.459763 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.459672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:28.555847 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.555813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:28.579762 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.579730 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v"] Sep 17 03:22:28.583180 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.583136 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.586807 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.586786 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 03:22:28.586916 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.586877 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 17 03:22:28.586981 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.586913 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 03:22:28.586981 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.586933 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 17 03:22:28.587210 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.587193 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkzz5\"" Sep 17 03:22:28.600388 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.600365 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v"] Sep 17 03:22:28.622314 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.622287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tvrw\" (UniqueName: \"kubernetes.io/projected/9fd21997-669e-4a64-95ee-27a62c0d36dc-kube-api-access-4tvrw\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.622635 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.622323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9fd21997-669e-4a64-95ee-27a62c0d36dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.622635 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.622356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9fd21997-669e-4a64-95ee-27a62c0d36dc-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.622635 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.622375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fd21997-669e-4a64-95ee-27a62c0d36dc-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.622635 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.622391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd21997-669e-4a64-95ee-27a62c0d36dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.722840 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.722747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tvrw\" (UniqueName: \"kubernetes.io/projected/9fd21997-669e-4a64-95ee-27a62c0d36dc-kube-api-access-4tvrw\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.722840 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.722789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9fd21997-669e-4a64-95ee-27a62c0d36dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.722840 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.722825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9fd21997-669e-4a64-95ee-27a62c0d36dc-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.722840 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.722841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fd21997-669e-4a64-95ee-27a62c0d36dc-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.723136 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.722858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd21997-669e-4a64-95ee-27a62c0d36dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.723326 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.723296 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9fd21997-669e-4a64-95ee-27a62c0d36dc-manifests\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.723966 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.723945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:28.725574 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.725550 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fd21997-669e-4a64-95ee-27a62c0d36dc-tmp\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.725655 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.725627 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd21997-669e-4a64-95ee-27a62c0d36dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.725696 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.725662 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9fd21997-669e-4a64-95ee-27a62c0d36dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.731136 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.731111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tvrw\" (UniqueName: \"kubernetes.io/projected/9fd21997-669e-4a64-95ee-27a62c0d36dc-kube-api-access-4tvrw\") pod \"opendatahub-operator-controller-manager-6b9b769b77-v8j7v\" (UID: \"9fd21997-669e-4a64-95ee-27a62c0d36dc\") " pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.824627 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.824592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:28.892773 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.892739 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:28.893718 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.893692 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:28.950231 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:28.950185 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:29.051410 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:29.051377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:29.158663 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:29.158634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:29.175618 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:29.175568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v"] Sep 17 03:22:29.177807 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:22:29.177778 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd21997_669e_4a64_95ee_27a62c0d36dc.slice/crio-a5f315b1dce851d2946313af076aebe40bb10c95969405fac8e0ca4c99584158 WatchSource:0}: Error finding container a5f315b1dce851d2946313af076aebe40bb10c95969405fac8e0ca4c99584158: Status 404 returned error can't find the container with id a5f315b1dce851d2946313af076aebe40bb10c95969405fac8e0ca4c99584158 Sep 17 03:22:29.941807 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:29.941775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" event={"ID":"9fd21997-669e-4a64-95ee-27a62c0d36dc","Type":"ContainerStarted","Data":"a5f315b1dce851d2946313af076aebe40bb10c95969405fac8e0ca4c99584158"} Sep 17 03:22:29.949420 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:29.949392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:30.051586 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:30.051550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:32.954895 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:32.954864 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" event={"ID":"9fd21997-669e-4a64-95ee-27a62c0d36dc","Type":"ContainerStarted","Data":"8a0047548c2a8e54044a819bff671cf188966584f827b1b8337c93a3b1e2188e"} Sep 17 03:22:33.960027 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:33.959995 2579 generic.go:356] "Generic (PLEG): container finished" podID="9fd21997-669e-4a64-95ee-27a62c0d36dc" containerID="8a0047548c2a8e54044a819bff671cf188966584f827b1b8337c93a3b1e2188e" exitCode=0 Sep 17 03:22:33.960462 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:33.960066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" event={"ID":"9fd21997-669e-4a64-95ee-27a62c0d36dc","Type":"ContainerDied","Data":"8a0047548c2a8e54044a819bff671cf188966584f827b1b8337c93a3b1e2188e"} Sep 17 03:22:34.965530 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:34.965493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" event={"ID":"9fd21997-669e-4a64-95ee-27a62c0d36dc","Type":"ContainerStarted","Data":"a2e2b548480aee131bd6b3e23362dc6bfbe41ec1e65e19bdc829c7b99003db59"} Sep 17 03:22:34.965929 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:34.965629 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:34.990063 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:34.990017 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" podStartSLOduration=2.428071303 podStartE2EDuration="6.99000169s" totalImagesPullingTime="3.514641387s" totalInitContainerRuntime="1.047289s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:34.989286265 +0000 UTC m=+594.529978452" watchObservedRunningTime="2026-09-17 03:22:34.99000169 +0000 UTC m=+594.530693876" Sep 17 03:22:40.125673 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:40.125639 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:40.233466 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:40.233430 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:40.844640 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:40.844613 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:22:40.845871 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:40.845847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:22:43.142860 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:43.142829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:43.243646 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:43.243614 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:43.605905 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:43.605877 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:43.707399 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:43.707358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:45.971299 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:45.971271 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b9b769b77-v8j7v" Sep 17 03:22:46.339430 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.339400 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh"] Sep 17 03:22:46.341764 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.341749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.344886 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.344863 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 17 03:22:46.345003 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.344914 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rdcwp\"" Sep 17 03:22:46.345003 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.344955 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 03:22:46.345095 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.345001 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 17 03:22:46.345095 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.345023 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:22:46.345194 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.345103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 17 03:22:46.350873 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.350854 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh"] Sep 17 03:22:46.462111 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.462086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45c4ea28-ae8e-4018-9d64-8093ed157e55-metrics-cert\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.462272 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.462130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz2hj\" (UniqueName: \"kubernetes.io/projected/45c4ea28-ae8e-4018-9d64-8093ed157e55-kube-api-access-nz2hj\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.462272 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.462210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45c4ea28-ae8e-4018-9d64-8093ed157e55-manager-config\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.462272 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.462256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c4ea28-ae8e-4018-9d64-8093ed157e55-cert\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.563342 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.563314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45c4ea28-ae8e-4018-9d64-8093ed157e55-manager-config\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.563416 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.563370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c4ea28-ae8e-4018-9d64-8093ed157e55-cert\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.563416 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.563392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45c4ea28-ae8e-4018-9d64-8093ed157e55-metrics-cert\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.563488 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.563448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz2hj\" (UniqueName: \"kubernetes.io/projected/45c4ea28-ae8e-4018-9d64-8093ed157e55-kube-api-access-nz2hj\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.564057 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.564036 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45c4ea28-ae8e-4018-9d64-8093ed157e55-manager-config\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.565963 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.565943 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45c4ea28-ae8e-4018-9d64-8093ed157e55-metrics-cert\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.566071 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.566053 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c4ea28-ae8e-4018-9d64-8093ed157e55-cert\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.572345 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.572321 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz2hj\" (UniqueName: \"kubernetes.io/projected/45c4ea28-ae8e-4018-9d64-8093ed157e55-kube-api-access-nz2hj\") pod \"lws-controller-manager-dd99db947-r7fgh\" (UID: \"45c4ea28-ae8e-4018-9d64-8093ed157e55\") " pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.651870 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.651800 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:46.923763 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:46.923742 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh"] Sep 17 03:22:46.925776 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:22:46.925749 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c4ea28_ae8e_4018_9d64_8093ed157e55.slice/crio-b1dcb117741b0b5c58dfa95ec1620cf9f29031fe7c5b9bf50077c32c3bd854b3 WatchSource:0}: Error finding container b1dcb117741b0b5c58dfa95ec1620cf9f29031fe7c5b9bf50077c32c3bd854b3: Status 404 returned error can't find the container with id b1dcb117741b0b5c58dfa95ec1620cf9f29031fe7c5b9bf50077c32c3bd854b3 Sep 17 03:22:47.007845 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:47.007811 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" event={"ID":"45c4ea28-ae8e-4018-9d64-8093ed157e55","Type":"ContainerStarted","Data":"b1dcb117741b0b5c58dfa95ec1620cf9f29031fe7c5b9bf50077c32c3bd854b3"} Sep 17 03:22:47.645512 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:47.645465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:47.789164 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:47.789108 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:49.402780 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:49.402753 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:49.535342 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:49.535316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:50.022340 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:50.022297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" event={"ID":"45c4ea28-ae8e-4018-9d64-8093ed157e55","Type":"ContainerStarted","Data":"20e6e6b22557081fea5e9dbae17698b5acf36bca004ae9b7a93608e36d1936b8"} Sep 17 03:22:50.022522 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:50.022405 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:22:50.041082 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:50.041036 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" podStartSLOduration=1.645945304 podStartE2EDuration="4.041021958s" totalImagesPullingTime="2.395076654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:50.040104708 +0000 UTC m=+609.580796894" watchObservedRunningTime="2026-09-17 03:22:50.041021958 +0000 UTC m=+609.581714211" Sep 17 03:22:50.810733 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:50.810706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:50.871698 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:50.871670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:51.805205 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:51.805170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:55.152044 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.152007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:55.252385 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.252347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:55.394900 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.394872 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt"] Sep 17 03:22:55.398498 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.398476 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.401560 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.401531 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-54st8\"" Sep 17 03:22:55.401741 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.401721 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 03:22:55.401891 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.401875 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 03:22:55.401983 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.401930 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 17 03:22:55.408743 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.408718 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt"] Sep 17 03:22:55.426335 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.426310 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:55.537647 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5228d6-033c-40f3-9c8e-283ed91b6108-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.537806 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5n4m\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-kube-api-access-r5n4m\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.537806 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.537806 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.537806 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.537806 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.537967 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537817 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.537967 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537832 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.537967 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.537912 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.539253 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.539229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:55.638608 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.638608 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.638854 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.638854 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.638854 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.638854 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.639066 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.639066 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5228d6-033c-40f3-9c8e-283ed91b6108-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.639066 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.638994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5n4m\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-kube-api-access-r5n4m\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.639066 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.639051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.639325 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.639166 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.639325 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.639192 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.639325 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.639235 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.639706 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.639685 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5228d6-033c-40f3-9c8e-283ed91b6108-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.640936 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.640915 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.641769 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.641747 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.647678 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.647653 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5n4m\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-kube-api-access-r5n4m\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.647892 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.647874 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bchwlnt\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.709089 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.709003 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:55.894462 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.894426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:55.986053 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:55.985968 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt"] Sep 17 03:22:55.988708 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:22:55.988684 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5228d6_033c_40f3_9c8e_283ed91b6108.slice/crio-221018e6566aa1bb8e939bcb5207024aeeaa722a60e2500eccb580f968c8459b WatchSource:0}: Error finding container 221018e6566aa1bb8e939bcb5207024aeeaa722a60e2500eccb580f968c8459b: Status 404 returned error can't find the container with id 221018e6566aa1bb8e939bcb5207024aeeaa722a60e2500eccb580f968c8459b Sep 17 03:22:56.045431 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:56.045405 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" event={"ID":"ff5228d6-033c-40f3-9c8e-283ed91b6108","Type":"ContainerStarted","Data":"221018e6566aa1bb8e939bcb5207024aeeaa722a60e2500eccb580f968c8459b"} Sep 17 03:22:58.544658 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.544621 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9fksh"] Sep 17 03:22:58.551351 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.551322 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:22:58.554925 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.554896 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8l8l9\"" Sep 17 03:22:58.555600 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.555574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 17 03:22:58.559501 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.559441 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9fksh"] Sep 17 03:22:58.576778 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.576713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:58.667191 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.667130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmxdv\" (UniqueName: \"kubernetes.io/projected/e926cf37-3538-44e5-a065-5c80b2a6f57e-kube-api-access-bmxdv\") pod \"odh-model-controller-7998c67dc4-9fksh\" (UID: \"e926cf37-3538-44e5-a065-5c80b2a6f57e\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:22:58.667374 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.667196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e926cf37-3538-44e5-a065-5c80b2a6f57e-cert\") pod \"odh-model-controller-7998c67dc4-9fksh\" (UID: \"e926cf37-3538-44e5-a065-5c80b2a6f57e\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:22:58.672821 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.672786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:58.768018 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.767976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmxdv\" (UniqueName: \"kubernetes.io/projected/e926cf37-3538-44e5-a065-5c80b2a6f57e-kube-api-access-bmxdv\") pod \"odh-model-controller-7998c67dc4-9fksh\" (UID: \"e926cf37-3538-44e5-a065-5c80b2a6f57e\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:22:58.768018 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.768017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e926cf37-3538-44e5-a065-5c80b2a6f57e-cert\") pod \"odh-model-controller-7998c67dc4-9fksh\" (UID: \"e926cf37-3538-44e5-a065-5c80b2a6f57e\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:22:58.770809 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.770782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e926cf37-3538-44e5-a065-5c80b2a6f57e-cert\") pod \"odh-model-controller-7998c67dc4-9fksh\" (UID: \"e926cf37-3538-44e5-a065-5c80b2a6f57e\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:22:58.771940 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.771916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:58.776974 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.776954 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmxdv\" (UniqueName: \"kubernetes.io/projected/e926cf37-3538-44e5-a065-5c80b2a6f57e-kube-api-access-bmxdv\") pod \"odh-model-controller-7998c67dc4-9fksh\" (UID: \"e926cf37-3538-44e5-a065-5c80b2a6f57e\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:22:58.865026 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.864963 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:22:58.924434 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.924388 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 03:22:58.924548 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.924493 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 03:22:58.924548 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.924536 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 03:22:58.965429 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:58.965404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:59.030590 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.030563 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2lrnv"] Sep 17 03:22:59.033626 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.033610 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:22:59.036483 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.036456 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 17 03:22:59.036640 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.036622 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tvp49\"" Sep 17 03:22:59.044176 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.044103 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2lrnv"] Sep 17 03:22:59.060312 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.060277 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" event={"ID":"ff5228d6-033c-40f3-9c8e-283ed91b6108","Type":"ContainerStarted","Data":"8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c"} Sep 17 03:22:59.083735 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.083677 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" podStartSLOduration=1.15027434 podStartE2EDuration="4.083657355s" totalImagesPullingTime="2.933383015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:22:59.081882745 +0000 UTC m=+618.622574932" watchObservedRunningTime="2026-09-17 03:22:59.083657355 +0000 UTC m=+618.624349544" Sep 17 03:22:59.134677 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.134652 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9fksh"] Sep 17 03:22:59.137049 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:22:59.137027 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode926cf37_3538_44e5_a065_5c80b2a6f57e.slice/crio-5f1881e717cdec3cfdc67904724f32e232719be497f367eb7fa4892b67e9b10c WatchSource:0}: Error finding container 5f1881e717cdec3cfdc67904724f32e232719be497f367eb7fa4892b67e9b10c: Status 404 returned error can't find the container with id 5f1881e717cdec3cfdc67904724f32e232719be497f367eb7fa4892b67e9b10c Sep 17 03:22:59.171313 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.171281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bc68fe4-15e7-429e-818a-0f3240d271f1-tls-certs\") pod \"model-serving-api-54d89bd5fc-2lrnv\" (UID: \"4bc68fe4-15e7-429e-818a-0f3240d271f1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:22:59.171541 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.171521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2pcs\" (UniqueName: \"kubernetes.io/projected/4bc68fe4-15e7-429e-818a-0f3240d271f1-kube-api-access-j2pcs\") pod \"model-serving-api-54d89bd5fc-2lrnv\" (UID: \"4bc68fe4-15e7-429e-818a-0f3240d271f1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:22:59.271990 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.271956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bc68fe4-15e7-429e-818a-0f3240d271f1-tls-certs\") pod \"model-serving-api-54d89bd5fc-2lrnv\" (UID: \"4bc68fe4-15e7-429e-818a-0f3240d271f1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:22:59.272135 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.272019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2pcs\" (UniqueName: \"kubernetes.io/projected/4bc68fe4-15e7-429e-818a-0f3240d271f1-kube-api-access-j2pcs\") pod \"model-serving-api-54d89bd5fc-2lrnv\" (UID: \"4bc68fe4-15e7-429e-818a-0f3240d271f1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:22:59.272135 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:22:59.272102 2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 17 03:22:59.272236 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:22:59.272201 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc68fe4-15e7-429e-818a-0f3240d271f1-tls-certs podName:4bc68fe4-15e7-429e-818a-0f3240d271f1 nodeName:}" failed. No retries permitted until 2026-09-17 03:22:59.772182825 +0000 UTC m=+619.312874993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4bc68fe4-15e7-429e-818a-0f3240d271f1-tls-certs") pod "model-serving-api-54d89bd5fc-2lrnv" (UID: "4bc68fe4-15e7-429e-818a-0f3240d271f1") : secret "model-serving-api-tls" not found Sep 17 03:22:59.281489 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.281462 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2pcs\" (UniqueName: \"kubernetes.io/projected/4bc68fe4-15e7-429e-818a-0f3240d271f1-kube-api-access-j2pcs\") pod \"model-serving-api-54d89bd5fc-2lrnv\" (UID: \"4bc68fe4-15e7-429e-818a-0f3240d271f1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:22:59.451803 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.451725 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:22:59.709581 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.709507 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:22:59.710972 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.710942 2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body= Sep 17 03:22:59.711108 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.711001 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" podUID="ff5228d6-033c-40f3-9c8e-283ed91b6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" Sep 17 03:22:59.776155 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.776124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bc68fe4-15e7-429e-818a-0f3240d271f1-tls-certs\") pod \"model-serving-api-54d89bd5fc-2lrnv\" (UID: \"4bc68fe4-15e7-429e-818a-0f3240d271f1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:22:59.778801 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.778777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bc68fe4-15e7-429e-818a-0f3240d271f1-tls-certs\") pod \"model-serving-api-54d89bd5fc-2lrnv\" (UID: \"4bc68fe4-15e7-429e-818a-0f3240d271f1\") " pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:22:59.944373 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:22:59.944331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:23:00.065159 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:00.065111 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" event={"ID":"e926cf37-3538-44e5-a065-5c80b2a6f57e","Type":"ContainerStarted","Data":"5f1881e717cdec3cfdc67904724f32e232719be497f367eb7fa4892b67e9b10c"} Sep 17 03:23:00.234783 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:00.234696 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2lrnv"] Sep 17 03:23:00.238405 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:23:00.238373 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc68fe4_15e7_429e_818a_0f3240d271f1.slice/crio-7f4ec3b2fc17d5a4f9c40e1c191b827d9035289f5baad9d589fe74ed74b1fa09 WatchSource:0}: Error finding container 7f4ec3b2fc17d5a4f9c40e1c191b827d9035289f5baad9d589fe74ed74b1fa09: Status 404 returned error can't find the container with id 7f4ec3b2fc17d5a4f9c40e1c191b827d9035289f5baad9d589fe74ed74b1fa09 Sep 17 03:23:00.710254 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:00.710215 2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body= Sep 17 03:23:00.710650 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:00.710277 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" podUID="ff5228d6-033c-40f3-9c8e-283ed91b6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" Sep 17 03:23:01.029090 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:01.029013 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dd99db947-r7fgh" Sep 17 03:23:01.076462 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:01.076177 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" event={"ID":"4bc68fe4-15e7-429e-818a-0f3240d271f1","Type":"ContainerStarted","Data":"7f4ec3b2fc17d5a4f9c40e1c191b827d9035289f5baad9d589fe74ed74b1fa09"} Sep 17 03:23:01.097054 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:01.097020 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt"] Sep 17 03:23:01.710367 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:01.710333 2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" start-of-body= Sep 17 03:23:01.710778 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:01.710396 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" podUID="ff5228d6-033c-40f3-9c8e-283ed91b6108" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.17:15021/healthz/ready\": dial tcp 10.133.0.17:15021: connect: connection refused" Sep 17 03:23:02.036800 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:02.036763 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:02.079302 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:02.079263 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" podUID="ff5228d6-033c-40f3-9c8e-283ed91b6108" containerName="istio-proxy" containerID="cri-o://8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c" gracePeriod=30 Sep 17 03:23:04.088670 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:04.088629 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" event={"ID":"4bc68fe4-15e7-429e-818a-0f3240d271f1","Type":"ContainerStarted","Data":"bb7b3f4dad437ecbf765348da63466aaf88a9980460c7a9b4e4065b7b6b2cd37"} Sep 17 03:23:04.089280 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:04.088736 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:23:04.090240 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:04.090222 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" event={"ID":"e926cf37-3538-44e5-a065-5c80b2a6f57e","Type":"ContainerStarted","Data":"dac47efdc97fe8dea99964855de9d7c5428cf3a8615bb26a4283f940fb801312"} Sep 17 03:23:04.090336 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:04.090265 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:23:04.105666 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:04.105622 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" podStartSLOduration=1.793487866 podStartE2EDuration="5.105611062s" totalImagesPullingTime="3.312123196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:23:04.104965228 +0000 UTC m=+623.645657414" watchObservedRunningTime="2026-09-17 03:23:04.105611062 +0000 UTC m=+623.646303266" Sep 17 03:23:04.122420 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:04.122371 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" podStartSLOduration=1.7454357790000001 podStartE2EDuration="6.122356703s" totalImagesPullingTime="4.376920924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:23:04.121073099 +0000 UTC m=+623.661765286" watchObservedRunningTime="2026-09-17 03:23:04.122356703 +0000 UTC m=+623.663048889" Sep 17 03:23:05.618345 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.618316 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf"] Sep 17 03:23:05.621682 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.621662 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.624882 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.624848 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 17 03:23:05.625022 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.624993 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 17 03:23:05.625022 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.625011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bx4td\"" Sep 17 03:23:05.625267 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.625251 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 17 03:23:05.638059 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.638033 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf"] Sep 17 03:23:05.728843 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.728815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99c0b26-7368-403a-a29e-7c31a754621c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.729028 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.728865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.729028 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.728929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j22p2\" (UniqueName: \"kubernetes.io/projected/d99c0b26-7368-403a-a29e-7c31a754621c-kube-api-access-j22p2\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.729028 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.728985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.729190 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.729045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.729190 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.729084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d99c0b26-7368-403a-a29e-7c31a754621c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.729190 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.729123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99c0b26-7368-403a-a29e-7c31a754621c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.829996 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.829964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99c0b26-7368-403a-a29e-7c31a754621c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.830192 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.830009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99c0b26-7368-403a-a29e-7c31a754621c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.830192 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.830130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.830318 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.830225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j22p2\" (UniqueName: \"kubernetes.io/projected/d99c0b26-7368-403a-a29e-7c31a754621c-kube-api-access-j22p2\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.830318 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.830267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.830318 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.830308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.830465 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.830340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d99c0b26-7368-403a-a29e-7c31a754621c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.830977 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.830947 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d99c0b26-7368-403a-a29e-7c31a754621c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.832503 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.832483 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99c0b26-7368-403a-a29e-7c31a754621c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.832680 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.832664 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.833006 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.832975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.833082 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.833015 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d99c0b26-7368-403a-a29e-7c31a754621c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.845788 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.845763 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j22p2\" (UniqueName: \"kubernetes.io/projected/d99c0b26-7368-403a-a29e-7c31a754621c-kube-api-access-j22p2\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.846293 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.846276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99c0b26-7368-403a-a29e-7c31a754621c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bqkvf\" (UID: \"d99c0b26-7368-403a-a29e-7c31a754621c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.890486 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.890420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:05.930512 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.930491 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:05.987660 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:05.987632 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:06.220485 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:06.220465 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf"] Sep 17 03:23:06.222120 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:23:06.222088 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99c0b26_7368_403a_a29e_7c31a754621c.slice/crio-b0f8581e298be45cb87612ac184cdf71d7aa4f5a87c657a1a7e7f5064e914e57 WatchSource:0}: Error finding container b0f8581e298be45cb87612ac184cdf71d7aa4f5a87c657a1a7e7f5064e914e57: Status 404 returned error can't find the container with id b0f8581e298be45cb87612ac184cdf71d7aa4f5a87c657a1a7e7f5064e914e57 Sep 17 03:23:06.224127 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:06.224112 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:23:07.101617 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.101591 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" event={"ID":"d99c0b26-7368-403a-a29e-7c31a754621c","Type":"ContainerStarted","Data":"b0f8581e298be45cb87612ac184cdf71d7aa4f5a87c657a1a7e7f5064e914e57"} Sep 17 03:23:07.325723 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.325699 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:23:07.444224 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444128 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-socket\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444224 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444175 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-token\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444224 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444197 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-credential-socket\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444224 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444217 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-podinfo\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444523 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444330 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5n4m\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-kube-api-access-r5n4m\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444523 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444378 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-data\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444523 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444411 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5228d6-033c-40f3-9c8e-283ed91b6108-istiod-ca-cert\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444523 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444420 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:23:07.444523 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444436 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-envoy\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444523 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444502 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-certs\") pod \"ff5228d6-033c-40f3-9c8e-283ed91b6108\" (UID: \"ff5228d6-033c-40f3-9c8e-283ed91b6108\") " Sep 17 03:23:07.444820 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444644 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:23:07.444820 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444646 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:23:07.444820 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444792 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5228d6-033c-40f3-9c8e-283ed91b6108-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:23:07.445128 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444838 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-data\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:07.445128 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444856 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:07.445128 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444866 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-credential-socket\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:07.445128 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.444849 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:23:07.446672 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.446652 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 17 03:23:07.446794 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.446776 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:23:07.447060 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.447034 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-kube-api-access-r5n4m" (OuterVolumeSpecName: "kube-api-access-r5n4m") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "kube-api-access-r5n4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:23:07.447060 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.447038 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff5228d6-033c-40f3-9c8e-283ed91b6108" (UID: "ff5228d6-033c-40f3-9c8e-283ed91b6108"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:23:07.546160 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.546122 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-podinfo\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:07.546299 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.546169 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5n4m\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-kube-api-access-r5n4m\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:07.546299 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.546180 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5228d6-033c-40f3-9c8e-283ed91b6108-istiod-ca-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:07.546299 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.546189 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-envoy\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:07.546299 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.546197 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5228d6-033c-40f3-9c8e-283ed91b6108-workload-certs\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:07.546299 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:07.546204 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5228d6-033c-40f3-9c8e-283ed91b6108-istio-token\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:08.106489 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.106452 2579 generic.go:356] "Generic (PLEG): container finished" podID="ff5228d6-033c-40f3-9c8e-283ed91b6108" containerID="8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c" exitCode=0 Sep 17 03:23:08.106857 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.106496 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" Sep 17 03:23:08.106857 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.106531 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" event={"ID":"ff5228d6-033c-40f3-9c8e-283ed91b6108","Type":"ContainerDied","Data":"8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c"} Sep 17 03:23:08.106857 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.106578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt" event={"ID":"ff5228d6-033c-40f3-9c8e-283ed91b6108","Type":"ContainerDied","Data":"221018e6566aa1bb8e939bcb5207024aeeaa722a60e2500eccb580f968c8459b"} Sep 17 03:23:08.106857 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.106600 2579 scope.go:117] "RemoveContainer" containerID="8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c" Sep 17 03:23:08.115368 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.115351 2579 scope.go:117] "RemoveContainer" containerID="8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c" Sep 17 03:23:08.115653 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:23:08.115637 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c\": container with ID starting with 8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c not found: ID does not exist" containerID="8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c" Sep 17 03:23:08.115694 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.115663 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c"} err="failed to get container status \"8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c\": rpc error: code = NotFound desc = could not find container \"8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c\": container with ID starting with 8c88fa3d5a96a4397a1143ea972e7e1143c8e831a32c7832af37528da8688a8c not found: ID does not exist" Sep 17 03:23:08.149473 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.149445 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt"] Sep 17 03:23:08.161282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.161257 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bchwlnt"] Sep 17 03:23:08.233410 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.233383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:08.377846 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.377761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:08.460658 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.460628 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:08.819370 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.819342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:08.909363 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:08.909330 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5228d6-033c-40f3-9c8e-283ed91b6108" path="/var/lib/kubelet/pods/ff5228d6-033c-40f3-9c8e-283ed91b6108/volumes" Sep 17 03:23:09.582139 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:09.582109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:09.655105 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:09.655076 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:09.719256 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:09.719224 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:12.897525 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:12.897490 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 03:23:12.897824 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:12.897583 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 03:23:13.131008 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:13.130974 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" event={"ID":"d99c0b26-7368-403a-a29e-7c31a754621c","Type":"ContainerStarted","Data":"47717f24e62b1de9406acb8fa4fd9395449677ea42d852a55301fadda3a29076"} Sep 17 03:23:13.131374 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:13.131178 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:13.132837 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:13.132802 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-bqkvf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 17 03:23:13.132928 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:13.132864 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" podUID="d99c0b26-7368-403a-a29e-7c31a754621c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 03:23:13.154262 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:13.154157 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" podStartSLOduration=1.481119033 podStartE2EDuration="8.154119508s" totalImagesPullingTime="6.673000475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:23:13.15301138 +0000 UTC m=+632.693703579" watchObservedRunningTime="2026-09-17 03:23:13.154119508 +0000 UTC m=+632.694811697" Sep 17 03:23:13.753079 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:13.753046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:14.141993 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:14.141966 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bqkvf" Sep 17 03:23:15.095232 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:15.095205 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9fksh" Sep 17 03:23:15.097138 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:15.097117 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-2lrnv" Sep 17 03:23:16.218651 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:16.218613 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9b8bf974-w7zck"] Sep 17 03:23:16.326929 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:16.326895 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:16.427060 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:16.427033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:16.501849 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:16.501775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:24.645924 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:24.645887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:41.238324 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.238235 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f9b8bf974-w7zck" podUID="34836c06-9635-45d9-9e5f-5d29b9f95eae" containerName="console" containerID="cri-o://7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24" gracePeriod=15 Sep 17 03:23:41.480044 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.480024 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:23:41.504911 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.504849 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-service-ca\") pod \"34836c06-9635-45d9-9e5f-5d29b9f95eae\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " Sep 17 03:23:41.504911 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.504886 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-trusted-ca-bundle\") pod \"34836c06-9635-45d9-9e5f-5d29b9f95eae\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " Sep 17 03:23:41.504911 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.504912 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-oauth-serving-cert\") pod \"34836c06-9635-45d9-9e5f-5d29b9f95eae\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " Sep 17 03:23:41.505159 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.504950 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-oauth-config\") pod \"34836c06-9635-45d9-9e5f-5d29b9f95eae\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " Sep 17 03:23:41.505159 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505101 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-config\") pod \"34836c06-9635-45d9-9e5f-5d29b9f95eae\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " Sep 17 03:23:41.505272 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505168 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-serving-cert\") pod \"34836c06-9635-45d9-9e5f-5d29b9f95eae\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " Sep 17 03:23:41.505272 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505246 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl7fb\" (UniqueName: \"kubernetes.io/projected/34836c06-9635-45d9-9e5f-5d29b9f95eae-kube-api-access-gl7fb\") pod \"34836c06-9635-45d9-9e5f-5d29b9f95eae\" (UID: \"34836c06-9635-45d9-9e5f-5d29b9f95eae\") " Sep 17 03:23:41.505404 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505356 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "34836c06-9635-45d9-9e5f-5d29b9f95eae" (UID: "34836c06-9635-45d9-9e5f-5d29b9f95eae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:23:41.505404 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505364 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "34836c06-9635-45d9-9e5f-5d29b9f95eae" (UID: "34836c06-9635-45d9-9e5f-5d29b9f95eae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:23:41.505404 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505377 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-service-ca" (OuterVolumeSpecName: "service-ca") pod "34836c06-9635-45d9-9e5f-5d29b9f95eae" (UID: "34836c06-9635-45d9-9e5f-5d29b9f95eae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:23:41.505569 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505473 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-config" (OuterVolumeSpecName: "console-config") pod "34836c06-9635-45d9-9e5f-5d29b9f95eae" (UID: "34836c06-9635-45d9-9e5f-5d29b9f95eae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:23:41.505569 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505527 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:41.505569 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505546 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-trusted-ca-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:41.505569 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.505560 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-oauth-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:41.507206 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.507179 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "34836c06-9635-45d9-9e5f-5d29b9f95eae" (UID: "34836c06-9635-45d9-9e5f-5d29b9f95eae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:23:41.507385 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.507361 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "34836c06-9635-45d9-9e5f-5d29b9f95eae" (UID: "34836c06-9635-45d9-9e5f-5d29b9f95eae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:23:41.507626 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.507604 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34836c06-9635-45d9-9e5f-5d29b9f95eae-kube-api-access-gl7fb" (OuterVolumeSpecName: "kube-api-access-gl7fb") pod "34836c06-9635-45d9-9e5f-5d29b9f95eae" (UID: "34836c06-9635-45d9-9e5f-5d29b9f95eae"). InnerVolumeSpecName "kube-api-access-gl7fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:23:41.606098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.606064 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-oauth-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:41.606098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.606091 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:41.606098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.606100 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/34836c06-9635-45d9-9e5f-5d29b9f95eae-console-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:41.606348 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:41.606111 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl7fb\" (UniqueName: \"kubernetes.io/projected/34836c06-9635-45d9-9e5f-5d29b9f95eae-kube-api-access-gl7fb\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:23:42.255274 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.255243 2579 generic.go:356] "Generic (PLEG): container finished" podID="34836c06-9635-45d9-9e5f-5d29b9f95eae" containerID="7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24" exitCode=0 Sep 17 03:23:42.255671 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.255287 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f9b8bf974-w7zck" Sep 17 03:23:42.255671 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.255331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b8bf974-w7zck" event={"ID":"34836c06-9635-45d9-9e5f-5d29b9f95eae","Type":"ContainerDied","Data":"7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24"} Sep 17 03:23:42.255671 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.255381 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f9b8bf974-w7zck" event={"ID":"34836c06-9635-45d9-9e5f-5d29b9f95eae","Type":"ContainerDied","Data":"92473df88a06bb7ba4305d9df03b556c1c236b6af439fb8bce911eee59e06a89"} Sep 17 03:23:42.255671 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.255403 2579 scope.go:117] "RemoveContainer" containerID="7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24" Sep 17 03:23:42.264094 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.264080 2579 scope.go:117] "RemoveContainer" containerID="7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24" Sep 17 03:23:42.264399 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:23:42.264380 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24\": container with ID starting with 7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24 not found: ID does not exist" containerID="7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24" Sep 17 03:23:42.264464 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.264412 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24"} err="failed to get container status \"7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24\": rpc error: code = NotFound desc = could not find container \"7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24\": container with ID starting with 7ad13e9bfcaea184546eb9a5fe16a961cbf2b5b95b9d52e3163c0310f0a01f24 not found: ID does not exist" Sep 17 03:23:42.277682 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.277657 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f9b8bf974-w7zck"] Sep 17 03:23:42.281308 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.281291 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f9b8bf974-w7zck"] Sep 17 03:23:42.908765 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:42.908733 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34836c06-9635-45d9-9e5f-5d29b9f95eae" path="/var/lib/kubelet/pods/34836c06-9635-45d9-9e5f-5d29b9f95eae/volumes" Sep 17 03:23:59.729643 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:59.729604 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:23:59.829083 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:23:59.829053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:00.727091 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:00.727061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:14.615428 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:14.615399 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:17.429037 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:17.428998 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:19.214874 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:19.214783 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:19.601518 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:19.601488 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:19.858389 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:19.858301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:20.011724 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:20.011697 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:21.055267 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:21.055235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:21.848333 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:21.848304 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:21.975471 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:21.975438 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:22.076307 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:22.076274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:22.175468 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:22.175390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:23.420111 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:23.420078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:23.703044 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:23.702951 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:23.809009 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:23.808974 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:23.920809 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:23.920776 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:26.634856 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:26.634822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:26.737184 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:26.737129 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:27.214510 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:27.214478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:27.314779 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:27.314751 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:28.754650 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:28.754613 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:28.851793 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:28.851761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:30.257571 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:30.257535 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:30.355404 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:30.355370 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:30.571845 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:30.571814 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:31.329699 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:31.329668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:35.153161 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:35.153068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:35.253724 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:35.253672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:35.321817 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:35.321788 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:40.869331 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.869293 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5"] Sep 17 03:24:40.869793 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.869590 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5228d6-033c-40f3-9c8e-283ed91b6108" containerName="istio-proxy" Sep 17 03:24:40.869793 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.869602 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5228d6-033c-40f3-9c8e-283ed91b6108" containerName="istio-proxy" Sep 17 03:24:40.869793 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.869621 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34836c06-9635-45d9-9e5f-5d29b9f95eae" containerName="console" Sep 17 03:24:40.869793 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.869627 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34836c06-9635-45d9-9e5f-5d29b9f95eae" containerName="console" Sep 17 03:24:40.869793 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.869672 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5228d6-033c-40f3-9c8e-283ed91b6108" containerName="istio-proxy" Sep 17 03:24:40.869793 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.869685 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34836c06-9635-45d9-9e5f-5d29b9f95eae" containerName="console" Sep 17 03:24:40.872592 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.872568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:40.876166 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.876126 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 03:24:40.876250 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.876200 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 03:24:40.876250 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.876214 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k4b22\"" Sep 17 03:24:40.886097 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.886073 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5"] Sep 17 03:24:40.974555 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.974524 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qf96\" (UniqueName: \"kubernetes.io/projected/cc2ef400-7548-4533-8d17-59027bfceef6-kube-api-access-2qf96\") pod \"kuadrant-operator-controller-manager-5f685c496f-xskl5\" (UID: \"cc2ef400-7548-4533-8d17-59027bfceef6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:40.974703 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:40.974562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2ef400-7548-4533-8d17-59027bfceef6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-xskl5\" (UID: \"cc2ef400-7548-4533-8d17-59027bfceef6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:41.075255 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:41.075226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf96\" (UniqueName: \"kubernetes.io/projected/cc2ef400-7548-4533-8d17-59027bfceef6-kube-api-access-2qf96\") pod \"kuadrant-operator-controller-manager-5f685c496f-xskl5\" (UID: \"cc2ef400-7548-4533-8d17-59027bfceef6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:41.075440 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:41.075272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2ef400-7548-4533-8d17-59027bfceef6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-xskl5\" (UID: \"cc2ef400-7548-4533-8d17-59027bfceef6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:41.075673 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:41.075652 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2ef400-7548-4533-8d17-59027bfceef6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-xskl5\" (UID: \"cc2ef400-7548-4533-8d17-59027bfceef6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:41.091694 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:41.091663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qf96\" (UniqueName: \"kubernetes.io/projected/cc2ef400-7548-4533-8d17-59027bfceef6-kube-api-access-2qf96\") pod \"kuadrant-operator-controller-manager-5f685c496f-xskl5\" (UID: \"cc2ef400-7548-4533-8d17-59027bfceef6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:41.182559 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:41.182479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:41.465774 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:41.465690 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5"] Sep 17 03:24:41.470602 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:24:41.470570 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2ef400_7548_4533_8d17_59027bfceef6.slice/crio-db6acffb7d2578cbde5d9c389cd7417ee5b71ffeec1afdeb10fa896e67000e5a WatchSource:0}: Error finding container db6acffb7d2578cbde5d9c389cd7417ee5b71ffeec1afdeb10fa896e67000e5a: Status 404 returned error can't find the container with id db6acffb7d2578cbde5d9c389cd7417ee5b71ffeec1afdeb10fa896e67000e5a Sep 17 03:24:41.710947 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:41.710909 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5"] Sep 17 03:24:41.719674 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:41.719605 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5"] Sep 17 03:24:44.062109 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:44.062069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:44.164386 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:44.164352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:45.491480 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:45.491443 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" podUID="cc2ef400-7548-4533-8d17-59027bfceef6" containerName="manager" containerID="cri-o://4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c" gracePeriod=2 Sep 17 03:24:46.601492 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:46.601459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:46.697419 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:46.697357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:47.670574 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:47.670550 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:47.730600 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:47.730572 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2ef400-7548-4533-8d17-59027bfceef6-extensions-socket-volume\") pod \"cc2ef400-7548-4533-8d17-59027bfceef6\" (UID: \"cc2ef400-7548-4533-8d17-59027bfceef6\") " Sep 17 03:24:47.730700 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:47.730628 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qf96\" (UniqueName: \"kubernetes.io/projected/cc2ef400-7548-4533-8d17-59027bfceef6-kube-api-access-2qf96\") pod \"cc2ef400-7548-4533-8d17-59027bfceef6\" (UID: \"cc2ef400-7548-4533-8d17-59027bfceef6\") " Sep 17 03:24:47.730806 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:47.730786 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2ef400-7548-4533-8d17-59027bfceef6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cc2ef400-7548-4533-8d17-59027bfceef6" (UID: "cc2ef400-7548-4533-8d17-59027bfceef6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:24:47.732808 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:47.732784 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2ef400-7548-4533-8d17-59027bfceef6-kube-api-access-2qf96" (OuterVolumeSpecName: "kube-api-access-2qf96") pod "cc2ef400-7548-4533-8d17-59027bfceef6" (UID: "cc2ef400-7548-4533-8d17-59027bfceef6"). InnerVolumeSpecName "kube-api-access-2qf96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:24:47.831273 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:47.831246 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2ef400-7548-4533-8d17-59027bfceef6-extensions-socket-volume\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:24:47.831273 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:47.831271 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qf96\" (UniqueName: \"kubernetes.io/projected/cc2ef400-7548-4533-8d17-59027bfceef6-kube-api-access-2qf96\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:24:48.505127 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:48.505093 2579 generic.go:356] "Generic (PLEG): container finished" podID="cc2ef400-7548-4533-8d17-59027bfceef6" containerID="4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c" exitCode=137 Sep 17 03:24:48.505327 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:48.505160 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:48.505327 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:48.505201 2579 scope.go:117] "RemoveContainer" containerID="4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c" Sep 17 03:24:48.508182 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:24:48.508156 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-xskl5\" is forbidden: User \"system:node:ip-10-0-141-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-105.ec2.internal' and this object" podUID="cc2ef400-7548-4533-8d17-59027bfceef6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:48.513654 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:48.513637 2579 scope.go:117] "RemoveContainer" containerID="4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c" Sep 17 03:24:48.513921 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:24:48.513905 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c\": container with ID starting with 4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c not found: ID does not exist" containerID="4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c" Sep 17 03:24:48.513963 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:48.513929 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c"} err="failed to get container status \"4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c\": rpc error: code = NotFound desc = could not find container \"4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c\": container with ID starting with 4b1319c1ac240d431512ffb4abd9b56ce6ccc323c740252b24e2e080b2e4b25c not found: ID does not exist" Sep 17 03:24:48.516045 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:24:48.516025 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-xskl5\" is forbidden: User \"system:node:ip-10-0-141-105.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-105.ec2.internal' and this object" podUID="cc2ef400-7548-4533-8d17-59027bfceef6" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-xskl5" Sep 17 03:24:48.908340 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:48.908307 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc2ef400-7548-4533-8d17-59027bfceef6" path="/var/lib/kubelet/pods/cc2ef400-7548-4533-8d17-59027bfceef6/volumes" Sep 17 03:24:49.619035 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:49.619004 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:49.725931 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:49.725876 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:52.553035 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:52.552990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:54.423610 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:54.423575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:54.525016 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:54.524943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:55.199938 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:55.199890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:55.263916 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:55.263866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:56.198960 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:56.198920 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:24:56.298028 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:24:56.297981 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:03.264162 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:03.264115 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:03.362097 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:03.362066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:14.273839 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:14.273801 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:14.373871 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:14.373838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:27.624788 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:27.624755 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:27.728256 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:27.728228 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:27.787292 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:27.787264 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:28.444452 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.444423 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:28.528929 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.528901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:28.532451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.532429 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-8b4hd"] Sep 17 03:25:28.532689 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.532678 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2ef400-7548-4533-8d17-59027bfceef6" containerName="manager" Sep 17 03:25:28.532744 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.532690 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2ef400-7548-4533-8d17-59027bfceef6" containerName="manager" Sep 17 03:25:28.532782 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.532752 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc2ef400-7548-4533-8d17-59027bfceef6" containerName="manager" Sep 17 03:25:28.537469 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.537452 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-8b4hd" Sep 17 03:25:28.539757 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.539712 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8b4hd"] Sep 17 03:25:28.540650 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.540627 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 03:25:28.540780 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.540634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lhlnk\"" Sep 17 03:25:28.542196 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.542179 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 03:25:28.658156 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.658122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbsk\" (UniqueName: \"kubernetes.io/projected/8d464018-2274-43cb-ad5d-cbf9dbdae3ab-kube-api-access-knbsk\") pod \"authorino-59c974bd48-8b4hd\" (UID: \"8d464018-2274-43cb-ad5d-cbf9dbdae3ab\") " pod="kuadrant-system/authorino-59c974bd48-8b4hd" Sep 17 03:25:28.758993 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.758910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knbsk\" (UniqueName: \"kubernetes.io/projected/8d464018-2274-43cb-ad5d-cbf9dbdae3ab-kube-api-access-knbsk\") pod \"authorino-59c974bd48-8b4hd\" (UID: \"8d464018-2274-43cb-ad5d-cbf9dbdae3ab\") " pod="kuadrant-system/authorino-59c974bd48-8b4hd" Sep 17 03:25:28.768588 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.768562 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbsk\" (UniqueName: \"kubernetes.io/projected/8d464018-2274-43cb-ad5d-cbf9dbdae3ab-kube-api-access-knbsk\") pod \"authorino-59c974bd48-8b4hd\" (UID: \"8d464018-2274-43cb-ad5d-cbf9dbdae3ab\") " pod="kuadrant-system/authorino-59c974bd48-8b4hd" Sep 17 03:25:28.847085 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:28.847055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-8b4hd" Sep 17 03:25:29.114797 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:29.114766 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8b4hd"] Sep 17 03:25:29.120197 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:25:29.120171 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d464018_2274_43cb_ad5d_cbf9dbdae3ab.slice/crio-8f40a7f200bfa65b65d7ac129fec34e25dfcf8b22b3430ca11e3459b39201935 WatchSource:0}: Error finding container 8f40a7f200bfa65b65d7ac129fec34e25dfcf8b22b3430ca11e3459b39201935: Status 404 returned error can't find the container with id 8f40a7f200bfa65b65d7ac129fec34e25dfcf8b22b3430ca11e3459b39201935 Sep 17 03:25:29.675327 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:29.675293 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-8b4hd" event={"ID":"8d464018-2274-43cb-ad5d-cbf9dbdae3ab","Type":"ContainerStarted","Data":"8f40a7f200bfa65b65d7ac129fec34e25dfcf8b22b3430ca11e3459b39201935"} Sep 17 03:25:31.684103 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:31.684059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-8b4hd" event={"ID":"8d464018-2274-43cb-ad5d-cbf9dbdae3ab","Type":"ContainerStarted","Data":"da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b"} Sep 17 03:25:31.700846 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:31.700794 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-8b4hd" podStartSLOduration=2.113097474 podStartE2EDuration="3.70077868s" totalImagesPullingTime="1.587681206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:25:31.699535144 +0000 UTC m=+771.240227331" watchObservedRunningTime="2026-09-17 03:25:31.70077868 +0000 UTC m=+771.241470866" Sep 17 03:25:43.345220 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:43.345166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:43.440652 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:43.440586 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:43.860046 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:43.860016 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:56.493620 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:56.493587 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:56.593284 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:56.593246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:25:56.994063 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:56.994024 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66784f9dbd-rc8dj"] Sep 17 03:25:56.998351 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:56.998328 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:25:57.001163 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.001129 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 17 03:25:57.004409 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.004385 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66784f9dbd-rc8dj"] Sep 17 03:25:57.077906 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.077862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pstdp\" (UniqueName: \"kubernetes.io/projected/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-kube-api-access-pstdp\") pod \"authorino-66784f9dbd-rc8dj\" (UID: \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\") " pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:25:57.077906 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.077902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-tls-cert\") pod \"authorino-66784f9dbd-rc8dj\" (UID: \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\") " pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:25:57.178910 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.178874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pstdp\" (UniqueName: \"kubernetes.io/projected/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-kube-api-access-pstdp\") pod \"authorino-66784f9dbd-rc8dj\" (UID: \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\") " pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:25:57.178910 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.178909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-tls-cert\") pod \"authorino-66784f9dbd-rc8dj\" (UID: \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\") " pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:25:57.181465 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.181443 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-tls-cert\") pod \"authorino-66784f9dbd-rc8dj\" (UID: \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\") " pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:25:57.188273 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.188245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pstdp\" (UniqueName: \"kubernetes.io/projected/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-kube-api-access-pstdp\") pod \"authorino-66784f9dbd-rc8dj\" (UID: \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\") " pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:25:57.307908 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.307882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:25:57.579312 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.579085 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66784f9dbd-rc8dj"] Sep 17 03:25:57.581745 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:25:57.581714 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f3725b4_37f5_4897_8a82_0b8b8e571a6c.slice/crio-2215897de78e09deb18db13d71c80c7a406b214235d74e80d27f7a795538034c WatchSource:0}: Error finding container 2215897de78e09deb18db13d71c80c7a406b214235d74e80d27f7a795538034c: Status 404 returned error can't find the container with id 2215897de78e09deb18db13d71c80c7a406b214235d74e80d27f7a795538034c Sep 17 03:25:57.784423 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:57.784387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" event={"ID":"5f3725b4-37f5-4897-8a82-0b8b8e571a6c","Type":"ContainerStarted","Data":"2215897de78e09deb18db13d71c80c7a406b214235d74e80d27f7a795538034c"} Sep 17 03:25:58.790054 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:58.790011 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" event={"ID":"5f3725b4-37f5-4897-8a82-0b8b8e571a6c","Type":"ContainerStarted","Data":"1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06"} Sep 17 03:25:58.807569 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:58.807525 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" podStartSLOduration=2.231093236 podStartE2EDuration="2.807509758s" totalImagesPullingTime="576.416522ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:25:58.805308966 +0000 UTC m=+798.346001146" watchObservedRunningTime="2026-09-17 03:25:58.807509758 +0000 UTC m=+798.348201945" Sep 17 03:25:58.828696 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:58.828666 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8b4hd"] Sep 17 03:25:58.828947 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:58.828923 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-8b4hd" podUID="8d464018-2274-43cb-ad5d-cbf9dbdae3ab" containerName="authorino" containerID="cri-o://da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b" gracePeriod=30 Sep 17 03:25:59.078976 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.078950 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-8b4hd" Sep 17 03:25:59.193859 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.193823 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knbsk\" (UniqueName: \"kubernetes.io/projected/8d464018-2274-43cb-ad5d-cbf9dbdae3ab-kube-api-access-knbsk\") pod \"8d464018-2274-43cb-ad5d-cbf9dbdae3ab\" (UID: \"8d464018-2274-43cb-ad5d-cbf9dbdae3ab\") " Sep 17 03:25:59.196018 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.195982 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d464018-2274-43cb-ad5d-cbf9dbdae3ab-kube-api-access-knbsk" (OuterVolumeSpecName: "kube-api-access-knbsk") pod "8d464018-2274-43cb-ad5d-cbf9dbdae3ab" (UID: "8d464018-2274-43cb-ad5d-cbf9dbdae3ab"). InnerVolumeSpecName "kube-api-access-knbsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:25:59.295432 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.295399 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knbsk\" (UniqueName: \"kubernetes.io/projected/8d464018-2274-43cb-ad5d-cbf9dbdae3ab-kube-api-access-knbsk\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:25:59.794931 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.794899 2579 generic.go:356] "Generic (PLEG): container finished" podID="8d464018-2274-43cb-ad5d-cbf9dbdae3ab" containerID="da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b" exitCode=0 Sep 17 03:25:59.795451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.794953 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-8b4hd" Sep 17 03:25:59.795451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.794991 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-8b4hd" event={"ID":"8d464018-2274-43cb-ad5d-cbf9dbdae3ab","Type":"ContainerDied","Data":"da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b"} Sep 17 03:25:59.795451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.795032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-8b4hd" event={"ID":"8d464018-2274-43cb-ad5d-cbf9dbdae3ab","Type":"ContainerDied","Data":"8f40a7f200bfa65b65d7ac129fec34e25dfcf8b22b3430ca11e3459b39201935"} Sep 17 03:25:59.795451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.795049 2579 scope.go:117] "RemoveContainer" containerID="da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b" Sep 17 03:25:59.803240 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.803216 2579 scope.go:117] "RemoveContainer" containerID="da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b" Sep 17 03:25:59.803498 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:25:59.803481 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b\": container with ID starting with da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b not found: ID does not exist" containerID="da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b" Sep 17 03:25:59.803547 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.803507 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b"} err="failed to get container status \"da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b\": rpc error: code = NotFound desc = could not find container \"da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b\": container with ID starting with da167257619bf0c8dffe6c85933b2e0ad7d74e7df5291d7bb60ad8eaa1e72b9b not found: ID does not exist" Sep 17 03:25:59.815981 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.815959 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8b4hd"] Sep 17 03:25:59.821968 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:25:59.821944 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8b4hd"] Sep 17 03:26:00.908404 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:00.908372 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d464018-2274-43cb-ad5d-cbf9dbdae3ab" path="/var/lib/kubelet/pods/8d464018-2274-43cb-ad5d-cbf9dbdae3ab/volumes" Sep 17 03:26:03.958289 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:03.958262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:04.052056 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.052021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:04.156880 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.156851 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:04.178976 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.178947 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-fgz5t"] Sep 17 03:26:04.179258 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.179245 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d464018-2274-43cb-ad5d-cbf9dbdae3ab" containerName="authorino" Sep 17 03:26:04.179313 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.179260 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d464018-2274-43cb-ad5d-cbf9dbdae3ab" containerName="authorino" Sep 17 03:26:04.179345 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.179314 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d464018-2274-43cb-ad5d-cbf9dbdae3ab" containerName="authorino" Sep 17 03:26:04.183319 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.183302 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.186182 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.186161 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 17 03:26:04.187585 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.187569 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 17 03:26:04.187585 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.187577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qs4t2\"" Sep 17 03:26:04.187746 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.187570 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 17 03:26:04.193159 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.193118 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-fgz5t"] Sep 17 03:26:04.236877 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.236802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-webhook-cert\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.236877 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.236844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-metrics-certs\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.236877 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.236866 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzt7h\" (UniqueName: \"kubernetes.io/projected/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-kube-api-access-zzt7h\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.310325 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.310294 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:04.337787 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.337758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-webhook-cert\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.337916 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.337808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-metrics-certs\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.337916 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.337854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzt7h\" (UniqueName: \"kubernetes.io/projected/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-kube-api-access-zzt7h\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.340407 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.340379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-metrics-certs\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.340501 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.340433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-webhook-cert\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.346715 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.346697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzt7h\" (UniqueName: \"kubernetes.io/projected/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-kube-api-access-zzt7h\") pod \"maas-controller-659dc8cbc8-fgz5t\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.499528 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.499448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:04.770083 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.770057 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-fgz5t"] Sep 17 03:26:04.772281 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:26:04.772252 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fdecb1d_ab6b_4c70_9a3b_6a98bcf9c1f5.slice/crio-b769121f35128416ee898069dc81f586ebf06eb2f0d0bcc47ff1cd3b80f6a2a9 WatchSource:0}: Error finding container b769121f35128416ee898069dc81f586ebf06eb2f0d0bcc47ff1cd3b80f6a2a9: Status 404 returned error can't find the container with id b769121f35128416ee898069dc81f586ebf06eb2f0d0bcc47ff1cd3b80f6a2a9 Sep 17 03:26:04.818496 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:04.818455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" event={"ID":"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5","Type":"ContainerStarted","Data":"b769121f35128416ee898069dc81f586ebf06eb2f0d0bcc47ff1cd3b80f6a2a9"} Sep 17 03:26:07.203421 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:07.203384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:07.302412 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:07.302331 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:07.834675 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:07.834646 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" event={"ID":"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5","Type":"ContainerStarted","Data":"8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db"} Sep 17 03:26:07.834896 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:07.834879 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:07.853265 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:07.853219 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" podStartSLOduration=1.589559903 podStartE2EDuration="3.853205298s" totalImagesPullingTime="2.263645395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:26:07.851809985 +0000 UTC m=+807.392502175" watchObservedRunningTime="2026-09-17 03:26:07.853205298 +0000 UTC m=+807.393897540" Sep 17 03:26:18.840704 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:18.840676 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:26:38.624617 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:38.624580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:38.717862 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:38.717829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:40.066527 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.066499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:40.158496 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.158455 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:40.158678 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.158631 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b"] Sep 17 03:26:40.165313 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.165295 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.168058 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.168037 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 17 03:26:40.168315 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.168296 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 17 03:26:40.168416 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.168346 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 17 03:26:40.168416 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.168363 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 17 03:26:40.169551 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.169532 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mf87n\"" Sep 17 03:26:40.175093 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.175073 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b"] Sep 17 03:26:40.233451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.233422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-maas-api-tls\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.233451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.233458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.233701 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.233479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/399d86aa-3fdf-4730-8029-2308e31cea03-openshift-service-ca\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.233701 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.233568 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxn2v\" (UniqueName: \"kubernetes.io/projected/399d86aa-3fdf-4730-8029-2308e31cea03-kube-api-access-jxn2v\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.334483 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.334402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-maas-api-tls\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.334483 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.334439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.334483 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.334461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/399d86aa-3fdf-4730-8029-2308e31cea03-openshift-service-ca\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.334719 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.334494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxn2v\" (UniqueName: \"kubernetes.io/projected/399d86aa-3fdf-4730-8029-2308e31cea03-kube-api-access-jxn2v\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.334719 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:26:40.334548 2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found Sep 17 03:26:40.334719 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:26:40.334550 2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Sep 17 03:26:40.334719 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:26:40.334624 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs podName:399d86aa-3fdf-4730-8029-2308e31cea03 nodeName:}" failed. No retries permitted until 2026-09-17 03:26:40.834607371 +0000 UTC m=+840.375299535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs") pod "maas-api-59f6566bbc-rqf4b" (UID: "399d86aa-3fdf-4730-8029-2308e31cea03") : secret "maas-api-metrics-tls" not found Sep 17 03:26:40.334719 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:26:40.334638 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-maas-api-tls podName:399d86aa-3fdf-4730-8029-2308e31cea03 nodeName:}" failed. No retries permitted until 2026-09-17 03:26:40.834632495 +0000 UTC m=+840.375324660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-maas-api-tls") pod "maas-api-59f6566bbc-rqf4b" (UID: "399d86aa-3fdf-4730-8029-2308e31cea03") : secret "maas-api-serving-cert" not found Sep 17 03:26:40.335111 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.335093 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/399d86aa-3fdf-4730-8029-2308e31cea03-openshift-service-ca\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.345943 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.345908 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxn2v\" (UniqueName: \"kubernetes.io/projected/399d86aa-3fdf-4730-8029-2308e31cea03-kube-api-access-jxn2v\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.527779 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.527749 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:40.617093 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.617006 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:40.703245 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.703212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:40.840235 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.840202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-maas-api-tls\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.840554 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.840525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:40.840694 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:26:40.840672 2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found Sep 17 03:26:40.840915 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:26:40.840901 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs podName:399d86aa-3fdf-4730-8029-2308e31cea03 nodeName:}" failed. No retries permitted until 2026-09-17 03:26:41.840877101 +0000 UTC m=+841.381569271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs") pod "maas-api-59f6566bbc-rqf4b" (UID: "399d86aa-3fdf-4730-8029-2308e31cea03") : secret "maas-api-metrics-tls" not found Sep 17 03:26:40.843503 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:40.843480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-maas-api-tls\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:41.095581 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:41.095549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:41.848182 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:41.848123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:41.850764 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:41.850743 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/399d86aa-3fdf-4730-8029-2308e31cea03-metrics-certs\") pod \"maas-api-59f6566bbc-rqf4b\" (UID: \"399d86aa-3fdf-4730-8029-2308e31cea03\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:41.978969 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:41.978939 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mf87n\"" Sep 17 03:26:41.987453 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:41.987429 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:42.265517 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:42.265488 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b"] Sep 17 03:26:42.267854 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:26:42.267826 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399d86aa_3fdf_4730_8029_2308e31cea03.slice/crio-1953da72e46ac6cda8f1e2ccdefc24d0041deda66a1f5df096d9d018be60a4c0 WatchSource:0}: Error finding container 1953da72e46ac6cda8f1e2ccdefc24d0041deda66a1f5df096d9d018be60a4c0: Status 404 returned error can't find the container with id 1953da72e46ac6cda8f1e2ccdefc24d0041deda66a1f5df096d9d018be60a4c0 Sep 17 03:26:42.984415 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:42.984370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" event={"ID":"399d86aa-3fdf-4730-8029-2308e31cea03","Type":"ContainerStarted","Data":"1953da72e46ac6cda8f1e2ccdefc24d0041deda66a1f5df096d9d018be60a4c0"} Sep 17 03:26:43.989928 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:43.989835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" event={"ID":"399d86aa-3fdf-4730-8029-2308e31cea03","Type":"ContainerStarted","Data":"f2eb9c8425b46b2ba2587df8be288622b52ba3848f1563db6bef66baf2cf4121"} Sep 17 03:26:43.990430 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:43.989963 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:44.006713 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:44.006661 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" podStartSLOduration=2.566154279 podStartE2EDuration="4.006644947s" totalImagesPullingTime="1.440490668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:26:44.006374791 +0000 UTC m=+843.547066982" watchObservedRunningTime="2026-09-17 03:26:44.006644947 +0000 UTC m=+843.547337135" Sep 17 03:26:49.999802 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:49.999774 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-rqf4b" Sep 17 03:26:51.000682 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:51.000624 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:26:51.099585 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:26:51.099555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:27:21.345642 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:21.345605 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:27:25.425303 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.425274 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2"] Sep 17 03:27:25.428895 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.428871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.433248 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.433216 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 17 03:27:25.433374 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.433276 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tvzh7\"" Sep 17 03:27:25.433374 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.433304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 17 03:27:25.433374 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.433320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 17 03:27:25.436507 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.436487 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2"] Sep 17 03:27:25.452998 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.452969 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:27:25.600269 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.600229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.600430 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.600327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.600430 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.600353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.600430 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.600369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkzf5\" (UniqueName: \"kubernetes.io/projected/92083494-be2c-4813-a73d-30b9054c2721-kube-api-access-hkzf5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.600531 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.600443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92083494-be2c-4813-a73d-30b9054c2721-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.600531 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.600489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.701710 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.701628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92083494-be2c-4813-a73d-30b9054c2721-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.701710 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.701664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.701893 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.701809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.701929 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.701893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.701962 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.701930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.702018 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.701957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkzf5\" (UniqueName: \"kubernetes.io/projected/92083494-be2c-4813-a73d-30b9054c2721-kube-api-access-hkzf5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.702200 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.702137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.702354 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.702261 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.702354 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.702283 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.704342 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.704316 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92083494-be2c-4813-a73d-30b9054c2721-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.704451 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.704436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92083494-be2c-4813-a73d-30b9054c2721-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.715574 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.715554 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkzf5\" (UniqueName: \"kubernetes.io/projected/92083494-be2c-4813-a73d-30b9054c2721-kube-api-access-hkzf5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sqqz2\" (UID: \"92083494-be2c-4813-a73d-30b9054c2721\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:25.756786 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:25.756749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:26.029135 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:26.029065 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2"] Sep 17 03:27:26.034220 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:27:26.034193 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92083494_be2c_4813_a73d_30b9054c2721.slice/crio-1967b44b5db15be62c01d9c280976d02e679b6b7ceaa5842b20a75956090d559 WatchSource:0}: Error finding container 1967b44b5db15be62c01d9c280976d02e679b6b7ceaa5842b20a75956090d559: Status 404 returned error can't find the container with id 1967b44b5db15be62c01d9c280976d02e679b6b7ceaa5842b20a75956090d559 Sep 17 03:27:26.162445 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:26.162414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" event={"ID":"92083494-be2c-4813-a73d-30b9054c2721","Type":"ContainerStarted","Data":"1967b44b5db15be62c01d9c280976d02e679b6b7ceaa5842b20a75956090d559"} Sep 17 03:27:27.168588 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:27.168552 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" event={"ID":"92083494-be2c-4813-a73d-30b9054c2721","Type":"ContainerStarted","Data":"8b8da27f6f9389c64ebc759fc6f067976cda6919f23f1c65228098370de7643d"} Sep 17 03:27:27.188612 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:27.188561 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" podStartSLOduration=1.143959421 podStartE2EDuration="2.188545208s" totalImagesPullingTime="1.044585787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:27:27.186482006 +0000 UTC m=+886.727174203" watchObservedRunningTime="2026-09-17 03:27:27.188545208 +0000 UTC m=+886.729237395" Sep 17 03:27:35.757774 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:35.757668 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:35.757774 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:35.757740 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:35.769956 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:35.769933 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:36.216550 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:36.216520 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sqqz2" Sep 17 03:27:40.869305 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:40.869276 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:27:40.871411 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:40.871385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:27:44.630522 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.630488 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm"] Sep 17 03:27:44.633703 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.633684 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.636661 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.636626 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 17 03:27:44.644064 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.644034 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm"] Sep 17 03:27:44.665969 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.665939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.666132 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.665988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgg6\" (UniqueName: \"kubernetes.io/projected/ad58450b-6670-4726-a047-f428c152ff36-kube-api-access-mhgg6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.666132 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.666013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.666132 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.666114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.666319 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.666184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.666319 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.666212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad58450b-6670-4726-a047-f428c152ff36-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.678888 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.678861 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:27:44.767565 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.767533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.767719 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.767571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.767719 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.767589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad58450b-6670-4726-a047-f428c152ff36-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.767719 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.767615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.767719 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.767651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgg6\" (UniqueName: \"kubernetes.io/projected/ad58450b-6670-4726-a047-f428c152ff36-kube-api-access-mhgg6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.767719 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.767673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.767955 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.767939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.768022 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.767998 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.768076 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.768018 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.770042 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.770013 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad58450b-6670-4726-a047-f428c152ff36-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.770288 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.770273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad58450b-6670-4726-a047-f428c152ff36-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.775853 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.775830 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgg6\" (UniqueName: \"kubernetes.io/projected/ad58450b-6670-4726-a047-f428c152ff36-kube-api-access-mhgg6\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm\" (UID: \"ad58450b-6670-4726-a047-f428c152ff36\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:44.946508 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:44.946416 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:45.216394 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:45.216368 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm"] Sep 17 03:27:45.218328 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:27:45.218300 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad58450b_6670_4726_a047_f428c152ff36.slice/crio-9604d09fb01b76c4732d2beb9feee27ae1503a2fd186d856ab75ef7eeabb3470 WatchSource:0}: Error finding container 9604d09fb01b76c4732d2beb9feee27ae1503a2fd186d856ab75ef7eeabb3470: Status 404 returned error can't find the container with id 9604d09fb01b76c4732d2beb9feee27ae1503a2fd186d856ab75ef7eeabb3470 Sep 17 03:27:45.242041 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:45.242011 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" event={"ID":"ad58450b-6670-4726-a047-f428c152ff36","Type":"ContainerStarted","Data":"9604d09fb01b76c4732d2beb9feee27ae1503a2fd186d856ab75ef7eeabb3470"} Sep 17 03:27:46.249797 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:46.249749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" event={"ID":"ad58450b-6670-4726-a047-f428c152ff36","Type":"ContainerStarted","Data":"2dfd95d9130548d6fda6407fe485dfc336451b175451b1146fcce2389588a4d7"} Sep 17 03:27:46.276112 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:46.276060 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" podStartSLOduration=2.11342303 podStartE2EDuration="2.27604341s" totalImagesPullingTime="162.62038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:27:46.273787158 +0000 UTC m=+905.814479345" watchObservedRunningTime="2026-09-17 03:27:46.27604341 +0000 UTC m=+905.816735597" Sep 17 03:27:54.946830 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:54.946792 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:54.947464 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:54.946871 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:54.959308 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:54.959282 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:55.297778 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:55.297753 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-x68sm" Sep 17 03:27:59.660503 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:27:59.660468 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:02.769524 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:02.769491 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:08.166282 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:08.166219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:13.070098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:13.070065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:26.569334 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:26.569301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:30.717496 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:30.717452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:37.025485 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:37.025440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:37.077247 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:37.077212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:41.605109 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:41.605072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:28:41.663436 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:28:41.663410 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:30:22.272042 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.272004 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66784f9dbd-rc8dj"] Sep 17 03:30:22.272572 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.272258 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" podUID="5f3725b4-37f5-4897-8a82-0b8b8e571a6c" containerName="authorino" containerID="cri-o://1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06" gracePeriod=30 Sep 17 03:30:22.520863 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.520838 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:30:22.589782 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.589757 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pstdp\" (UniqueName: \"kubernetes.io/projected/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-kube-api-access-pstdp\") pod \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\" (UID: \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\") " Sep 17 03:30:22.589967 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.589788 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-tls-cert\") pod \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\" (UID: \"5f3725b4-37f5-4897-8a82-0b8b8e571a6c\") " Sep 17 03:30:22.592053 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.592022 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-kube-api-access-pstdp" (OuterVolumeSpecName: "kube-api-access-pstdp") pod "5f3725b4-37f5-4897-8a82-0b8b8e571a6c" (UID: "5f3725b4-37f5-4897-8a82-0b8b8e571a6c"). InnerVolumeSpecName "kube-api-access-pstdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:30:22.599821 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.599776 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5f3725b4-37f5-4897-8a82-0b8b8e571a6c" (UID: "5f3725b4-37f5-4897-8a82-0b8b8e571a6c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:30:22.638372 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.638346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:30:22.691098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.691059 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pstdp\" (UniqueName: \"kubernetes.io/projected/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-kube-api-access-pstdp\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:30:22.691098 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.691084 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f3725b4-37f5-4897-8a82-0b8b8e571a6c-tls-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:30:22.725347 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.725313 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:30:22.799409 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.799379 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:30:22.810492 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.810455 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-fgz5t"] Sep 17 03:30:22.810747 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.810720 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" podUID="7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" containerName="manager" containerID="cri-o://8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db" gracePeriod=30 Sep 17 03:30:22.927309 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.927274 2579 generic.go:356] "Generic (PLEG): container finished" podID="5f3725b4-37f5-4897-8a82-0b8b8e571a6c" containerID="1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06" exitCode=0 Sep 17 03:30:22.927469 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.927323 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" Sep 17 03:30:22.927469 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.927333 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" event={"ID":"5f3725b4-37f5-4897-8a82-0b8b8e571a6c","Type":"ContainerDied","Data":"1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06"} Sep 17 03:30:22.927469 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.927373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66784f9dbd-rc8dj" event={"ID":"5f3725b4-37f5-4897-8a82-0b8b8e571a6c","Type":"ContainerDied","Data":"2215897de78e09deb18db13d71c80c7a406b214235d74e80d27f7a795538034c"} Sep 17 03:30:22.927469 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.927398 2579 scope.go:117] "RemoveContainer" containerID="1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06" Sep 17 03:30:22.936590 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.936571 2579 scope.go:117] "RemoveContainer" containerID="1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06" Sep 17 03:30:22.936940 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:30:22.936911 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06\": container with ID starting with 1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06 not found: ID does not exist" containerID="1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06" Sep 17 03:30:22.937012 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.936954 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06"} err="failed to get container status \"1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06\": rpc error: code = NotFound desc = could not find container \"1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06\": container with ID starting with 1bcda8b2c465c9425c2be32dd694741a0679d5d6a1c844044e8e730ef608be06 not found: ID does not exist" Sep 17 03:30:22.944928 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.944897 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66784f9dbd-rc8dj"] Sep 17 03:30:22.950206 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:22.950182 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66784f9dbd-rc8dj"] Sep 17 03:30:23.349986 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.349958 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:30:23.396679 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.396651 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-webhook-cert\") pod \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " Sep 17 03:30:23.396841 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.396688 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzt7h\" (UniqueName: \"kubernetes.io/projected/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-kube-api-access-zzt7h\") pod \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " Sep 17 03:30:23.396841 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.396749 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-metrics-certs\") pod \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\" (UID: \"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5\") " Sep 17 03:30:23.398984 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.398956 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" (UID: "7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:30:23.399116 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.399063 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" (UID: "7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:30:23.399116 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.399090 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-kube-api-access-zzt7h" (OuterVolumeSpecName: "kube-api-access-zzt7h") pod "7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" (UID: "7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5"). InnerVolumeSpecName "kube-api-access-zzt7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:30:23.497808 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.497730 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-webhook-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:30:23.497808 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.497757 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzt7h\" (UniqueName: \"kubernetes.io/projected/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-kube-api-access-zzt7h\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:30:23.497808 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.497767 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5-metrics-certs\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Sep 17 03:30:23.932226 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.932190 2579 generic.go:356] "Generic (PLEG): container finished" podID="7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" containerID="8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db" exitCode=0 Sep 17 03:30:23.932409 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.932240 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" Sep 17 03:30:23.932409 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.932278 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" event={"ID":"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5","Type":"ContainerDied","Data":"8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db"} Sep 17 03:30:23.932409 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.932329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-659dc8cbc8-fgz5t" event={"ID":"7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5","Type":"ContainerDied","Data":"b769121f35128416ee898069dc81f586ebf06eb2f0d0bcc47ff1cd3b80f6a2a9"} Sep 17 03:30:23.932409 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.932360 2579 scope.go:117] "RemoveContainer" containerID="8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db" Sep 17 03:30:23.940848 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.940830 2579 scope.go:117] "RemoveContainer" containerID="8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db" Sep 17 03:30:23.941092 ip-10-0-141-105 kubenswrapper[2579]: E0917 03:30:23.941069 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db\": container with ID starting with 8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db not found: ID does not exist" containerID="8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db" Sep 17 03:30:23.941184 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.941105 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db"} err="failed to get container status \"8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db\": rpc error: code = NotFound desc = could not find container \"8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db\": container with ID starting with 8cdee161146c1bf0f2921d1df947f2d64395f86e0547b243a7eebb827c62b4db not found: ID does not exist" Sep 17 03:30:23.956399 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.956374 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-fgz5t"] Sep 17 03:30:23.959087 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:23.959060 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-659dc8cbc8-fgz5t"] Sep 17 03:30:24.909555 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:24.909523 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f3725b4-37f5-4897-8a82-0b8b8e571a6c" path="/var/lib/kubelet/pods/5f3725b4-37f5-4897-8a82-0b8b8e571a6c/volumes" Sep 17 03:30:24.909918 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:24.909849 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" path="/var/lib/kubelet/pods/7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5/volumes" Sep 17 03:30:39.723138 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:39.723033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:30:39.796779 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:30:39.796723 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:05.236515 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:05.236484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:05.627920 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:05.627884 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:06.829413 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:06.829373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:06.951972 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:06.951927 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:07.938758 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:07.938717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:08.038859 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:08.038815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:19.200236 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:19.200138 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:19.299252 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:19.299221 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:22.222842 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:22.222809 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lqn4s_26df3765-8233-4f0a-93ad-22aaca3b7460/global-pull-secret-syncer/0.log" Sep 17 03:31:22.268415 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:22.268387 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" Sep 17 03:31:22.372613 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:22.372586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-105.ec2.internal_c9ea5fe55135c7b1e5541fdd12fac4be/haproxy/0.log" Sep 17 03:31:28.635934 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:28.635902 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lxh2_22097a94-19a8-43f0-bf74-781e3568ff4e/node-exporter/0.log" Sep 17 03:31:28.660747 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:28.660715 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lxh2_22097a94-19a8-43f0-bf74-781e3568ff4e/kube-rbac-proxy/0.log" Sep 17 03:31:28.695814 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:28.695794 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8lxh2_22097a94-19a8-43f0-bf74-781e3568ff4e/init-textfile/0.log" Sep 17 03:31:29.194811 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:29.194782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-754d5dd9c9-mb7v9_e3d5dfe4-889e-4009-a65c-7435d3b8487d/telemeter-client/0.log" Sep 17 03:31:29.219116 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:29.219094 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-754d5dd9c9-mb7v9_e3d5dfe4-889e-4009-a65c-7435d3b8487d/reload/0.log" Sep 17 03:31:29.239964 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:29.239941 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-754d5dd9c9-mb7v9_e3d5dfe4-889e-4009-a65c-7435d3b8487d/kube-rbac-proxy/0.log" Sep 17 03:31:29.870634 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:29.870595 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:29.930311 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:29.930278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b2jc4_9b304f45-3678-4e3b-9a50-f562d4957f86/konnectivity-agent/0.log" limit=1024 Sep 17 03:31:33.264913 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.264879 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585"] Sep 17 03:31:33.265301 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.265202 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f3725b4-37f5-4897-8a82-0b8b8e571a6c" containerName="authorino" Sep 17 03:31:33.265301 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.265269 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f3725b4-37f5-4897-8a82-0b8b8e571a6c" containerName="authorino" Sep 17 03:31:33.265301 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.265280 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" containerName="manager" Sep 17 03:31:33.265301 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.265286 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" containerName="manager" Sep 17 03:31:33.265435 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.265351 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fdecb1d-ab6b-4c70-9a3b-6a98bcf9c1f5" containerName="manager" Sep 17 03:31:33.265435 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.265360 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f3725b4-37f5-4897-8a82-0b8b8e571a6c" containerName="authorino" Sep 17 03:31:33.268266 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.268241 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.271205 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.271178 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnnlt\"/\"openshift-service-ca.crt\"" Sep 17 03:31:33.271324 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.271214 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dnnlt\"/\"default-dockercfg-v2wjg\"" Sep 17 03:31:33.272602 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.272587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dnnlt\"/\"kube-root-ca.crt\"" Sep 17 03:31:33.279404 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.279385 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585"] Sep 17 03:31:33.363547 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.363512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-lib-modules\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.363746 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.363563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps8p7\" (UniqueName: \"kubernetes.io/projected/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-kube-api-access-ps8p7\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.363746 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.363621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-podres\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.363746 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.363644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-proc\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.363746 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.363738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-sys\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464476 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-podres\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464476 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-proc\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-sys\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-lib-modules\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps8p7\" (UniqueName: \"kubernetes.io/projected/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-kube-api-access-ps8p7\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-proc\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-podres\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464645 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-sys\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.464726 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.464713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-lib-modules\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.475195 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.475170 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps8p7\" (UniqueName: \"kubernetes.io/projected/8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a-kube-api-access-ps8p7\") pod \"perf-node-gather-daemonset-c6585\" (UID: \"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a\") " pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.577706 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.577667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:33.847636 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:33.847615 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585"] Sep 17 03:31:33.850129 ip-10-0-141-105 kubenswrapper[2579]: W0917 03:31:33.850083 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8102e41c_3a4d_4f6e_9a5d_2cc548ddd29a.slice/crio-de365707d9c972fbd1255544e9fff4460b1dbd9256ec682468006a1b5e838d19 WatchSource:0}: Error finding container de365707d9c972fbd1255544e9fff4460b1dbd9256ec682468006a1b5e838d19: Status 404 returned error can't find the container with id de365707d9c972fbd1255544e9fff4460b1dbd9256ec682468006a1b5e838d19 Sep 17 03:31:34.218429 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:34.218341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" event={"ID":"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a","Type":"ContainerStarted","Data":"5efa0efd881e56e3cba6dc41c3addb92dc10d36c324aeee615e1b34ebe1eafc3"} Sep 17 03:31:34.218429 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:34.218391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" event={"ID":"8102e41c-3a4d-4f6e-9a5d-2cc548ddd29a","Type":"ContainerStarted","Data":"de365707d9c972fbd1255544e9fff4460b1dbd9256ec682468006a1b5e838d19"} Sep 17 03:31:34.218609 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:34.218485 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:34.235198 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:34.235132 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" podStartSLOduration=1.235115036 podStartE2EDuration="1.235115036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:31:34.234696099 +0000 UTC m=+1133.775388287" watchObservedRunningTime="2026-09-17 03:31:34.235115036 +0000 UTC m=+1133.775807224" Sep 17 03:31:34.264711 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:34.264693 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6lgbn_e06810de-29ab-4710-bb7c-a7460788d700/dns/0.log" Sep 17 03:31:34.285411 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:34.285395 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6lgbn_e06810de-29ab-4710-bb7c-a7460788d700/kube-rbac-proxy/0.log" Sep 17 03:31:34.448195 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:34.448166 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhp9t_b4a61839-eb50-4c74-8640-6414c11ae80d/dns-node-resolver/0.log" Sep 17 03:31:35.002795 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:35.002768 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54667bf9b4-9dn5h_897be0b4-b25f-4e3d-823f-7c69493ee9dc/registry/0.log" Sep 17 03:31:35.069722 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:35.069694 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j76qf_49aaad79-7f59-4a60-99e4-b5d9007b6a85/node-ca/0.log" Sep 17 03:31:35.999053 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:35.999021 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bqkvf_d99c0b26-7368-403a-a29e-7c31a754621c/discovery/0.log" Sep 17 03:31:36.795373 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:36.795347 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m8jj5_8f458e55-2a05-43ea-b1d7-bf292c53da3a/serve-healthcheck-canary/0.log" Sep 17 03:31:37.310255 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:37.310228 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llh9t_70134c4c-d910-40d5-9000-7b948919c514/kube-rbac-proxy/0.log" Sep 17 03:31:37.329802 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:37.329782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llh9t_70134c4c-d910-40d5-9000-7b948919c514/exporter/0.log" Sep 17 03:31:37.349558 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:37.349535 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llh9t_70134c4c-d910-40d5-9000-7b948919c514/extractor/0.log" Sep 17 03:31:39.608432 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:39.608408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2lrnv_4bc68fe4-15e7-429e-818a-0f3240d271f1/server/0.log" Sep 17 03:31:39.672197 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:39.672171 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9fksh_e926cf37-3538-44e5-a065-5c80b2a6f57e/manager/0.log" Sep 17 03:31:39.828914 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:39.828883 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9b769b77-v8j7v_9fd21997-669e-4a64-95ee-27a62c0d36dc/manager/0.log" Sep 17 03:31:39.848316 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:39.848292 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b9b769b77-v8j7v_9fd21997-669e-4a64-95ee-27a62c0d36dc/copy-manifests/0.log" Sep 17 03:31:40.232483 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:40.232455 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dnnlt/perf-node-gather-daemonset-c6585" Sep 17 03:31:41.005277 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:41.005250 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dd99db947-r7fgh_45c4ea28-ae8e-4018-9d64-8093ed157e55/manager/0.log" Sep 17 03:31:42.494960 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:42.494882 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bqkvf_d99c0b26-7368-403a-a29e-7c31a754621c/discovery/0.log" Sep 17 03:31:43.834055 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:43.834024 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bqkvf_d99c0b26-7368-403a-a29e-7c31a754621c/discovery/0.log" Sep 17 03:31:47.940856 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:47.940821 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdgpz_3626474d-05b8-4a4b-bfbe-36ea2c0bf623/kube-multus-additional-cni-plugins/0.log" Sep 17 03:31:47.961701 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:47.961674 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdgpz_3626474d-05b8-4a4b-bfbe-36ea2c0bf623/egress-router-binary-copy/0.log" Sep 17 03:31:47.980953 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:47.980932 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdgpz_3626474d-05b8-4a4b-bfbe-36ea2c0bf623/cni-plugins/0.log" Sep 17 03:31:47.999661 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:47.999640 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdgpz_3626474d-05b8-4a4b-bfbe-36ea2c0bf623/bond-cni-plugin/0.log" Sep 17 03:31:48.019814 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:48.019796 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdgpz_3626474d-05b8-4a4b-bfbe-36ea2c0bf623/routeoverride-cni/0.log" Sep 17 03:31:48.040362 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:48.040337 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdgpz_3626474d-05b8-4a4b-bfbe-36ea2c0bf623/whereabouts-cni-bincopy/0.log" Sep 17 03:31:48.060080 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:48.060057 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdgpz_3626474d-05b8-4a4b-bfbe-36ea2c0bf623/whereabouts-cni/0.log" Sep 17 03:31:48.296295 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:48.296266 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qsllp_a4da1c28-24f8-475f-a256-35018049771d/kube-multus/0.log" Sep 17 03:31:48.404576 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:48.404547 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rxmmr_b593d1c3-6930-4400-b8b8-7d7783c21668/network-metrics-daemon/0.log" Sep 17 03:31:48.422841 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:48.422814 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rxmmr_b593d1c3-6930-4400-b8b8-7d7783c21668/kube-rbac-proxy/0.log" Sep 17 03:31:49.415704 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.415623 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-controller/0.log" Sep 17 03:31:49.430808 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.430784 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/0.log" Sep 17 03:31:49.430808 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.430786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovn-acl-logging/1.log" Sep 17 03:31:49.450549 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.450528 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/kube-rbac-proxy-node/0.log" Sep 17 03:31:49.468508 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.468487 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 03:31:49.484072 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.484050 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/northd/0.log" Sep 17 03:31:49.502462 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.502441 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/nbdb/0.log" Sep 17 03:31:49.524389 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.524368 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/sbdb/0.log" Sep 17 03:31:49.558323 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:49.558293 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g2dhb_7a101863-d5a8-4d6e-872d-43de5ac27fc3/ovnkube-controller/0.log" Sep 17 03:31:50.850785 ip-10-0-141-105 kubenswrapper[2579]: I0917 03:31:50.850757 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-b8ns5_6120ddfe-4f62-41b6-bd1f-31149386ea9b/network-check-target-container/0.log"